EVERY CAPABILITY
All capabilities
35 capabilities on 1 shelf · on crawlspur.halowerk.com · every website
Checks & verification 35
Meta-robots value check for a robots file
Found by us · crawlspur.halowerk.com
Checks & verification
Checks the meta-robots tag value on a robots file.
X-Robots-Tag check for a robots file
Found by us · crawlspur.halowerk.com
Checks & verification
Checks the X-Robots-Tag value on a robots file.
Meta-robots value check for a sitemap
Found by us · crawlspur.halowerk.com
Checks & verification
Checks the meta-robots tag value tied to a sitemap.
X-Robots-Tag check for a video
Found by us · crawlspur.halowerk.com
Checks & verification
Checks the X-Robots-Tag value on a video.
Robots.txt check for a paginated page
Found by us · crawlspur.halowerk.com
Checks & verification
Checks whether robots.txt allows crawling of a paginated page.
X-Robots-Tag check for a news document
Found by us · crawlspur.halowerk.com
Checks & verification
Checks the X-Robots-Tag value on a news document.
Meta-robots value check for pagination
Found by us · crawlspur.halowerk.com
Checks & verification
Checks the meta-robots tag value on a paginated page.
Indexability check for a URL rule
Found by us · crawlspur.halowerk.com
Checks & verification
Checks whether a URL rule is technically indexable.
Robots.txt check for a canonical URL
Found by us · crawlspur.halowerk.com
Checks & verification
Checks whether robots.txt allows crawling of a canonical URL.
Check a page's technical indexability
Found by us · crawlspur.halowerk.com
Checks & verification
Tells you whether a page object is technically indexable.
Check a robots file's technical indexability
Found by us · crawlspur.halowerk.com
Checks & verification
Tells you whether a robots file object is technically indexable.
Check whether robots.txt allows a page
Found by us · crawlspur.halowerk.com
Checks & verification
Tells you whether a page object is allowed by that site's robots.txt.
Check whether robots.txt allows an image
Found by us · crawlspur.halowerk.com
Checks & verification
Tells you whether an image object is allowed by that site's robots.txt.
Check the meta-robots value on a news document
Found by us · crawlspur.halowerk.com
Checks & verification
Gives you the value of the meta-robots specification for a news document.
Check the value of an image's meta-robots tag
Found by us · crawlspur.halowerk.com
Checks & verification
Gives you the value of the meta-robots specification for an image object.
Check a sitemap's technical indexability
Found by us · crawlspur.halowerk.com
Checks & verification
Tells you whether a sitemap object is technically indexable.
Check whether robots.txt allows a video
Found by us · crawlspur.halowerk.com
Checks & verification
Tells you whether a video object is allowed by that site's robots.txt.
Check whether robots.txt allows a URL rule
Found by us · crawlspur.halowerk.com
Checks & verification
Tells you whether a URL rule is allowed by that site's robots.txt.
Check the value of a canonical meta-robots tag
Found by us · crawlspur.halowerk.com
Checks & verification
Gives you the value of the meta-robots specification for a canonical object.
Check whether robots.txt allows a robots file
Found by us · crawlspur.halowerk.com
Checks & verification
Tells you whether a robots file object is allowed by robots.txt.
Check whether robots.txt allows a document
Found by us · crawlspur.halowerk.com
Checks & verification
Tells you whether a news document is allowed by that site's robots.txt.
Check whether robots.txt allows a URL
Found by us · crawlspur.halowerk.com
Checks & verification
Tells you whether a URL is allowed by that site's robots.txt.
Check the value of a meta robots tag
Found by us · crawlspur.halowerk.com
Checks & verification
Gives you the value of a page's meta-robots specification.
Image X-Robots-Tag value check
Found by us · crawlspur.halowerk.com
Checks & verification
Tells you the value of an image's X-Robots-Tag response header.
Parameter URL meta robots value check
Found by us · crawlspur.halowerk.com
Checks & verification
Tells you the value of a parameterized URL's meta robots tag.
URL rule X-Robots-Tag value check
Found by us · crawlspur.halowerk.com
Checks & verification
Tells you the value of the X-Robots-Tag response header for a URL rule.
Pagination X-Robots-Tag value check
Found by us · crawlspur.halowerk.com
Checks & verification
Tells you the value of a paginated page's X-Robots-Tag response header.
Meta robots tag value check
Found by us · crawlspur.halowerk.com
Checks & verification
Tells you the value of a page's meta robots tag.
Sitemap robots.txt permission check
Found by us · crawlspur.halowerk.com
Checks & verification
Tells you whether robots.txt allows crawling of a sitemap.
Sitemap X-Robots-Tag value check
Found by us · crawlspur.halowerk.com
Checks & verification
Tells you the value of a sitemap's X-Robots-Tag response header.
X-Robots-Tag value check
Found by us · crawlspur.halowerk.com
Checks & verification
Tells you the value of a page's X-Robots-Tag response header.
Meta-robots check for video objects
Found by us · crawlspur.halowerk.com
Checks & verification
Checks the meta-robots value for a video object on a page.
Page X-Robots-Tag value check
Found by us · crawlspur.halowerk.com
Checks & verification
Checks the X-Robots-Tag value for a page.
X-Robots-Tag value check
Found by us · crawlspur.halowerk.com
Checks & verification
Checks the X-Robots-Tag value for a URL with parameters.
URL parameter indexability check
Found by us · crawlspur.halowerk.com
Checks & verification
Checks whether a URL with parameters is technically indexable by search engines.