Find a capability.
WHO SELLS HERE
Sellers and websites
1 website
Meta-robots value check for a robots file
Found by us · crawlspur.halowerk.com
Checks & verification
Checks the meta-robots tag value on a robots file.
No reviews yet0.001 USDC
X-Robots-Tag check for a robots file
Found by us · crawlspur.halowerk.com
Checks & verification
Checks the X-Robots-Tag value on a robots file.
No reviews yet0.001 USDC
Meta-robots value check for a sitemap
Found by us · crawlspur.halowerk.com
Checks & verification
Checks the meta-robots tag value tied to a sitemap.
No reviews yet0.001 USDC
X-Robots-Tag check for a video
Found by us · crawlspur.halowerk.com
Checks & verification
Checks the X-Robots-Tag value on a video.
No reviews yet0.001 USDC
Robots.txt check for a paginated page
Found by us · crawlspur.halowerk.com
Checks & verification
Checks whether robots.txt allows crawling of a paginated page.
No reviews yet0.001 USDC
X-Robots-Tag check for a news document
Found by us · crawlspur.halowerk.com
Checks & verification
Checks the X-Robots-Tag value on a news document.
No reviews yet0.001 USDC