AI Bot Access Tester
Test your robots.txt file against modern AI web crawlers. See if OpenAI, Anthropic, Perplexity, and others are allowed to scrape your content for AI training.
Configuration
The specific URL path you want to test (e.g., / or /private-data/).
How it works
This tool locally parses the rules exactly as a standard web crawler would. It checks for exact `User-agent` matches first, falling back to the `*` wildcard if a specific bot isn't mentioned. It evaluates paths based on standard robots.txt prefix matching and longest-rule prioritization.
Bot Evaluation Results
Click Run Access Test to analyze your configuration.