io.github.sharozdawa/robotstxt-ai
Analyze and generate robots.txt with AI crawler detection for 20+ bots like GPTBot and ClaudeBot.
★ 0No licensedevtools
Install
Config snippet generator goes here (5 client tabs)
Analyze and generate robots.txt with AI crawler detection for 20+ bots like GPTBot and ClaudeBot.
Config snippet generator goes here (5 client tabs)