← All tools
Web & research
Robots.txt reader
Turn pasted crawler directives into structured data.
Your results will appear here.
Enter a value or load an example to begin.Where your data goes
Processing happens entirely in this browser. Your input is not uploaded, logged, or saved by sudor.io. External result links only open when you choose them.
Before you use the result
Results are a research aid. Review the output before using it in a production workflow.