Free tools
Robots.txt tester
Read a site's robots.txt and test a path against it the way a crawler would, for any user-agent you name. Shows the exact rule that decided it.
Need the proxies behind the tools?
Every pool runs on one gateway and one balance. Start on pay as you go and move to a plan when the volume justifies it.
Accounts are for adults 18 and over. Buying means agreeing to the Terms and Acceptable Use Policy.