To help you quickly detect if certain URLs are blocked by robots.txt, we provide detailed robot.txt metrics for every source page.
| Metric |
Description |
| Robots.txt Bots |
txt allows general bots for currents URL |
| Robots.txt Googlebot |
txt allows Googlebot for current URL |
| Robots.txt Allowed Bots |
Major Bots* are allowed by Robots.txt for current URL |
| Robots.txt Blocked Bots |
Major Bots are blocked by Robots.txt for current URL |
*major Bots = applebot, baiduspider, bingbot, googlebot, msnbot, naverbot, seznambot, slurp, teoma, yandex
LRT Documentation