What is Robots.txt Report?
This X (formerly Twitter) bot reports when relevant companies update robots.txt files. For a list of currently tracked companies, check the pinned post (DM for requests to be added). The robots.txt diff is uploaded in the post when a change is detected.
