Log in
Preview of robots.txt Detection

robots.txt Detection by Werner

Check whether a website has robots.txt. After configuration, this extension can detect whether other paths exist.

0 (0 reviews)
16 Users
You’ll need Firefox to use this extension
Download Firefox and get the extension
Download file
Screenshots
If there is at least one path to detect, an icon appears in the address bar.Move your mouse over the icon to see the prompt.Click on the icon to see the existing path and status code. Click on the path to open it directly.On the configuration page, you can configure which paths to detect, and which HTTP status codes are returned, and the detected path does not exist.
About this extension
The purpose of this extension is to automatically detect if there is a specified path for each website being viewed. By default only robots.txt is detected. If it does, an icon appears in the address bar to prompt the user.
Rated 0 by 0 reviewers

Star rating saved

5
0
4
0
3
0
2
0
1
0
No reviews yet
Permissions and dataLearn more

Required permissions:

  • Access browser tabs
  • Access your data for all websites
More information
Version
0.3
Size
49.7 KB
Last updated
6 years ago (Nov 16, 2019)
Version History
Add to collection
Report this add-on
More extensions by Werner