Hoardy-Web by Jan Malakhovski
Passively capture, archive, and hoard your web browsing history, including the contents of the pages you visit, for later offline viewing, replay, mirroring, data scraping, and/or indexing. Low memory footprint, lots of configuration options.
You'll need Firefox to use this extension
Extension Metadata
Screenshots
About this extension
Hoardy-Web
passively captures and collects dumps of HTTP
requests and responses as you browse the web, and then archives them using one or more of the following methods:- by saving them into your browser’s local storage, which is the default;
- by submitting them to your own private archiving server via
HTTP
, like- the advanced archival+replay server
hoardy-web serve
(also on GitHub) or - the simple archiving-only server
hoardy-web-sas
(also on GitHub);
- the advanced archival+replay server
- by generating fake-Downloads containing bundles of those dumps, making your browser simply save them to your
Downloads
directory.
Hoardy-Web
produces dumps in a very simple, yet efficient, WRR
file format (also on GitHub).Moreover,
Hoardy-Web
implements:- UI indicators that help in ensuring good and complete website captures,
- optional post-capture machinery that helps in archiving only select subsets of captured data;
- archival+replay integration when used in combination with an advanced archiving+replay server like
hoardy-web serve
(also on GitHub); - capture of
DOM
snapshots; - inspection of captured
HTTP
traffic, similar to browser’s ownNetwork Monitor
(except browser-wise, i.e., it can captureHTTP
requests even when a page generates them when its tab/window closes; which a surprising number of websites does to prevent their web traffic from being inspected withNetwork Monitor
); - some generally useful web browsing features (like per-tab
Work offline
mode).
In other words, this extension implements an in-browser half of your own personal private passive Wayback Machine that archives everything you see, including
HTTP POST
requests and responses (e.g. answer pages of web search engines), as well as most other HTTP
-level data (AJAX
, JSON RPC
, etc).For more information see project’s documentation (also on GitHub) and extension’s
Help
page (also on GitHub) (also distributed with the extension itself, available via the “Help” button from its popup UI), especially the “Frequently Asked Questions” section there (also on GitHub).Also, note that:
Hoardy-Web
DOES NOT send any of your captured web browsing data anywhere, unless you explicitly configure it to do so.Hoardy-Web
DOES NOT send any telemetry anywhere.- Both of the above statements will apply to all future versions of
Hoardy-Web
.
Hoardy-Web
was previously known as “Personal Private Passive Web Archive” aka pWebArc
.Rate your experience
PermissionsLearn more
This add-on needs to:
- Display notifications to you
- Access browser tabs
- Store unlimited amount of client-side data
- Access browser activity during navigation
- Access your data for all websites
More information
- Add-on Links
- Version
- 1.20.0
- Size
- 263.82 KB
- Last updated
- 4 days ago (Jan 24, 2025)
- Related Categories
- License
- GNU Lesser General Public License v3.0 only
- Privacy Policy
- Read the privacy policy for this add-on
- Version History
- Tags
Add to collection
Release notes for 1.20.0
[extension-v1.20.0] - 2024-12-24: Annoyance and bug fixes
Added
- Core + Popup UI:
- Implemented config.limboNotifyInterval option and its popup UI.
It prevents “Too much stuff in limbo” notifications from being generated more frequently than given number of seconds, which makes them much less annoying.
Changed
- Core:
- From now on, retryUnarchived scheduled action can be canceled (until a new reqres gets captured) with the cancelActions (red square) button.
- Unavailable and non-archiving servers produce different notification error messages and are handled differently now.
- Archivals to broken servers and localStorage produce nicer notification errors now.
- Unrecoverable archival failures now get a hint about using the retryFailed popup UI button in their notification messages.
- From now on, pressing keyboard shortcuts and popup UI buttons will force immediate updates to displayed notifications.
I.e. no longer relevant notifications will disappear immediately.
(Thanks to @douglasg14b on GitHub for pointing out three out of five of the above.)
- The Help page:
- Added “Table of Contents” section.
- Moved and adapted a bunch move stuff from top-level README.md.
- Improved some pieces of it.
- Other documentation pages:
- Improved rendering of various references, added more of them.
- Improved in many random places.
Fixed
- All documentation pages:
- Clicking on internal links will now replace history states that point to other links.
This makes the use of “Back” browser button more intuitive.
- Core:
- On Firefox, fixed an issue when, with a popup UI open, opening “Internal State” page would make the popup show the wrong tab stats until a tab switch.
- On Firefox, fixed popup UI’s tab stats flickering between inconsistent states when, with a popup UI open, a new tab gets opened, starts loading, and then gets redirected, with all of it happening really fast.
Added
- Core + Popup UI:
- Implemented config.limboNotifyInterval option and its popup UI.
It prevents “Too much stuff in limbo” notifications from being generated more frequently than given number of seconds, which makes them much less annoying.
Changed
- Core:
- From now on, retryUnarchived scheduled action can be canceled (until a new reqres gets captured) with the cancelActions (red square) button.
- Unavailable and non-archiving servers produce different notification error messages and are handled differently now.
- Archivals to broken servers and localStorage produce nicer notification errors now.
- Unrecoverable archival failures now get a hint about using the retryFailed popup UI button in their notification messages.
- From now on, pressing keyboard shortcuts and popup UI buttons will force immediate updates to displayed notifications.
I.e. no longer relevant notifications will disappear immediately.
(Thanks to @douglasg14b on GitHub for pointing out three out of five of the above.)
- The Help page:
- Added “Table of Contents” section.
- Moved and adapted a bunch move stuff from top-level README.md.
- Improved some pieces of it.
- Other documentation pages:
- Improved rendering of various references, added more of them.
- Improved in many random places.
Fixed
- All documentation pages:
- Clicking on internal links will now replace history states that point to other links.
This makes the use of “Back” browser button more intuitive.
- Core:
- On Firefox, fixed an issue when, with a popup UI open, opening “Internal State” page would make the popup show the wrong tab stats until a tab switch.
- On Firefox, fixed popup UI’s tab stats flickering between inconsistent states when, with a popup UI open, a new tab gets opened, starts loading, and then gets redirected, with all of it happening really fast.
More extensions by Jan Malakhovski
- There are no ratings yet
- There are no ratings yet
- There are no ratings yet
- There are no ratings yet
- There are no ratings yet
- There are no ratings yet