Mwmbl is a project with almost audacious ambition that is very much needed to provide a counter to the encroaching commercialisation and walled-garden-approach the web at large has been undergoing for many years now. Think trying to do for search engines what Wikipedia has done for looking up encyclopedic knowledge.

This is an easy way to support the project - and if you have some more know-how and resources, also check out the CLI script they have as well (I have it running on my server, for example).

Very nice project! However I noticed that the addon sometimes causes considerable CPU load (at least on my notebook, i7-6600U). So it might be helpful to add some options, to limit resource demand and bandwidth, or pause the crawling altogether.

While I would like to support the crawling effort to help with indexing, sometimes it is kind of annoying to have my network speed slowed down. It would be nice if there was a way to pause the crawling, whenever the user actually needs to browse or whatever :D