Iceggiren i Mwmbl Web Crawler
Mwmbl Web Crawler sɣur Mwmbl Non-profit Search Engine, MooGoesTheLlama
9 n yiceggiren
- Yettwasezmel 5 ɣef 5sɣur AbNormalHumanBeing, 2 moannen lynMwmbl is a project with almost audacious ambition that is very much needed to provide a counter to the encroaching commercialisation and walled-garden-approach the web at large has been undergoing for many years now. Think trying to do for search engines what Wikipedia has done for looking up encyclopedic knowledge.
This is an easy way to support the project - and if you have some more know-how and resources, also check out the CLI script they have as well (I have it running on my server, for example). - Yettwasezmel 5 ɣef 5sɣur Aseqdac Firefox 18943720, 2 moannen lyn
- Yettwasezmel 1 ɣef 5sɣur enunciate793, 5 moannen lyn
- Yettwasezmel 5 ɣef 5sɣur Diagonalo, ien jier lyn
- Yettwasezmel 5 ɣef 5sɣur ADD-ONS, ien jier lyn
- Yettwasezmel 5 ɣef 5sɣur Santiago Lema, 2 jierren lyn
- Yettwasezmel 5 ɣef 5sɣur FObersteiner, 3 jierren lynVery nice project! However I noticed that the addon sometimes causes considerable CPU load (at least on my notebook, i7-6600U). So it might be helpful to add some options, to limit resource demand and bandwidth, or pause the crawling altogether.
Tiririt n ineflayen
yeffeɣ-d deg 2 jierren lynThanks the kind review! I think this problem was due to the extension logging in the console. I've removed all logging in the latest version, so hopefully it will be improved.
We do want to add more options for users pause crawling and limit bandwidth as you suggest. - Yettwasezmel 5 ɣef 5sɣur Yuuwa0519, 3 jierren lynWhile I would like to support the crawling effort to help with indexing, sometimes it is kind of annoying to have my network speed slowed down. It would be nice if there was a way to pause the crawling, whenever the user actually needs to browse or whatever :D
Tiririt n ineflayen
yeffeɣ-d deg 3 jierren lynThanks, this is a good idea. Issue is here if you want to track progress: https://github.com/mwmbl/crawler-extension/issues/25 - Yettwasezmel 5 ɣef 5sɣur Aseqdac Firefox 17391048, 3 jierren lyn