chbinnc: RT @jpope For anyone who using my Searx node: I've never had any logging active for my node at https://search.jpope.org. Unfortunately, due to abuse by bots, I've had to enable nginx logging to enable fail2ban to do it's thing and block certain IP addresses that are just hammering my node. This has caused issues with it being blocked from scraping various search engines (google, qwant, duckduckgo, etc...). I will say this much though, even though logging is now enabled, aside from trying to mitigate abuse, I will be doing nothing with the logs aside from letting logrotate compress them daily and delete them after three days. Just posting this in an effort to be honest and transparent on the public service I run... I'm not happy about having logging active, but the search results have been fucking terrible as of late. #searx #transparency #report

Sat, 24 Feb 2018 07:30:05 +0000

RT @jpope For anyone who using my Searx node:

I've never had any logging active for my node at https://search.jpope.org. Unfortunately, due to abuse by bots, I've had to enable nginx logging to enable fail2ban to do it's thing and block certain IP addresses that are just hammering my node. This has caused issues with it being blocked from scraping various search engines (google, qwant, duckduckgo, etc...).

I will say this much though, even though logging is now enabled, aside from trying to mitigate abuse, I will be doing nothing with the logs aside from letting logrotate compress them daily and delete them after three days.

Just posting this in an effort to be honest and transparent on the public service I run... I'm not happy about having logging active, but the search results have been fucking terrible as of late.