rixxAbout five years ago I read an article about building responsible/polite/good scrapers that rate limit themselves etc. I can't seem to find it now, can anybody help out? (Similar resources would do, too). It didn't discuss legality, and focused on practical implementation of a few points, like spacing out requests.
Bobinas P4G is a social network. It runs on GNU social, version 2.0.1-beta0, available under the GNU Affero General Public License.
All Bobinas P4G content and data are available under the Creative Commons Attribution 3.0 license.