@Gargron it might make sense to have on process coordinating work (the one who keeps the queue), and that process starts N childs, and they do the scraping for you, and send it back to the parent via messages (instead of using the same queue)
@Gargron it might make sense to have on process coordinating work (the one who keeps the queue), and that process starts N childs, and they do the scraping for you, and send it back to the parent via messages (instead of using the same queue)
Bobinas P4G is a social network. It runs on GNU social, version 2.0.1-beta0, available under the GNU Affero General Public License.
All Bobinas P4G content and data are available under the Creative Commons Attribution 3.0 license.