6 Commits

Author	SHA1	Message	Date
Joscha	296a169dd3	Make limiter logic more complex ... The limiter can now distinguish between crawl and download actions and has a fancy slot system and delay logic.	2021-05-15 15:25:05 +02:00
Joscha	0459ed093e	Add simple authenticator ... ... including some required authenticator infrastructure	2021-05-11 00:28:03 +02:00
Joscha	d5f29f01c5	Use global conductor instance ... The switch from crawler-local conductors to a single pferd-global conductor was made to prepare for auth section credential providers.	2021-05-11 00:05:04 +02:00
Joscha	273d56c39a	Properly load crawler config	2021-05-05 23:45:10 +02:00
Joscha	91c33596da	Load crawlers from config file	2021-04-30 16:22:14 +02:00
Joscha	fbebc46c58	Load and dump config	2021-04-29 09:51:50 +02:00