pferd/PFERD
I-Al-Istannen e4f9560655 Only retry on aiohttp errors in ILIAS crawler
This patch removes quite a few retries and now only retries the ilias
element method. Every other HTTP-interacting method (except for the root
requests) is called from there and should be covered.

In the future we also want to retry the root a few times, but that
will be done after the download sink API is adjusted.
2021-05-19 22:01:09 +02:00
..
authenticators Move logging logic to singleton 2021-05-18 22:45:19 +02:00
crawlers Only retry on aiohttp errors in ILIAS crawler 2021-05-19 22:01:09 +02:00
__init__.py Single-source version number 2021-05-14 21:27:44 +02:00
__main__.py Explain config file loading 2021-05-19 18:11:43 +02:00
authenticator.py Move logging logic to singleton 2021-05-18 22:45:19 +02:00
config.py Explain config file loading 2021-05-19 18:11:43 +02:00
crawler.py Configure explain log level via cli and config file 2021-05-19 17:50:10 +02:00
limiter.py Change limiter logic 2021-05-15 15:25:05 +02:00
logging.py Explain config file loading 2021-05-19 18:11:43 +02:00
output_dir.py Implement reusable FileSinkToken for OutputDirectory 2021-05-19 17:16:23 +02:00
pferd.py Move logging logic to singleton 2021-05-18 22:45:19 +02:00
report.py Fix cookies getting deleted 2021-05-15 22:25:48 +02:00
transformer.py Allow variable whitespace in arrow rules 2021-05-15 15:25:05 +02:00
utils.py Split up ilias crawler in multiple files 2021-05-19 21:34:36 +02:00
version.py Implement --version flag 2021-05-19 17:33:36 +02:00