pferd/PFERD
Joscha ec95dda18f Unify crawling and downloading steps
Now, the progress bar, limiter etc. for downloading and crawling are all handled
via the reusable CrawlToken and DownloadToken context managers.
2021-05-22 21:36:53 +02:00
..
authenticators Move logging logic to singleton 2021-05-18 22:45:19 +02:00
cli Extract CLI argument parsing to separate module 2021-05-22 15:03:45 +02:00
crawlers Try out some HTTP authentication handling 2021-05-21 12:02:51 +02:00
__init__.py Single-source version number 2021-05-14 21:27:44 +02:00
__main__.py Improve PFERD error handling 2021-05-22 21:13:25 +02:00
authenticator.py Move logging logic to singleton 2021-05-18 22:45:19 +02:00
config.py Clean up main and improve error handling 2021-05-22 16:47:24 +02:00
crawler.py Unify crawling and downloading steps 2021-05-22 21:36:53 +02:00
limiter.py Change limiter logic 2021-05-15 15:25:05 +02:00
logging.py Handle abort in exclusive output state correctly 2021-05-22 18:58:19 +02:00
output_dir.py Unify crawling and downloading steps 2021-05-22 21:36:53 +02:00
pferd.py Improve PFERD error handling 2021-05-22 21:13:25 +02:00
report.py Improve output dir and report error handling 2021-05-22 20:54:42 +02:00
transformer.py Allow variable whitespace in arrow rules 2021-05-15 15:25:05 +02:00
utils.py Run async input and password getters in daemon thread 2021-05-22 18:37:53 +02:00
version.py Implement --version flag 2021-05-19 17:33:36 +02:00