pferd/PFERD/crawl
I-Al-Istannen 46fb782798 Add forum crawling
This downloads all forum posts when needed and saves each thread in its
own html file, named after the thread title.
2022-05-24 23:43:53 +02:00
..
ilias Add forum crawling 2022-05-24 23:43:53 +02:00
__init__.py Add kit-ipd crawler 2021-10-21 13:20:21 +02:00
crawler.py Fix mypy errors and add missing await 2022-04-27 22:52:50 +02:00
http_crawler.py Use utf-8 for cookies 2022-04-29 23:12:41 +02:00
kit_ipd_crawler.py Simplify IPD crawler link regex 2022-05-08 18:18:05 +02:00
local_crawler.py Deduplicate path names in crawler 2021-05-25 12:11:15 +02:00