16 Commits

Author	SHA1	Message	Date
I-Al-Istannen	3453bbc991	Add basic auth to KIT-IPD crawler	2025-10-29 13:11:34 +01:00
I-Al-Istannen	6e563134b2	Fix ruff errors	2025-10-19 15:48:16 +02:00
I-Al-Istannen	2cf0e060ed	Reformat and switch to ruff	2025-10-19 15:45:49 +02:00
I-Al-Istannen	bd9d7efe64	"Fix" mypy errors ... Thank you mypy, very cool. These types make things *so much better*. They don't just complicate everything and don't really help because they can not detect that an element queried by a tag is no navigable string...	2025-02-19 12:15:41 +01:00
Tim	5983200247	Treat headings as folders in kit-ipd crawler (#99)	2024-11-04 23:53:48 +01:00
Tim	739dd95850	Use Last-Modified and ETag headers to determine KIT-IPD file versions (#95) ... Co-authored-by: I-Al-Istannen <i-al-istannen@users.noreply.github.com>	2024-10-27 19:03:47 +01:00
Joscha	c0d6d8b229	Use url after redirect for relative links	2022-11-21 18:10:45 +01:00
I-Al-Istannen	f47d2f11d8	Append trailing slash to kit-ipd links to ensure urljoin works as expected	2022-10-25 20:28:22 +02:00
Joscha	616b0480f7	Simplify IPD crawler link regex	2022-05-08 18:18:05 +02:00
Joscha	af2cc1169a	Mention href for users of link_regex option	2022-05-05 14:36:03 +02:00
Joscha	bc3fa36637	Fix IPD crawler crashing on weird HTML comments	2022-05-05 14:35:42 +02:00
I-Al-Istannen	b8fe25c580	Add .cpp to ipd link regex	2022-05-04 14:19:26 +02:00
I-Al-Istannen	5f527bc697	Remove Python 3.9 Pattern typehints	2022-01-08 17:14:40 +01:00
I-Al-Istannen	88afe64a92	Refactor IPD crawler a bit	2021-11-02 01:25:01 +00:00
Julius Rüberg	6b2a657573	Fix IPD crawler for different subpages (#42) ... This patch reworks the IPD crawler to support subpages which do not use "/intern" for links and fetches the folder names from table headings.	2021-11-02 01:25:01 +00:00
I-Al-Istannen	6673077397	Add kit-ipd crawler	2021-10-21 13:20:21 +02:00