I-Al-Istannen
3f5637366e
Sanitize / in kit-ipd heading hierarchy
2025-10-30 20:19:37 +01:00
I-Al-Istannen
ebcfb2a2f3
Fix some typing errors
...
It seems like the type hints have gotten better :)
2025-10-19 16:27:54 +02:00
I-Al-Istannen
6e563134b2
Fix ruff errors
2025-10-19 15:48:16 +02:00
I-Al-Istannen
2cf0e060ed
Reformat and switch to ruff
2025-10-19 15:45:49 +02:00
I-Al-Istannen
2f0e792670
Increase default http timeout to 30
...
Otherwise larger forums will fail to download in time
2025-02-19 12:19:13 +01:00
I-Al-Istannen
bd9d7efe64
"Fix" mypy errors
...
Thank you mypy, very cool. These types make things *so much better*.
They don't just complicate everything and don't really help because they
can not detect that an element queried by a tag is no navigable
string...
2025-02-19 12:15:41 +01:00
PinieP
596b6a7688
Add support for non-KIT shibboleth login ( #98 )
...
Co-authored-by: Mr-Pine <git@mr-pine.de >
Co-authored-by: I-Al-Istannen <I-Al-Istannen@users.noreply.github.com >
2024-11-05 18:30:34 +01:00
Tim
5983200247
Treat headings as folders in kit-ipd crawler ( #99 )
2024-11-04 23:53:48 +01:00
Tim
739dd95850
Use Last-Modified and ETag headers to determine KIT-IPD file versions ( #95 )
...
Co-authored-by: I-Al-Istannen <i-al-istannen@users.noreply.github.com >
2024-10-27 19:03:47 +01:00
Joscha
b56475450d
Use utf-8 for cookies
2022-04-29 23:12:41 +02:00
Joscha
722970a255
Store cookies in text-based format
...
Using the stdlib's http.cookie module, cookies are now stored as one
"Set-Cookie" header per line. Previously, the aiohttp.CookieJar's save() and
load() methods were used (which use pickling).
2021-05-31 20:18:20 +00:00
I-Al-Istannen
263780e6a3
Use certifi to ensure CA certificates are bundled in pyinstaller
2021-05-25 18:24:06 +02:00
I-Al-Istannen
9ce20216b5
Do not set a timeout for whole HTTP request
...
Downloads might take longer!
2021-05-24 18:54:26 +02:00
Joscha
86ba47541b
Fix cookie loading and saving
2021-05-24 16:55:11 +02:00
I-Al-Istannen
d44f6966c2
Log authentication attempts in HTTP crawler
2021-05-24 16:22:11 +02:00
Joscha
c687d4a51a
Implement cookie sharing
2021-05-24 13:10:44 +02:00
I-Al-Istannen
3ab3581f84
Add timeout for HTTP connection
2021-05-23 23:41:05 +02:00
Joscha
2fdf24495b
Restructure crawling and auth related modules
2021-05-23 19:16:42 +02:00
