10 Commits

Author	SHA1	Message	Date
Joscha	5adfdfbd2b	Switch http_crawler to requests	2023-04-19 10:12:48 +02:00
Joscha	b56475450d	Use utf-8 for cookies	2022-04-29 23:12:41 +02:00
Joscha	722970a255	Store cookies in text-based format ... Using the stdlib's http.cookie module, cookies are now stored as one "Set-Cookie" header per line. Previously, the aiohttp.CookieJar's save() and load() methods were used (which use pickling).	2021-05-31 20:18:20 +00:00
I-Al-Istannen	263780e6a3	Use certifi to ensure CA certificates are bundled in pyinstaller	2021-05-25 18:24:06 +02:00
I-Al-Istannen	9ce20216b5	Do not set a timeout for whole HTTP request ... Downloads might take longer!	2021-05-24 18:54:26 +02:00
Joscha	86ba47541b	Fix cookie loading and saving	2021-05-24 16:55:11 +02:00
I-Al-Istannen	d44f6966c2	Log authentication attempts in HTTP crawler	2021-05-24 16:22:11 +02:00
Joscha	c687d4a51a	Implement cookie sharing	2021-05-24 13:10:44 +02:00
I-Al-Istannen	3ab3581f84	Add timeout for HTTP connection	2021-05-23 23:41:05 +02:00
Joscha	2fdf24495b	Restructure crawling and auth related modules	2021-05-23 19:16:42 +02:00