146 Commits

Author	SHA1	Message	Date
Daniel Augustin	f6fbd5e4bb	Add download summary	2020-06-25 19:19:34 +02:00
I-Al-Istannen	7024db1f13	Use transient progessbar ... This will ensure no pesky newline ends up in the output, even on windows.	2020-06-25 18:03:12 +02:00
I-Al-Istannen	23bfa42a0d	Never use the direct download button, as it is currently broken	2020-06-11 13:31:01 +02:00
I-Al-Istannen	fdb57884ed	Touch files with same content to update timestamps	2020-05-31 20:27:15 +02:00
I-Al-Istannen	8198c9ecaa	Reorder methods a bit	2020-05-30 19:06:36 +02:00
I-Al-Istannen	086b15d10f	Crawl a bit more iteratively	2020-05-30 15:47:15 +02:00
I-Al-Istannen	9d6ce331a5	Use IliasCrawlerEntry entries in the ilias scraper	2020-05-30 15:20:51 +02:00
I-Al-Istannen	821c7ade26	Move video url extraction logic to crawler	2020-05-30 00:22:31 +02:00
I-Al-Istannen	b969a1854a	Remove unneeded whitespace	2020-05-30 00:22:31 +02:00
I-Al-Istannen	62535b4452	Unpack videos in ILIAS downloader	2020-05-21 22:12:52 +02:00
I-Al-Istannen	c0056e5669	Correctly crawl video pages with multiple pages	2020-05-21 21:38:07 +02:00
I-Al-Istannen	03a801eecc	Correctly type hint swallow_and_print_errors decorator	2020-05-12 21:03:53 +02:00
Joscha	072c6630bf	Avoid logging import in config	2020-05-12 18:19:23 +00:00
I-Al-Istannen	4f56c8f192	Pass element type to ilias directory filter	2020-05-12 14:41:13 +02:00
I-Al-Istannen	4fdb67128d	Fetch correct diva playlist id	2020-05-11 00:25:34 +02:00
I-Al-Istannen	a0f9d31d94	Use PrettyLogger warning everywhere	2020-05-10 21:56:12 +02:00
I-Al-Istannen	e7b08420ba	Warn when a marked file is added again	2020-05-10 21:42:30 +02:00
I-Al-Istannen	c1b21f7772	Only remove a progress task when we added it	2020-05-10 12:28:30 +02:00
I-Al-Istannen	9850ab1d73	Allow crawling the ILIAS Personal Desktop	2020-05-10 12:16:42 +02:00
I-Al-Istannen	9950144e97	Allow passing a playlist URL to diva instead of an id	2020-05-10 11:17:13 +02:00
I-Al-Istannen	f6faacabb0	Move FatalException to errors.py	2020-05-09 00:11:21 +02:00
I-Al-Istannen	19c1e3ac6f	Fail on invalid ILIAS course ids	2020-05-09 00:11:20 +02:00
I-Al-Istannen	afa48c2d2d	Swallow and print errors instead of crashing	2020-05-09 00:10:54 +02:00
I-Al-Istannen	a4c518bf4c	Update date find regex	2020-05-08 22:17:58 +02:00
I-Al-Istannen	057135022f	Try to accept that life sometimes is in English	2020-05-08 22:10:43 +02:00
I-Al-Istannen	755e9aa0d3	Try to add support for Shibboleth TFA token	2020-05-08 21:52:51 +02:00
I-Al-Istannen	c9deca19ca	Remove walrus to lower needed python version	2020-05-08 21:21:33 +02:00
I-Al-Istannen	a0c5572b59	Fix progress bars swallowing a line when they shouldn't	2020-05-08 19:55:53 +02:00
I-Al-Istannen	2d20d2934c	Color warning differently	2020-05-08 19:52:45 +02:00
I-Al-Istannen	2c48ab66d4	Use rich for log colorization	2020-05-08 19:31:54 +02:00
I-Al-Istannen	56f2394001	Add a download progress bar	2020-05-08 17:09:56 +02:00
I-Al-Istannen	bee3d70998	Added a diva playlist downloader	2020-04-30 17:18:45 +02:00
I-Al-Istannen	42345ecc61	Demangle "Morgen" too	2020-04-30 12:05:25 +02:00
I-Al-Istannen	920d521d68	Change PrettyLogger.warn to PrettyLogger.warning	2020-04-25 20:11:51 +02:00
I-Al-Istannen	e0b46a306a	Use warn method in IliasCrawler	2020-04-25 20:07:40 +02:00
I-Al-Istannen	8a42a2a396	Move logging into its own file	2020-04-25 20:02:01 +02:00
I-Al-Istannen	80247400a4	Debug log when starting an ilias download	2020-04-25 13:02:07 +02:00
Joscha	1aaa6e7ab5	Use PathLike everywhere	2020-04-24 18:41:14 +00:00
Joscha	7f53543324	Satisfy pylint and add todo	2020-04-24 18:26:28 +00:00
Joscha	292e516297	Change crawler and downloader output	2020-04-24 18:24:44 +00:00
Joscha	8258fa8919	Add test run option to PFERD	2020-04-24 18:00:21 +00:00
Joscha	5b929f09a2	Move download strategies to downloader ... Also fixes an issue where the downloader didn't mark files that were not downloaded due to the strategy used.	2020-04-24 14:27:40 +00:00
Joscha	4d32f863bc	Clean up organizer after synchronizing	2020-04-24 14:17:23 +00:00
Joscha	4e7333b396	Allow specifying paths as strings in Pferd	2020-04-24 11:50:40 +00:00
I-Al-Istannen	4c0e3b493a	Use download_modified_or_new as default strategy	2020-04-24 13:48:06 +02:00
Joscha	2de079a5d3	Add a few Transform combinators	2020-04-24 11:35:46 +00:00
I-Al-Istannen	509e624d47	Satisfy pyling. Useful docstrings? Not quite sure.	2020-04-23 20:35:59 +02:00
I-Al-Istannen	980f69b5af	Fix organizer marking itself causing an error	2020-04-23 20:02:05 +02:00
I-Al-Istannen	0b00a9c26b	Log when starting to synchronize	2020-04-23 19:56:37 +02:00
Joscha	1ef85c45e5	Switch Transform to PurePath	2020-04-23 17:40:43 +00:00