Commit Graph

  • 755e9aa0d3 Try to add support for Shibboleth TFA token I-Al-Istannen 2020-05-08 21:51:33 +0200
  • c9deca19ca Remove walrus to lower needed python version I-Al-Istannen 2020-05-08 21:21:33 +0200
  • bb048c3a6d Apparently we want Python 3.8 I-Al-Istannen 2020-05-08 21:03:49 +0200
  • 33fcd307b2 Adjust install directions I-Al-Istannen 2020-05-08 20:53:41 +0200
  • a0c5572b59 Fix progress bars swallowing a line when they shouldn't I-Al-Istannen 2020-05-08 19:55:53 +0200
  • 2d20d2934c Color warning differently I-Al-Istannen 2020-05-08 19:48:21 +0200
  • 2c48ab66d4 Use rich for log colorization I-Al-Istannen 2020-05-08 19:28:34 +0200
  • 104b838aed Automatically discover packages in setup.py I-Al-Istannen 2020-05-08 18:55:30 +0200
  • 7f10931be8 Add rich to setup.py I-Al-Istannen 2020-05-08 18:49:36 +0200
  • 07c225bc20 Expand README. I did not proofread this thing :( I-Al-Istannen 2020-05-08 18:47:58 +0200
  • 56f2394001 Add a download progress bar I-Al-Istannen 2020-05-08 00:26:33 +0200
  • fdff8bc40e example_config: Change db transform I-Al-Istannen 2020-05-01 13:31:29 +0200
  • bee3d70998 Added a diva playlist downloader I-Al-Istannen 2020-04-30 16:24:38 +0200
  • 42345ecc61 Demangle "Morgen" too I-Al-Istannen 2020-04-30 12:00:21 +0200
  • 920d521d68 Change PrettyLogger.warn to PrettyLogger.warning I-Al-Istannen 2020-04-25 20:11:51 +0200
  • e0b46a306a Use warn method in IliasCrawler I-Al-Istannen 2020-04-25 20:05:19 +0200
  • 8a42a2a396 Move logging into its own file I-Al-Istannen 2020-04-25 19:59:58 +0200
  • 80247400a4 Debug log when starting an ilias download I-Al-Istannen 2020-04-25 13:02:07 +0200
  • 13c5a29ff0 Fix and extend example config Joscha 2020-04-24 18:41:22 +0000
  • 1aaa6e7ab5 Use PathLike everywhere Joscha 2020-04-24 18:39:30 +0000
  • 7f53543324 Satisfy pylint and add todo Joscha 2020-04-24 18:26:28 +0000
  • 292e516297 Change crawler and downloader output Joscha 2020-04-24 18:24:44 +0000
  • 8258fa8919 Add test run option to PFERD Joscha 2020-04-24 18:00:21 +0000
  • 5b929f09a2 Move download strategies to downloader Joscha 2020-04-24 14:26:20 +0000
  • 4d32f863bc Clean up organizer after synchronizing Joscha 2020-04-24 14:17:23 +0000
  • 4e7333b396 Allow specifying paths as strings in Pferd Joscha 2020-04-24 11:50:27 +0000
  • 4c0e3b493a Use download_modified_or_new as default strategy I-Al-Istannen 2020-04-24 13:48:06 +0200
  • 2de079a5d3 Add a few Transform combinators Joscha 2020-04-24 11:35:31 +0000
  • 509e624d47 Satisfy pyling. Useful docstrings? Not quite sure. I-Al-Istannen 2020-04-23 20:31:32 +0200
  • ca8fcf7a1d Somewhat elaborate example_config I-Al-Istannen 2020-04-23 20:22:41 +0200
  • 980f69b5af Fix organizer marking itself causing an error I-Al-Istannen 2020-04-23 20:02:05 +0200
  • 0b00a9c26b Log when starting to synchronize I-Al-Istannen 2020-04-23 19:55:37 +0200
  • 1ef85c45e5 Switch Transform to PurePath Joscha 2020-04-23 17:38:41 +0000
  • 5ef5a56e69 Extract Location into separate file Joscha 2020-04-23 17:38:28 +0000
  • f3f4be2690 More free functions I-Al-Istannen 2020-04-23 19:18:21 +0200
  • 076b8c5a1f Add download strategies to save bandwith I-Al-Istannen 2020-04-23 18:29:20 +0200
  • 13bc78c889 Display reason for ignoring an element in ilias crawler I-Al-Istannen 2020-04-23 13:54:58 +0200
  • dc964a9d98 Remove finished TODOs I-Al-Istannen 2020-04-23 13:30:34 +0200
  • c2b14f3db9 ilias crawler: Use direct download link if possible I-Al-Istannen 2020-04-23 13:07:07 +0200
  • 4b59a7c375 Move around TODOs Joscha 2020-04-23 10:49:01 +0000
  • 3a57430893 Fix type errors in example_config I-Al-Istannen 2020-04-23 12:35:58 +0200
  • bef210ae77 Rename and implement IliasDirectoryFilter I-Al-Istannen 2020-04-23 12:33:38 +0200
  • ea005517cf Only remove folders if they exist in tmpdir I-Al-Istannen 2020-04-23 12:09:45 +0200
  • 3841f27aab Add example config Joscha 2020-04-23 09:49:15 +0000
  • df0eb84a44 Fix TmpDir and Location Joscha 2020-04-23 09:48:09 +0000
  • 2de4255a78 Add Pferd class Joscha 2020-04-23 09:44:13 +0000
  • 3c808879c9 Add Transforms and Transformables Joscha 2020-04-22 18:25:09 +0000
  • a051e3bcca ilias crawler: Add some unhelpful documentation I-Al-Istannen 2020-04-22 17:58:19 +0200
  • eb7df036df WIP: ilias crawler: Also crawl assignments I-Al-Istannen 2020-04-22 14:32:20 +0200
  • 23db59e733 WIP: ilias-crawler: Demangle dates I-Al-Istannen 2020-04-22 12:44:41 +0200
  • ac65b06a8e Satisfy pylint a bit I-Al-Istannen 2020-04-22 01:37:34 +0200
  • 8891041069 WIP: crawler: Add opencast video crawler I-Al-Istannen 2020-04-21 23:01:19 +0200
  • 70d63e3e90 WIP: Start small ILIAS crawler I-Al-Istannen 2020-04-21 13:32:03 +0200
  • b2a7af2e3e Store modification_date in IliasDownloadInfo, remove parameters I-Al-Istannen 2020-04-21 13:31:50 +0200
  • 23bed48c8c Satisfy autopep8 I-Al-Istannen 2020-04-21 13:30:42 +0200
  • 0926d33798 Use downloader-specific data classes Joscha 2020-04-20 18:06:21 +0000
  • 55ba2f4070 Fix pylint in downloaders I-Al-Istannen 2020-04-20 19:48:59 +0200
  • d18b48aaf4 Stream in http downloader I-Al-Istannen 2020-04-20 19:45:25 +0200
  • 4ef0ffe3bf Listen to pylint and mypy Joscha 2020-04-20 17:27:26 +0000
  • ce77995c8f Rename http downloader module Joscha 2020-04-20 17:08:51 +0000
  • ed9245c14d Remove old organizer I-Al-Istannen 2020-04-20 18:50:23 +0200
  • 01e6972c96 Add ilias downloader I-Al-Istannen 2020-04-20 18:36:40 +0200
  • 8181ae5b17 Guard http response in context manager I-Al-Istannen 2020-04-20 18:04:56 +0200
  • 6407190ae0 Soupify requests responses properly Joscha 2020-04-20 16:38:18 +0000
  • 87395faac2 Add base for simple HTTP downloader I-Al-Istannen 2020-04-20 17:43:41 +0200
  • a9e6e7883d Create temp dir folder in constructor I-Al-Istannen 2020-04-20 17:43:28 +0200
  • 154d6b29dd Listen to pylint Joscha 2020-04-20 15:15:47 +0000
  • 62ac569ec4 Revert "Add proposed crawler entry type" I-Al-Istannen 2020-04-20 16:59:08 +0200
  • 9f1a0a58ab Add proposed crawler entry type I-Al-Istannen 2020-04-20 16:54:32 +0200
  • 879a2c7c80 Rewrite ILIAS authenticator Joscha 2020-04-20 14:25:55 +0000
  • ff06c5215e Fix authenticator Joscha 2020-04-20 14:03:22 +0000
  • 135a8dce4b Fix resolve_path allowing paths outside its folder I-Al-Istannen 2020-04-20 16:07:14 +0200
  • 63bbcad918 Add resolve method to tmp_dir I-Al-Istannen 2020-04-20 15:39:52 +0200
  • 6584d6a905 Elaborate accept_file in new_organizer I-Al-Istannen 2020-04-20 15:39:38 +0200
  • 5990098ef8 Add UserPassAuthenticator Joscha 2020-04-20 13:26:45 +0000
  • f3d3d6bb65 Add some docs to cookie_jar I-Al-Istannen 2020-04-20 14:38:03 +0200
  • b2fe7cc064 Add preliminary logging to organizer and tmp_dir I-Al-Istannen 2020-04-20 14:37:44 +0200
  • 930d821dd7 Add a simple organizer I-Al-Istannen 2020-04-20 14:29:41 +0200
  • 5c2ff14839 Add "prompt_yes_no" to utils I-Al-Istannen 2020-04-20 14:29:28 +0200
  • a3d6dc7873 Clean up temp_folder I-Al-Istannen 2020-04-20 14:28:22 +0200
  • 53ad1c924b Add cookie jar Joscha 2020-04-20 11:35:26 +0000
  • 8c431c7d81 Add a simple temporary folder I-Al-Istannen 2020-04-20 12:08:52 +0200
  • d5dd5aac06 Fix some mypy errors Joscha 2020-04-20 01:54:47 +0000
  • 7d48972967 Configure mypy Joscha 2020-04-19 19:50:17 +0000
  • 25043a4aaa Remove unnecessary files Joscha 2020-04-19 19:49:43 +0000
  • 7ebeef5873 Clean up gitignore Joscha 2020-04-19 18:47:44 +0000
  • 9b658776ca
    Merge pull request #6 from I-Al-Istannen/master Garmelon 2020-03-01 23:09:32 +0000
  • cf3553175f Add OS_Exams synchronizer I-Al-Istannen 2020-02-27 14:51:29 +0100
  • bf8b3cf9f7 Hack in support for TI exams I-Al-Istannen 2020-02-24 20:56:43 +0100
  • 4a5600d5ce
    Merge pull request #5 from I-Al-Istannen/master Garmelon 2019-12-12 11:52:05 +0000
  • f5bc49160f Lose 50 minutes of my life (and fix the TGI tut) I-Al-Istannen 2019-12-12 12:50:16 +0100
  • fa5f82d312
    Merge pull request #4 from I-Al-Istannen/master Garmelon 2019-11-18 22:12:32 +0000
  • 4433696509 [TGI] Add TGi tut I-Al-Istannen 2019-11-14 15:37:57 +0100
  • 1f5475abc5
    Merge pull request #3 from I-Al-Istannen/master Garmelon 2019-10-17 21:10:21 +0000
  • 1407c6d264 Download all TGI files and not just lectures I-Al-Istannen 2019-10-17 22:14:32 +0200
  • e152bfc4a3
    Merge pull request #2 from I-Al-Istannen/master Garmelon 2019-10-15 20:01:10 +0000
  • 1973c931bd Add support for other years in TGI downloader I-Al-Istannen 2019-10-15 15:37:52 +0200
  • 458cc1c6d6 Add support for TGI website I-Al-Istannen 2019-10-15 15:34:59 +0200
  • 52852d11a6 Bump version to 1.1.8 v1.1.8 Joscha 2019-09-22 11:56:41 +0000
  • f94629a7fa Fix exceptions with weird content types Joscha 2019-09-22 11:55:47 +0000