Commit Graph

  • fde811ae5a Document on_conflict option Joscha 2021-05-05 00:55:55 +0200
  • 07e831218e Add sync report Joscha 2021-05-02 00:56:10 +0200
  • 91c33596da Load crawlers from config file Joscha 2021-04-30 16:22:14 +0200
  • a8dcf941b9 Document possible redownload settings Joscha 2021-04-30 15:32:56 +0200
  • e7a51decb0 Elaborate on transforms and implement changes Joscha 2021-04-29 20:13:46 +0200
  • 9ec19be113 Document config file format Joscha 2021-04-29 18:55:08 +0200
  • f776186480 Use PurePath instead of Path Joscha 2021-04-29 16:52:00 +0200
  • 0096d83387 Simplify Limiter implementation Joscha 2021-04-29 16:37:42 +0200
  • 20a24dbcbf Add changelog Joscha 2021-04-29 16:14:50 +0200
  • 502654d853 Fix mypy errors Joscha 2021-04-29 15:47:52 +0200
  • d2103d7c44 Document crawler Joscha 2021-04-29 15:43:20 +0200
  • d96a361325 Test and fix exclusive output Joscha 2021-04-29 15:26:10 +0200
  • 2e85d26b6b Use conductor via context manager Joscha 2021-04-29 14:23:28 +0200
  • 6431a3fb3d Fix some mypy errors Joscha 2021-04-29 14:23:09 +0200
  • ac3bfd7388 Make progress bars easier to use Joscha 2021-04-29 13:53:16 +0200
  • 3ea86d18a0 Jerry-rig DummyCrawler to run Joscha 2021-04-29 13:45:04 +0200
  • bbc792f9fb Implement Crawler and DummyCrawler Joscha 2021-04-29 13:44:29 +0200
  • 7e127cd5cc Clean up and fix conductor and limiter Joscha 2021-04-29 13:43:50 +0200
  • c4fb92c658 Make type hints compatible with Python 3.8 Joscha 2021-04-29 13:11:58 +0200
  • 8da1ac6cee Extend mypy config Joscha 2021-04-29 11:25:13 +0200
  • a18db57e6f Implement terminal conductor Joscha 2021-04-29 11:25:00 +0200
  • b915e393dd Implement limiter Joscha 2021-04-29 10:24:28 +0200
  • 3a74c23d09 Implement transformer Joscha 2021-04-29 09:51:25 +0200
  • fbebc46c58 Load and dump config Joscha 2021-04-27 12:41:49 +0200
  • 024aceb5ee
    merge master be7a 2021-04-29 00:30:02 +0200
  • 11bbfa0c40
    fix symbol rename be7a 2021-04-29 00:26:23 +0200
  • cccd68e04a Bump version to v2.6.2 v2.6.2 v2 I-Al-Istannen 2021-04-29 00:18:26 +0200
  • 2bd40a5f30 Fix -p and -u flags I-Al-Istannen 2021-04-29 00:15:12 +0200
  • 9ad176c3ca
    update examples be7a 2021-04-29 00:07:50 +0200
  • c800d307db
    Add warning about event-loop in ILIASCrawler be7a 2021-04-29 00:02:03 +0200
  • 3eab236b99
    update sync_url.py and fix event_loop housekeeping be7a 2021-04-28 23:58:21 +0200
  • 2d6be9f5c1
    run autopep8 and fix formatting be7a 2021-04-28 23:09:38 +0200
  • 1d3e169ead
    merge upstream be7a 2021-04-28 01:53:42 +0200
  • c0ba8b9528
    Use shared ILIASCrawler be7a 2021-04-28 01:50:28 +0200
  • e3a13143bc
    Use shared ILIASCrawler be7a 2021-04-28 01:50:28 +0200
  • 5595a908d8 Configure entry point Joscha 2021-04-27 00:29:42 +0200
  • 27e4abcfa3 Do project setup from scratch Joscha 2021-04-26 23:46:44 +0200
  • 54a446c43c
    await authentication in ilias crawler be7a 2021-04-24 16:21:48 +0200
  • ad730f5259
    fix another bad search and replace be7a 2021-04-24 00:05:22 +0200
  • 4f966c5ee2
    fix incorrect httpx vs requests replace be7a 2021-04-23 22:56:45 +0200
  • 07218e6cab
    remove false help text and fix httpx auth be7a 2021-04-23 22:07:30 +0200
  • 411d4b91d5
    use the async client to crawl illias be7a 2021-04-23 21:43:52 +0200
  • 44aeb6c2eb
    transition from requests to httpx be7a 2021-04-23 18:02:57 +0200
  • f4531906f6 Add sync_url flag to only print the summary Christophe 2021-04-19 20:53:00 +0200
  • 2ca1101326 Fix typo in sync_url I-Al-Istannen 2021-04-19 14:53:16 +0200
  • c1ab7485e2 Bump version to 2.6.1 v2.6.1 I-Al-Istannen 2021-04-19 11:21:56 +0200
  • 29cd5d1a3c Reflect totality of sanitize_windows_path in return type I-Al-Istannen 2021-04-19 11:10:02 +0200
  • 6d5d9333ad Force folder to be file-system path I-Al-Istannen 2021-04-19 11:07:25 +0200
  • 7cc40595dc Allow synchronizing to directory "." I-Al-Istannen 2021-04-14 20:25:25 +0200
  • 80ae5ddfaa Bump version to v2.6.0 v2.6.0 I-Al-Istannen 2021-04-14 19:47:41 +0200
  • 4f480d117e Install keyring in CI I-Al-Istannen 2021-04-14 19:24:05 +0200
  • 1f2af3a290 Retry on more I/O Errors I-Al-Istannen 2021-04-13 11:32:55 +0200
  • 14cdfb6a69 Fix typo in date demangler doc I-Al-Istannen 2021-04-13 11:19:51 +0200
  • e2bf84392b [sync_url] Properly declare "no-videos" as flag I-Al-Istannen 2021-04-08 18:12:27 +0200
  • 946b7a7931 Also crawl .c/.java/.zip from IPD page I-Al-Istannen 2021-02-09 12:30:59 +0100
  • 9a9018751e Bump version v2.5.4 I-Al-Istannen 2021-02-06 22:54:05 +0100
  • 83b75e8254 syncurl: Sanitize element name on windows if it is used as folder name I-Al-Istannen 2021-02-06 22:51:08 +0100
  • 86062f0b3f
    Add KeyboardInterrupt detection Pavel Zwerschke 2021-02-06 10:24:45 +0100
  • b2f547a626
    Merge branch 'master' into glob-enhancements Toorero 2021-01-29 14:24:22 +0100
  • 35c3fa205d
    Fixed description of activating venv (#22) Toorero 2021-01-28 21:24:09 +0100
  • d51d2e5bd0 Removed environment special gitignore entry Toorero 2021-01-28 20:44:24 +0100
  • 86f340dd05 Removed glob-feature from this branch Toorero 2021-01-28 15:03:21 +0100
  • 3491c45316 Added use-case example. Toorero 2021-01-28 15:01:20 +0100
  • 743fd3c3d4 Updated .gitignore Toorero 2021-01-28 14:24:35 +0100
  • a9e8c13ca4 Addes switches in Organizer and Pferd to force and change the default user conflict resolution Toorero 2021-01-28 13:56:09 +0100
  • 27ece2ab97 Added posix glob with pathmatch Toorero 2021-01-27 13:09:42 +0100
  • b09afd70a4
    Fixed description of activating venv Toorero 2021-01-25 15:56:51 +0100
  • 0b606f02fa Bump version v2.5.3 I-Al-Istannen 2021-01-17 10:33:10 +0100
  • fb78a6e98e Retry ILIAS downloads a few times and only fail that file I-Al-Istannen 2021-01-06 12:29:24 +0100
  • 5de68a0400 Bump version v2.5.2 I-Al-Istannen 2020-12-30 17:20:30 +0100
  • f0562049b6 Remove Python 3.9 method in crawler I-Al-Istannen 2020-12-30 17:18:04 +0100
  • 0e1077bb50 Bump version v2.5.1 I-Al-Istannen 2020-12-30 14:50:49 +0100
  • c978e9edf4 Resolve a few pylint warnings I-Al-Istannen 2020-12-30 14:45:46 +0100
  • 2714ac6be6 Send CSRF token to Shibboleth I-Al-Istannen 2020-12-30 14:34:11 +0100
  • 9b048a9cfc Canonize meeting names to a properly formatted date I-Al-Istannen 2020-12-30 14:32:59 +0100
  • 1c2b6bf994 Bump version v2.5.0 I-Al-Istannen 2020-12-13 19:57:29 +0100
  • ee39aaf08b Fix merge marker in LICENSE I-Al-Istannen 2020-12-07 22:55:28 +0100
  • 93e6329901 Use the least destructive conflict resolver if there are multiple I-Al-Istannen 2020-12-06 13:28:08 +0100
  • f47b137b59 Fix ILIAS init.py and Pferd.py authenticators I-Al-Istannen 2020-12-05 23:35:20 +0100
  • 83ea15ee83 Use system keyring service for password auth Scriptim 2020-11-04 00:18:27 +0100
  • 75471c46d1 Use credential file I-Al-Istannen 2020-11-04 21:18:48 +0100
  • 1e0343bba6 sync_url: Add username and password args Lucas 2020-11-03 13:38:33 +0100
  • 0f5e55648b Tell user when the conflict resolver kept existing files I-Al-Istannen 2020-12-05 14:11:51 +0100
  • 57259e21f4 Print download summary in sync_url I-Al-Istannen 2020-12-05 14:08:00 +0100
  • 4ce385b262 Treat file overwrite and marked file overwrite differently I-Al-Istannen 2020-12-05 14:03:43 +0100
  • 2d64409542 Fix handling of empty args.folder I-Al-Istannen 2020-12-05 13:50:46 +0100
  • fcb3884a8f Add --remote-first, --local-first and --no-delete flags I-Al-Istannen 2020-12-05 13:47:53 +0100
  • 9f6dc56a7b Use a strategy to decide conflict resolution I-Al-Istannen 2020-12-02 19:29:52 +0100
  • 56ab473611
    Merge pull request #17 from TheChristophe/master I-Al-Istannen 2020-12-02 19:04:46 +0100
  • 6426060804 Fix relative paths bug Christophe 2020-12-02 18:40:45 +0100
  • 49a0ca7a7c Add myself to LICENSE Christophe 2020-12-02 16:59:29 +0100
  • f3a4663491 Add passive/no_prompt flag Christophe 2020-12-02 16:58:36 +0100
  • ecdbca8fb6 Make sync_url work relative to cwd like sane programs Christophe 2020-12-02 16:50:30 +0100
  • 9cbea5fe06 Add requirements.txt I-Al-Istannen 2020-11-23 10:16:40 +0100
  • ba3c7f85fa Replace "\" in ILIAS paths as well I-Al-Istannen 2020-11-19 19:37:28 +0100
  • 373ba57bbf Added backslash in path sanitization and removed redundant sanitization in sanitize_windows_path Felix 2020-11-19 18:27:28 +0100
  • ba9215ebe8 Bump version v2.4.5 I-Al-Istannen 2020-11-18 10:09:45 +0100
  • 8ebf0eab16 Sort download summary I-Al-Istannen 2020-11-17 21:36:04 +0100
  • cd90a60dee Move "sanitize_windows_path" to PFERD.transform I-Al-Istannen 2020-11-12 20:52:46 +0100
  • 98834c9c95 Bump version v2.4.4 I-Al-Istannen 2020-11-12 20:23:36 +0100