mirrors
/
pferd
mirror of https://github.com/Garmelon/PFERD.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity

Commit Graph

  • 42098dc3a5
         Merge 77c1f1516c into a117126389 Julius Rüberg 2023-12-09 22:34:12 -0700
  • a117126389 Fix video name deduplication master I-Al-Istannen 2023-12-09 23:01:59 +0100
  • e9f8901520 Fix typos in ilias crawler and use set literals I-Al-Istannen 2023-11-30 20:50:53 +0100
  • 266812f90e Move is_logged_in helper to kit_ilias_html I-Al-Istannen 2023-11-16 10:34:49 +0100
  • 03efa17cf1 Print mtime before updating file metadata debug/mtime-error-22 I-Al-Istannen 2023-09-23 12:37:56 +0200
  • 533bc27439 Bump version to 3.5.0 v3.5.0 latest I-Al-Istannen 2023-09-13 23:13:30 +0200
  • 0113a0ca10 Update flake.lock I-Al-Istannen 2023-09-13 22:23:21 +0200
  • 40f8a05ad6 Add .idea to gitignore I-Al-Istannen 2023-09-13 22:23:31 +0200
  • 50b50513c6 Ignore SCORM learning modules I-Al-Istannen 2023-08-29 13:51:19 +0200
  • df3514cd03 Crawl paginated past meetings I-Al-Istannen 2023-08-29 12:30:54 +0200
  • ad53185247 Sanitize ascii control characters on windows I-Al-Istannen 2023-08-29 12:25:16 +0200
  • 87b67e9271 Crawl files in the info tab I-Al-Istannen 2023-08-29 11:52:16 +0200
  • b54b3b979c Remove size suffix for content pages I-Al-Istannen 2023-08-27 11:42:25 +0200
  • 2184ac8040 Add support for ILIAS mediacast listings I-Al-Istannen 2023-08-26 19:39:40 +0200
  • b3d412360b Add Nix flake I-Al-Istannen 2023-08-26 23:48:14 +0200
  • dbc2553b11 Add default `show-not-deleted` option If set to `no`, PFERD won't print status or report messages for not deleted files Mr. Pine 2023-03-15 15:33:42 +0100
  • e41a22149e Add default `show-not-deleted` option If set to `no`, PFERD won't print status or report messages for not deleted files Mr. Pine 2023-03-15 15:33:42 +0100
  • 68c398f1fe Add support for ILIAS learning modules I-Al-Istannen 2023-07-29 23:23:10 +0200
  • 123a57beec Fix mypy unreachable error in file_templates I-Al-Istannen 2023-07-29 18:14:57 +0200
  • d204dac8ce Detect unexpected root page redirects and abort operation I-Al-Istannen 2023-06-02 18:19:39 +0200
  • 443f7fe839 Add `no-delete-prompt-overwrite` crawler conflict resolution option (#75) Mr. Pine 2023-07-29 17:54:42 +0200
  • 825dd8dfb3
         Merge cb0e9127ea into 86b87ce524 Philipp Fruck 2023-07-29 17:59:31 +0200
  • 86b87ce524
         Add `no-delete-prompt-overwrite` crawler conflict resolution option (#75) Mr. Pine 2023-07-29 17:54:42 +0200
  • bf27f4a686 TODO sequential Joscha 2022-11-24 15:47:01 +0100
  • 5adfdfbd2b Switch http_crawler to requests Joscha 2022-11-24 11:24:05 +0100
  • 5c3942a13d Fix flake8 error Joscha 2022-11-24 07:53:52 +0100
  • 5c9209b12e Document path formatting functions Joscha 2022-11-23 23:48:17 +0100
  • 50c7778d38 Use mypy to install library stub packages Joscha 2022-11-23 23:12:14 +0100
  • 354a22d1e3 Add vscode settings Joscha 2022-11-23 23:00:25 +0100
  • 6f87c5c774 Make ipd crawler synchronous Joscha 2022-11-23 22:34:44 +0100
  • 1ca10571f0 Remove limiter Joscha 2022-11-23 22:28:40 +0100
  • 10e1a5e871 De-Async ilias crawler I-Al-Istannen 2022-11-22 20:56:35 +0100
  • a2ffce4702 Make local crawler synchronous Joscha 2022-10-26 19:41:34 +0200
  • cb0e9127ea
         add documentation for default config section Philipp Fruck 2023-03-24 17:16:03 +0100
  • 62f1cf30c0
         add documentation for generic ILIAS instances Philipp Fruck 2023-03-23 17:37:35 +0100
  • 723a82f617
         improve compatibility with other ilias instances Philipp Fruck 2023-03-23 17:09:29 +0100
  • d512fc24c5
         split generic ilias crawler and KIT functionality Philipp Fruck 2023-03-23 17:05:35 +0100
  • eeebb65405
         add client_id and base_url to crawler section Philipp Fruck 2023-03-23 17:04:09 +0100
  • 34a96da869
         add dedicated ilias-web crawler command Philipp Fruck 2023-03-22 23:43:00 +0100
  • 256cd14637
         add common ilias config parser Philipp Fruck 2023-03-22 22:44:09 +0100
  • 0294ceb7d5 Update github action versions I-Al-Istannen 2023-03-22 00:08:19 +0100
  • 6f30c6583d Fix crawling of cards without descriptions I-Al-Istannen 2023-03-21 23:52:33 +0100
  • 467fc526e8 Fix crawling of file/video cards I-Al-Istannen 2023-03-21 23:52:24 +0100
  • 722d2eb393 Fix crawling of courses with preselected timeline tab I-Al-Istannen 2022-11-25 12:49:36 +0100
  • 38e366fd8b
         fix CONFIG.md Mr. Pine 2023-03-15 15:59:57 +0100
  • 2c85c1e1d0
         fix LICENSE Mr. Pine 2023-03-15 15:46:06 +0100
  • 2f0467ddb8
         Fix error message Mr. Pine 2023-03-15 15:38:19 +0100
  • 44e2b037c4
         Add crawler `on-conflict` option `no-delete-prompt-overwrite` Never deletes but prompts when overwriting a file Mr. Pine 2023-03-14 14:59:46 +0100
  • 6d44aac278 Bump version to 3.4.3 v3.4.3 Joscha 2022-11-29 18:22:19 +0100
  • 55a2de6b88 Fix crawling English opencast c0derMo 2022-11-25 10:25:22 +0000
  • c0d6d8b229 Use url after redirect for relative links Joscha 2022-11-21 17:53:30 +0100
  • 635caa765d Fix typo Joscha 2022-11-15 17:17:55 +0100
  • c92b4af3bb
         fixed minor mistake in 'config file-format' ReadMe Burg113 2022-11-15 16:25:31 +0100
  • e69b55b349
         Add more unofficial package managers (#66) Pavel Zwerschke 2022-11-04 12:18:26 +0100
  • e9b9d82a9f
         Add more package managers Pavel Zwerschke 2022-11-03 14:40:31 +0100
  • 07200bbde5 Document ilias web crawler's forums option Joscha 2022-10-31 14:10:45 +0100
  • c020cccc64 Include found paths in "second path found" warning I-Al-Istannen 2022-10-29 14:08:29 +0200
  • 259cfc20cc Bump version to 3.4.2 v3.4.2 Joscha 2022-10-26 18:26:17 +0200
  • 37b51a66d8 Update changelog Joscha 2022-10-26 18:22:37 +0200
  • f47d2f11d8 Append trailing slash to kit-ipd links to ensure urljoin works as expected I-Al-Istannen 2022-10-25 20:28:06 +0200
  • 847a2f36ec
         Bump action versions Pavel Zwerschke 2022-10-25 16:36:57 +0200
  • 1b6be6bd79 Handle content pages in cards I-Al-Istannen 2022-10-24 18:36:54 +0200
  • e1430e6298 Handle (and ignore) surveys I-Al-Istannen 2022-10-24 18:36:34 +0200
  • 2d145e7c94 Check for new versions at startup update-checks I-Al-Istannen 2022-10-24 17:31:34 +0200
  • 5fdd40204b Unwrap future meetings when ILIAS hides them behind a pagination I-Al-Istannen 2022-10-24 14:33:58 +0200
  • fb4631ba18 Fix ilias background login I-Al-Istannen 2022-10-24 13:13:36 +0200
  • d72fc2760b Handle empty forums I-Al-Istannen 2022-10-24 13:09:29 +0200
  • 4a51aaa4f5 Fix forum crawling crashing for empty threads I-Al-Istannen 2022-10-19 22:59:33 +0200
  • 66a5b1ba02 Bump version to 3.4.1 v3.4.1 Joscha 2022-08-17 13:24:01 +0200
  • aa5a3a10bc Adjust changelog I-Al-Istannen 2022-08-14 21:48:59 +0200
  • d9b111cec2 Correctly nest description entries I-Al-Istannen 2022-08-14 21:45:33 +0200
  • 345f52a1f6 Detect new login button I-Al-Istannen 2022-08-14 21:41:29 +0200
  • ed24366aba Add pass authenticator Joscha 2022-01-15 16:23:37 +0100
  • 46fb782798 Add forum crawling I-Al-Istannen 2022-05-24 23:28:09 +0200
  • 846c29aee1 Download page descriptions I-Al-Istannen 2022-05-11 21:16:09 +0200
  • a5015fe9b1 Correctly parse day-only meeting dates I-Al-Istannen 2022-05-08 23:21:18 +0200
  • 616b0480f7 Simplify IPD crawler link regex Joscha 2022-05-08 17:39:18 +0200
  • 2f0e04ce13 Adjust changelog I-Al-Istannen 2022-05-05 22:57:55 +0200
  • bcc537468c Fix crawling of expanded meetings I-Al-Istannen 2022-05-05 22:53:37 +0200
  • 694ffb4d77 Fix meeting date parsing I-Al-Istannen 2022-05-05 22:28:30 +0200
  • af2cc1169a Mention href for users of link_regex option Joscha 2022-05-05 14:23:19 +0200
  • bc3fa36637 Fix IPD crawler crashing on weird HTML comments Joscha 2022-05-05 14:20:45 +0200
  • afbd03f777 Fix docs Joscha 2022-05-05 14:15:48 +0200
  • b8fe25c580 Add `.cpp` to ipd link regex I-Al-Istannen 2022-05-04 14:13:39 +0200
  • a241672726 Bump version to 3.4.0 v3.4.0 Joscha 2022-05-01 22:29:06 +0200
  • a8f76e9be7 Use utf-8 for credential file Joscha 2022-04-29 23:15:12 +0200
  • b56475450d Use utf-8 for cookies Joscha 2022-04-29 23:12:41 +0200
  • aa74604d29 Use utf-8 for report Joscha 2022-04-29 23:11:27 +0200
  • d2e6d91880 Make PFERD executable via python -m Joscha 2022-04-27 22:50:36 +0200
  • 602044ff1b Fix mypy errors and add missing await Joscha 2022-04-27 22:50:06 +0200
  • 31631fb409 Increase minimum python version to 3.9 Joscha 2022-04-27 22:16:47 +0200
  • 00db348218 Update changelog I-Al-Istannen 2022-04-27 21:53:29 +0200
  • a709280cbf Try to detect unsupported config file encoding I-Al-Istannen 2022-04-27 21:48:09 +0200
  • a99ddaa0cc Read and write config in UTF-8 I-Al-Istannen 2022-04-27 21:47:51 +0200
  • ba3d299c05 Fix changelog Joscha 2022-04-27 21:23:55 +0200
  • 07a21f80a6 Link to unofficial packages Joscha 2022-04-27 21:15:33 +0200
  • f17b9b68f4 Add shibboleth authentication fix to changelog I-Al-Istannen 2022-04-27 14:01:40 +0200
  • a2831fbea2 Fix shib authentication I-Al-Istannen 2022-04-27 13:55:24 +0200
  • 9e95c5d3fd
         Add note about encoding on Windows Linus 2022-04-27 12:07:48 +0200
  • 7bc3a846b5
         readme.md: fixing arch linux installation issues TornaxO7 2022-04-22 19:46:40 +0200