mirrors/pferd
1
0
Fork 0
mirror of https://github.com/Garmelon/PFERD.git synced 2023-12-21 10:23:01 +01:00
Code Issues Packages Projects Releases Wiki Activity

Commit Graph

  • a117126389 Fix video name deduplication master I-Al-Istannen 2023-12-09 23:01:59 +01:00
  • e9f8901520 Fix typos in ilias crawler and use set literals I-Al-Istannen 2023-11-30 20:50:53 +01:00
  • 266812f90e Move is_logged_in helper to kit_ilias_html I-Al-Istannen 2023-11-16 10:34:49 +01:00
  • 03efa17cf1 Print mtime before updating file metadata debug/mtime-error-22 I-Al-Istannen 2023-09-23 12:37:56 +02:00
  • 533bc27439 Bump version to 3.5.0 v3.5.0 latest I-Al-Istannen 2023-09-13 23:13:30 +02:00
  • 0113a0ca10 Update flake.lock I-Al-Istannen 2023-09-13 22:23:21 +02:00
  • 40f8a05ad6 Add .idea to gitignore I-Al-Istannen 2023-09-13 22:23:31 +02:00
  • 50b50513c6 Ignore SCORM learning modules I-Al-Istannen 2023-08-29 13:51:19 +02:00
  • df3514cd03 Crawl paginated past meetings I-Al-Istannen 2023-08-29 12:30:54 +02:00
  • ad53185247 Sanitize ascii control characters on windows I-Al-Istannen 2023-08-29 12:25:16 +02:00
  • 87b67e9271 Crawl files in the info tab I-Al-Istannen 2023-08-29 11:52:16 +02:00
  • b54b3b979c Remove size suffix for content pages I-Al-Istannen 2023-08-27 11:42:25 +02:00
  • 2184ac8040 Add support for ILIAS mediacast listings I-Al-Istannen 2023-08-26 19:39:40 +02:00
  • b3d412360b Add Nix flake I-Al-Istannen 2023-08-26 23:48:14 +02:00
  • dbc2553b11 Add default show-not-deleted option If set to no, PFERD won't print status or report messages for not deleted files Mr. Pine 2023-03-15 15:33:42 +01:00
  • 68c398f1fe Add support for ILIAS learning modules I-Al-Istannen 2023-07-29 23:23:10 +02:00
  • 123a57beec Fix mypy unreachable error in file_templates I-Al-Istannen 2023-07-29 18:14:57 +02:00
  • d204dac8ce Detect unexpected root page redirects and abort operation I-Al-Istannen 2023-06-02 18:19:39 +02:00
  • 443f7fe839 Add no-delete-prompt-overwrite crawler conflict resolution option () Mr. Pine 2023-07-29 17:54:42 +02:00
  • bf27f4a686 TODO sequential Joscha 2022-11-24 15:47:01 +01:00
  • 5adfdfbd2b Switch http_crawler to requests Joscha 2022-11-24 11:24:05 +01:00
  • 5c3942a13d Fix flake8 error Joscha 2022-11-24 07:53:52 +01:00
  • 5c9209b12e Document path formatting functions Joscha 2022-11-23 23:48:17 +01:00
  • 50c7778d38 Use mypy to install library stub packages Joscha 2022-11-23 23:12:14 +01:00
  • 354a22d1e3 Add vscode settings Joscha 2022-11-23 23:00:25 +01:00
  • 6f87c5c774 Make ipd crawler synchronous Joscha 2022-11-23 22:34:44 +01:00
  • 1ca10571f0 Remove limiter Joscha 2022-11-23 22:28:40 +01:00
  • 10e1a5e871 De-Async ilias crawler I-Al-Istannen 2022-11-22 20:56:35 +01:00
  • a2ffce4702 Make local crawler synchronous Joscha 2022-10-26 19:41:34 +02:00
  • 0294ceb7d5 Update github action versions I-Al-Istannen 2023-03-22 00:08:19 +01:00
  • 6f30c6583d Fix crawling of cards without descriptions I-Al-Istannen 2023-03-21 23:52:33 +01:00
  • 467fc526e8 Fix crawling of file/video cards I-Al-Istannen 2023-03-21 23:52:24 +01:00
  • 722d2eb393 Fix crawling of courses with preselected timeline tab I-Al-Istannen 2022-11-25 12:49:36 +01:00
  • 6d44aac278 Bump version to 3.4.3 v3.4.3 Joscha 2022-11-29 18:22:19 +01:00
  • 55a2de6b88 Fix crawling English opencast c0derMo 2022-11-25 10:25:22 +00:00
  • c0d6d8b229 Use url after redirect for relative links Joscha 2022-11-21 17:53:30 +01:00
  • 635caa765d Fix typo Joscha 2022-11-15 17:17:55 +01:00
  • e69b55b349
         Add more unofficial package managers () Pavel Zwerschke 2022-11-04 12:18:26 +01:00
  • 07200bbde5 Document ilias web crawler's forums option Joscha 2022-10-31 14:10:45 +01:00
  • c020cccc64 Include found paths in "second path found" warning I-Al-Istannen 2022-10-29 14:08:29 +02:00
  • 259cfc20cc Bump version to 3.4.2 v3.4.2 Joscha 2022-10-26 18:26:17 +02:00
  • 37b51a66d8 Update changelog Joscha 2022-10-26 18:22:37 +02:00
  • f47d2f11d8 Append trailing slash to kit-ipd links to ensure urljoin works as expected I-Al-Istannen 2022-10-25 20:28:06 +02:00
  • 1b6be6bd79 Handle content pages in cards I-Al-Istannen 2022-10-24 18:36:54 +02:00
  • e1430e6298 Handle (and ignore) surveys I-Al-Istannen 2022-10-24 18:36:34 +02:00
  • 2d145e7c94 Check for new versions at startup update-checks I-Al-Istannen 2022-10-24 17:31:34 +02:00
  • 5fdd40204b Unwrap future meetings when ILIAS hides them behind a pagination I-Al-Istannen 2022-10-24 14:33:58 +02:00
  • fb4631ba18 Fix ilias background login I-Al-Istannen 2022-10-24 13:13:36 +02:00
  • d72fc2760b Handle empty forums I-Al-Istannen 2022-10-24 13:09:29 +02:00
  • 4a51aaa4f5 Fix forum crawling crashing for empty threads I-Al-Istannen 2022-10-19 22:59:33 +02:00
  • 66a5b1ba02 Bump version to 3.4.1 v3.4.1 Joscha 2022-08-17 13:24:01 +02:00
  • aa5a3a10bc Adjust changelog I-Al-Istannen 2022-08-14 21:48:59 +02:00
  • d9b111cec2 Correctly nest description entries I-Al-Istannen 2022-08-14 21:45:33 +02:00
  • 345f52a1f6 Detect new login button I-Al-Istannen 2022-08-14 21:41:29 +02:00
  • ed24366aba Add pass authenticator Joscha 2022-01-15 16:23:37 +01:00
  • 46fb782798 Add forum crawling I-Al-Istannen 2022-05-24 23:28:09 +02:00
  • 846c29aee1 Download page descriptions I-Al-Istannen 2022-05-11 21:16:09 +02:00
  • a5015fe9b1 Correctly parse day-only meeting dates I-Al-Istannen 2022-05-08 23:21:18 +02:00
  • 616b0480f7 Simplify IPD crawler link regex Joscha 2022-05-08 17:39:18 +02:00
  • 2f0e04ce13 Adjust changelog I-Al-Istannen 2022-05-05 22:57:55 +02:00
  • bcc537468c Fix crawling of expanded meetings I-Al-Istannen 2022-05-05 22:53:37 +02:00
  • 694ffb4d77 Fix meeting date parsing I-Al-Istannen 2022-05-05 22:28:30 +02:00
  • af2cc1169a Mention href for users of link_regex option Joscha 2022-05-05 14:23:19 +02:00
  • bc3fa36637 Fix IPD crawler crashing on weird HTML comments Joscha 2022-05-05 14:20:45 +02:00
  • afbd03f777 Fix docs Joscha 2022-05-05 14:15:48 +02:00
  • b8fe25c580 Add .cpp to ipd link regex I-Al-Istannen 2022-05-04 14:13:39 +02:00
  • a241672726 Bump version to 3.4.0 v3.4.0 Joscha 2022-05-01 22:29:06 +02:00
  • a8f76e9be7 Use utf-8 for credential file Joscha 2022-04-29 23:15:12 +02:00
  • b56475450d Use utf-8 for cookies Joscha 2022-04-29 23:12:41 +02:00
  • aa74604d29 Use utf-8 for report Joscha 2022-04-29 23:11:27 +02:00
  • d2e6d91880 Make PFERD executable via python -m Joscha 2022-04-27 22:50:36 +02:00
  • 602044ff1b Fix mypy errors and add missing await Joscha 2022-04-27 22:50:06 +02:00
  • 31631fb409 Increase minimum python version to 3.9 Joscha 2022-04-27 22:16:47 +02:00
  • 00db348218 Update changelog I-Al-Istannen 2022-04-27 21:53:29 +02:00
  • a709280cbf Try to detect unsupported config file encoding I-Al-Istannen 2022-04-27 21:48:09 +02:00
  • a99ddaa0cc Read and write config in UTF-8 I-Al-Istannen 2022-04-27 21:47:51 +02:00
  • ba3d299c05 Fix changelog Joscha 2022-04-27 21:23:55 +02:00
  • 07a21f80a6 Link to unofficial packages Joscha 2022-04-27 21:15:33 +02:00
  • f17b9b68f4 Add shibboleth authentication fix to changelog I-Al-Istannen 2022-04-27 14:01:40 +02:00
  • a2831fbea2 Fix shib authentication I-Al-Istannen 2022-04-27 13:55:24 +02:00
  • da72863b47 Placate newer mypy I-Al-Istannen 2022-04-03 13:19:08 +02:00
  • 86e2e226dc Notify user when shibboleth presents new entitlements I-Al-Istannen 2022-04-03 11:32:38 +02:00
  • 7872fe5221 Fix tables with more columns than expected I-Al-Istannen 2022-01-18 22:32:43 +01:00
  • 86947e4874 Bump version to 3.3.1 v3.3.1 Joscha 2022-01-15 15:11:22 +01:00
  • 4f022e2d19 Reword changelog Joscha 2022-01-15 15:06:02 +01:00
  • f47e7374d2 Use fixed windows path for video cache I-Al-Istannen 2022-01-14 22:01:45 +01:00
  • 57ec51e95a Fix login after shib url parser change I-Al-Istannen 2022-01-14 20:15:19 +01:00
  • 0045124a4e Bump version to 3.3.0 v3.3.0 Joscha 2022-01-09 21:09:09 +01:00
  • 9618aae83b Add content pages to changelog I-Al-Istannen 2022-01-09 18:32:58 +01:00
  • 33453ede2d Update dependency versions in setup.py I-Al-Istannen 2022-01-09 18:31:42 +01:00
  • e467b38d73 Only reject 1970 timestamps on windows I-Al-Istannen 2022-01-09 18:23:00 +01:00
  • e9d2d05030 Update changelog I-Al-Istannen 2022-01-09 11:39:42 +01:00
  • 4bf0c972e6 Update types for rich 11 I-Al-Istannen 2022-01-09 11:47:59 +01:00
  • 4ee919625d Add rudimentary support for content pages I-Al-Istannen 2022-01-08 20:47:35 +01:00
  • d30f25ee97 Detect shib login page as login page I-Al-Istannen 2022-01-08 20:28:45 +01:00
  • 10d9d74528 Bail out when crawling recursive courses I-Al-Istannen 2022-01-08 20:28:30 +01:00
  • 43c5453e10 Correctly crawl files on desktop I-Al-Istannen 2022-01-08 19:59:42 +01:00
  • eb4de8ae0c Ignore 1970 dates as windows crashes when calling .timestamp() I-Al-Istannen 2022-01-08 18:14:43 +01:00
  • e32c1f000f Fix mtime for single streams I-Al-Istannen 2022-01-08 18:05:48 +01:00
  • 5f527bc697 Remove Python 3.9 Pattern typehints I-Al-Istannen 2022-01-08 17:14:40 +01:00