b01f093474
fix: Element detection for other universities
...
Other universities might use other URL schemes
for different element types
2024-05-04 17:52:06 +02:00
3a05b90525
fix circular import for _io_repeat
2024-05-04 17:51:59 +02:00
7a00f73e0e
feat: Add authentication to generic ilias dl
2024-05-04 17:51:38 +02:00
5d0621420e
feat: Generic ilias_web command
2024-05-04 17:44:37 +02:00
fc1f68ccd9
refactor: Separate generic and KIT ilias functions
2024-05-04 17:44:18 +02:00
3e831c7e23
Fix normalization of meeting names in cards
2024-04-24 22:32:26 +02:00
3db186a978
Fix personal desktop crawling HTML warnings
2024-04-10 11:15:25 +02:00
4a5959fd58
Fix personal desktop crawling without favorites
2024-04-10 11:15:25 +02:00
1cbc2b717a
Fix personal desktop crawling with ILIAS 8
2024-04-10 01:20:37 +02:00
c1b592ac29
Fix ILIAS 8 file downloads truncating to zero bytes
2024-04-08 17:59:41 +02:00
eb0c956d32
Add compatibility with ILIAS 8
2024-04-05 19:08:05 +02:00
a117126389
Fix video name deduplication
2023-12-09 23:08:42 +01:00
e9f8901520
Fix typos in ilias crawler and use set literals
2023-11-30 20:57:57 +01:00
266812f90e
Move is_logged_in helper to kit_ilias_html
2023-11-16 11:19:20 +01:00
50b50513c6
Ignore SCORM learning modules
2023-08-29 13:51:19 +02:00
df3514cd03
Crawl paginated past meetings
2023-08-29 12:41:21 +02:00
87b67e9271
Crawl files in the info tab
2023-08-29 12:41:15 +02:00
b54b3b979c
Remove size suffix for content pages
2023-08-27 11:43:05 +02:00
2184ac8040
Add support for ILIAS mediacast listings
2023-08-27 11:43:05 +02:00
68c398f1fe
Add support for ILIAS learning modules
2023-08-02 13:34:54 +02:00
123a57beec
Fix mypy unreachable error in file_templates
2023-07-29 18:36:33 +02:00
d204dac8ce
Detect unexpected root page redirects and abort operation
2023-07-29 18:36:33 +02:00
6f30c6583d
Fix crawling of cards without descriptions
2023-03-21 23:52:33 +01:00
467fc526e8
Fix crawling of file/video cards
2023-03-21 23:52:24 +01:00
722d2eb393
Fix crawling of courses with preselected timeline tab
2023-03-21 23:36:47 +01:00
55a2de6b88
Fix crawling English opencast
2022-11-29 18:13:56 +01:00
c0d6d8b229
Use url after redirect for relative links
2022-11-21 18:10:45 +01:00
c020cccc64
Include found paths in "second path found" warning
2022-10-29 14:08:29 +02:00
f47d2f11d8
Append trailing slash to kit-ipd links to ensure urljoin works as expected
2022-10-25 20:28:22 +02:00
1b6be6bd79
Handle content pages in cards
2022-10-24 18:37:26 +02:00
e1430e6298
Handle (and ignore) surveys
2022-10-24 18:37:26 +02:00
5fdd40204b
Unwrap future meetings when ILIAS hides them behind a pagination
2022-10-24 14:33:58 +02:00
fb4631ba18
Fix ilias background login
2022-10-24 13:13:36 +02:00
d72fc2760b
Handle empty forums
2022-10-24 13:12:17 +02:00
4a51aaa4f5
Fix forum crawling crashing for empty threads
2022-10-19 22:59:33 +02:00
d9b111cec2
Correctly nest description entries
2022-08-14 21:45:33 +02:00
345f52a1f6
Detect new login button
2022-08-14 21:41:29 +02:00
46fb782798
Add forum crawling
...
This downloads all forum posts when needed and saves each thread in its
own html file, named after the thread title.
2022-05-24 23:43:53 +02:00
846c29aee1
Download page descriptions
2022-05-11 21:16:56 +02:00
a5015fe9b1
Correctly parse day-only meeting dates
...
I failed to recognize the correct format in the previous adjustment, so
this (hopefully) fixes it for good.
Meetings apparently don't always have a time portion.
2022-05-08 23:22:26 +02:00
616b0480f7
Simplify IPD crawler link regex
2022-05-08 18:18:05 +02:00
bcc537468c
Fix crawling of expanded meetings
...
The last meeting on every page is expanded by default.
Its content is then shown inline *and* in the meeting page itself.
We should skip the inline content.
2022-05-05 22:53:37 +02:00
694ffb4d77
Fix meeting date parsing
...
Apparently the new pattern "<relative time qualifier>: <date>," was
added. This patch adds support for it.
2022-05-05 22:28:30 +02:00
af2cc1169a
Mention href for users of link_regex option
2022-05-05 14:36:03 +02:00
bc3fa36637
Fix IPD crawler crashing on weird HTML comments
2022-05-05 14:35:42 +02:00
b8fe25c580
Add .cpp to ipd link regex
2022-05-04 14:19:26 +02:00
b56475450d
Use utf-8 for cookies
2022-04-29 23:12:41 +02:00
602044ff1b
Fix mypy errors and add missing await
2022-04-27 22:52:50 +02:00
a2831fbea2
Fix shib authentication
...
Authentication failed previously if the shib session was still valid.
If Shibboleth gets a request and the session is still valid, it directly
responds without a second redirect.
2022-04-27 13:55:24 +02:00
86e2e226dc
Notify user when shibboleth presents new entitlements
2022-04-03 11:37:08 +02:00
