1a430ad5d1
Update minimum Python version to 3.11
2025-04-15 11:31:39 +02:00
f6bdeb6b9d
Support ILIAS 9
2025-04-15 11:19:53 +02:00
63f25277b0
Fix crawling of empty forum threads
2025-03-09 23:44:25 +01:00
c8eff04ae0
Make thread titles link to original ILIAS thread
2025-02-19 16:23:20 +01:00
edc482cdf4
Internalize images in forum threads
2025-02-19 16:23:20 +01:00
72cd0f77e2
Prettify forum thread exports
...
Co-authored-by: Tim <me@scriptim.dev >
2025-02-19 16:23:20 +01:00
be175f9347
Download only new/updated forum threads
2025-02-19 16:16:37 +01:00
ba2833dba5
Crawl all threads in a forum
...
Before this patch the row count was unconditionally changed to 800. This
patch tries to detect how many rows the forum has and then fetches this
amount, if it is larger than 800.
2025-02-19 12:19:33 +01:00
2f0e792670
Increase default http timeout to 30
...
Otherwise larger forums will fail to download in time
2025-02-19 12:19:13 +01:00
5f88539f7e
Fix page size increase for forum threads
2025-02-19 12:19:11 +01:00
bd9d7efe64
"Fix" mypy errors
...
Thank you mypy, very cool. These types make things *so much better*.
They don't just complicate everything and don't really help because they
can not detect that an element queried by a tag is no navigable
string...
2025-02-19 12:15:41 +01:00
16a2dd5b15
fix: totp
2025-02-19 12:15:41 +01:00
678283d341
Use Python facilities to convert paths to file:// urls
2024-11-15 00:09:11 +01:00
287173b0b1
Bump version to 3.7.0
2024-11-13 20:38:27 +01:00
712217e959
Handle groups in cards
2024-11-11 12:53:08 +01:00
6dda4c55a8
Add doctype header to forum threads
...
This should fix mimetype detection on most systems and is more relevant
now that the report is clickable
2024-11-05 18:36:21 +01:00
596b6a7688
Add support for non-KIT shibboleth login ( #98 )
...
Co-authored-by: Mr-Pine <git@mr-pine.de >
Co-authored-by: I-Al-Istannen <I-Al-Istannen@users.noreply.github.com >
2024-11-05 18:30:34 +01:00
5983200247
Treat headings as folders in kit-ipd crawler ( #99 )
2024-11-04 23:53:48 +01:00
26e802d88b
Add clickable links to file names in the printed report ( #100 )
...
Co-authored-by: I-Al-Istannen <i-al-istannen@users.noreply.github.com >
2024-11-04 00:32:32 +01:00
f5c4e82816
Delay ilias loop detection after transform
...
This allows users to filter out duplicated elements and suppress the
warning.
2024-11-02 22:46:51 +01:00
f5273f7ca0
Collapse ilias url crawling into normal page crawling
2024-11-02 22:46:51 +01:00
fa71a9f44f
Add support for mob videos in page descriptions
2024-10-28 20:35:30 +01:00
81d6ff53c4
Respect row flex in descriptions
2024-10-28 19:41:03 +01:00
d7a2b6e019
Delete videos from course descriptions
2024-10-28 19:41:03 +01:00
71c65e89d1
Internalize images in course descriptions
2024-10-28 19:41:03 +01:00
c1046498e7
Fix download of links without a target URL
...
They are now downloaded as links to the empty url.
2024-10-28 19:41:03 +01:00
8fbd1978af
Fix crawling of nested courses
2024-10-28 18:52:27 +01:00
739dd95850
Use Last-Modified and ETag headers to determine KIT-IPD file versions ( #95 )
...
Co-authored-by: I-Al-Istannen <i-al-istannen@users.noreply.github.com >
2024-10-27 19:03:47 +01:00
c54c3bcfa1
Fix crawling of favorites
2024-10-27 10:50:59 +01:00
d7f2229978
Bump version to 3.6.0
2024-10-23 20:17:47 +02:00
52fdeae752
Crawl custom item groups as folders
2024-10-21 23:43:48 +02:00
f9bb2e41cf
Sanitize slashes in exercise container names
2024-10-21 22:30:16 +02:00
4f9e2ab48d
Support named capture groups in regex transformers ( #94 )
2024-10-21 15:21:33 +02:00
c897d9e2f5
Support finding entries for course overview page
...
Related to issue #93
2024-06-26 16:54:07 +02:00
4b4f72b2ca
Fix command name
2024-05-10 14:34:20 +02:00
778517d8c6
Fix KIT crawler requiring base_url and client_id options
2024-05-10 14:12:45 +02:00
428b0179fc
Remove IliasConfig
...
Also uses urljoin() in a few places that previously used string
concatenation or fstrings.
At this point, there isn't yet a need for IliasConfig, so I'd rather
keep the code base simpler and more consistent. Should we need a
structure like IliasConfig in the future (maybe because we have a few
more ilias parsers), it's easy to add back.
2024-05-10 14:09:14 +02:00
b01f093474
fix: Element detection for other universities
...
Other universities might use other URL schemes
for different element types
2024-05-04 17:52:06 +02:00
3a05b90525
fix circular import for _io_repeat
2024-05-04 17:51:59 +02:00
7a00f73e0e
feat: Add authentication to generic ilias dl
2024-05-04 17:51:38 +02:00
5d0621420e
feat: Generic ilias_web command
2024-05-04 17:44:37 +02:00
df98153169
refactor: Extract generic settings from ilias command
...
Preparation for generic ilias_web command
2024-05-04 17:44:30 +02:00
fc1f68ccd9
refactor: Separate generic and KIT ilias functions
2024-05-04 17:44:18 +02:00
3e831c7e23
Fix normalization of meeting names in cards
2024-04-24 22:32:26 +02:00
eb01aa86cb
Bump version to 3.5.2
2024-04-14 12:10:17 +02:00
3db186a978
Fix personal desktop crawling HTML warnings
2024-04-10 11:15:25 +02:00
4a5959fd58
Fix personal desktop crawling without favorites
2024-04-10 11:15:25 +02:00
1cbc2b717a
Fix personal desktop crawling with ILIAS 8
2024-04-10 01:20:37 +02:00
da627ff929
Bump version to 3.5.1
2024-04-09 14:28:56 +02:00
c1b592ac29
Fix ILIAS 8 file downloads truncating to zero bytes
2024-04-08 17:59:41 +02:00
