4c230ef6dd
Fix exercise crawling
2025-04-25 13:45:57 +02:00
b305e1ce23
Fix login using the native ilias login form
2025-04-23 16:08:45 +02:00
bdf17f5c87
Ignore wikis
2025-04-23 16:03:37 +02:00
653bf139f0
Fix encoding of descriptions and force images to light mode
2025-04-16 10:52:18 +02:00
b97b6fae6b
Update minimum Python version to 3.11
2025-04-15 21:35:20 +02:00
477234ad0d
Support ILIAS 9
2025-04-15 21:35:20 +02:00
63f25277b0
Fix crawling of empty forum threads
2025-03-09 23:44:25 +01:00
c8eff04ae0
Make thread titles link to original ILIAS thread
2025-02-19 16:23:20 +01:00
edc482cdf4
Internalize images in forum threads
2025-02-19 16:23:20 +01:00
72cd0f77e2
Prettify forum thread exports
...
Co-authored-by: Tim <me@scriptim.dev >
2025-02-19 16:23:20 +01:00
be175f9347
Download only new/updated forum threads
2025-02-19 16:16:37 +01:00
ba2833dba5
Crawl all threads in a forum
...
Before this patch the row count was unconditionally changed to 800. This
patch tries to detect how many rows the forum has and then fetches this
amount, if it is larger than 800.
2025-02-19 12:19:33 +01:00
2f0e792670
Increase default http timeout to 30
...
Otherwise larger forums will fail to download in time
2025-02-19 12:19:13 +01:00
5f88539f7e
Fix page size increase for forum threads
2025-02-19 12:19:11 +01:00
bd9d7efe64
"Fix" mypy errors
...
Thank you mypy, very cool. These types make things *so much better*.
They don't just complicate everything and don't really help because they
can not detect that an element queried by a tag is no navigable
string...
2025-02-19 12:15:41 +01:00
16a2dd5b15
fix: totp
2025-02-19 12:15:41 +01:00
712217e959
Handle groups in cards
2024-11-11 12:53:08 +01:00
6dda4c55a8
Add doctype header to forum threads
...
This should fix mimetype detection on most systems and is more relevant
now that the report is clickable
2024-11-05 18:36:21 +01:00
596b6a7688
Add support for non-KIT shibboleth login ( #98 )
...
Co-authored-by: Mr-Pine <git@mr-pine.de >
Co-authored-by: I-Al-Istannen <I-Al-Istannen@users.noreply.github.com >
2024-11-05 18:30:34 +01:00
5983200247
Treat headings as folders in kit-ipd crawler ( #99 )
2024-11-04 23:53:48 +01:00
26e802d88b
Add clickable links to file names in the printed report ( #100 )
...
Co-authored-by: I-Al-Istannen <i-al-istannen@users.noreply.github.com >
2024-11-04 00:32:32 +01:00
f5c4e82816
Delay ilias loop detection after transform
...
This allows users to filter out duplicated elements and suppress the
warning.
2024-11-02 22:46:51 +01:00
f5273f7ca0
Collapse ilias url crawling into normal page crawling
2024-11-02 22:46:51 +01:00
fa71a9f44f
Add support for mob videos in page descriptions
2024-10-28 20:35:30 +01:00
81d6ff53c4
Respect row flex in descriptions
2024-10-28 19:41:03 +01:00
d7a2b6e019
Delete videos from course descriptions
2024-10-28 19:41:03 +01:00
71c65e89d1
Internalize images in course descriptions
2024-10-28 19:41:03 +01:00
c1046498e7
Fix download of links without a target URL
...
They are now downloaded as links to the empty url.
2024-10-28 19:41:03 +01:00
8fbd1978af
Fix crawling of nested courses
2024-10-28 18:52:27 +01:00
739dd95850
Use Last-Modified and ETag headers to determine KIT-IPD file versions ( #95 )
...
Co-authored-by: I-Al-Istannen <i-al-istannen@users.noreply.github.com >
2024-10-27 19:03:47 +01:00
c54c3bcfa1
Fix crawling of favorites
2024-10-27 10:50:59 +01:00
52fdeae752
Crawl custom item groups as folders
2024-10-21 23:43:48 +02:00
f9bb2e41cf
Sanitize slashes in exercise container names
2024-10-21 22:30:16 +02:00
c897d9e2f5
Support finding entries for course overview page
...
Related to issue #93
2024-06-26 16:54:07 +02:00
778517d8c6
Fix KIT crawler requiring base_url and client_id options
2024-05-10 14:12:45 +02:00
428b0179fc
Remove IliasConfig
...
Also uses urljoin() in a few places that previously used string
concatenation or fstrings.
At this point, there isn't yet a need for IliasConfig, so I'd rather
keep the code base simpler and more consistent. Should we need a
structure like IliasConfig in the future (maybe because we have a few
more ilias parsers), it's easy to add back.
2024-05-10 14:09:14 +02:00
b01f093474
fix: Element detection for other universities
...
Other universities might use other URL schemes
for different element types
2024-05-04 17:52:06 +02:00
3a05b90525
fix circular import for _io_repeat
2024-05-04 17:51:59 +02:00
7a00f73e0e
feat: Add authentication to generic ilias dl
2024-05-04 17:51:38 +02:00
5d0621420e
feat: Generic ilias_web command
2024-05-04 17:44:37 +02:00
fc1f68ccd9
refactor: Separate generic and KIT ilias functions
2024-05-04 17:44:18 +02:00
3e831c7e23
Fix normalization of meeting names in cards
2024-04-24 22:32:26 +02:00
3db186a978
Fix personal desktop crawling HTML warnings
2024-04-10 11:15:25 +02:00
4a5959fd58
Fix personal desktop crawling without favorites
2024-04-10 11:15:25 +02:00
1cbc2b717a
Fix personal desktop crawling with ILIAS 8
2024-04-10 01:20:37 +02:00
c1b592ac29
Fix ILIAS 8 file downloads truncating to zero bytes
2024-04-08 17:59:41 +02:00
eb0c956d32
Add compatibility with ILIAS 8
2024-04-05 19:08:05 +02:00
a117126389
Fix video name deduplication
2023-12-09 23:08:42 +01:00
e9f8901520
Fix typos in ilias crawler and use set literals
2023-11-30 20:57:57 +01:00
266812f90e
Move is_logged_in helper to kit_ilias_html
2023-11-16 11:19:20 +01:00
