I-Al-Istannen
3f5637366e
Sanitize / in kit-ipd heading hierarchy
2025-10-30 20:19:37 +01:00
I-Al-Istannen
3453bbc991
Add basic auth to KIT-IPD crawler
2025-10-29 13:11:34 +01:00
I-Al-Istannen
ebcfb2a2f3
Fix some typing errors
...
It seems like the type hints have gotten better :)
2025-10-19 16:27:54 +02:00
I-Al-Istannen
6e563134b2
Fix ruff errors
2025-10-19 15:48:16 +02:00
I-Al-Istannen
2cf0e060ed
Reformat and switch to ruff
2025-10-19 15:45:49 +02:00
I-Al-Istannen
f6c713d621
Fix mypy errors
2025-10-19 15:08:21 +02:00
I-Al-Istannen
207af51aa4
Include description in internet-shortcut links
2025-07-27 20:13:05 +02:00
Mr. Pine
549ce6cce9
Ignore unavailable elements ( #119 )
2025-05-28 17:04:57 +02:00
I-Al-Istannen
34564cedb4
Add support for link collections
2025-05-27 16:25:59 +02:00
I-Al-Istannen
2b0d20a1f6
Fix crawling of exercises with instructions
...
We do not want a second path and the instruction field has an identical
link...
2025-05-26 14:42:38 +02:00
I-Al-Istannen
4c230ef6dd
Fix exercise crawling
2025-04-25 13:45:57 +02:00
Nikolas Heise
b305e1ce23
Fix login using the native ilias login form
2025-04-23 16:08:45 +02:00
I-Al-Istannen
bdf17f5c87
Ignore wikis
2025-04-23 16:03:37 +02:00
I-Al-Istannen
653bf139f0
Fix encoding of descriptions and force images to light mode
2025-04-16 10:52:18 +02:00
I-Al-Istannen
b97b6fae6b
Update minimum Python version to 3.11
2025-04-15 21:35:20 +02:00
I-Al-Istannen
477234ad0d
Support ILIAS 9
2025-04-15 21:35:20 +02:00
I-Al-Istannen
63f25277b0
Fix crawling of empty forum threads
2025-03-09 23:44:25 +01:00
I-Al-Istannen
c8eff04ae0
Make thread titles link to original ILIAS thread
2025-02-19 16:23:20 +01:00
I-Al-Istannen
edc482cdf4
Internalize images in forum threads
2025-02-19 16:23:20 +01:00
I-Al-Istannen
72cd0f77e2
Prettify forum thread exports
...
Co-authored-by: Tim <me@scriptim.dev >
2025-02-19 16:23:20 +01:00
I-Al-Istannen
be175f9347
Download only new/updated forum threads
2025-02-19 16:16:37 +01:00
I-Al-Istannen
ba2833dba5
Crawl all threads in a forum
...
Before this patch the row count was unconditionally changed to 800. This
patch tries to detect how many rows the forum has and then fetches this
amount, if it is larger than 800.
2025-02-19 12:19:33 +01:00
I-Al-Istannen
2f0e792670
Increase default http timeout to 30
...
Otherwise larger forums will fail to download in time
2025-02-19 12:19:13 +01:00
I-Al-Istannen
5f88539f7e
Fix page size increase for forum threads
2025-02-19 12:19:11 +01:00
I-Al-Istannen
bd9d7efe64
"Fix" mypy errors
...
Thank you mypy, very cool. These types make things *so much better*.
They don't just complicate everything and don't really help because they
can not detect that an element queried by a tag is no navigable
string...
2025-02-19 12:15:41 +01:00
Aurelia
16a2dd5b15
fix: totp
2025-02-19 12:15:41 +01:00
I-Al-Istannen
712217e959
Handle groups in cards
2024-11-11 12:53:08 +01:00
I-Al-Istannen
6dda4c55a8
Add doctype header to forum threads
...
This should fix mimetype detection on most systems and is more relevant
now that the report is clickable
2024-11-05 18:36:21 +01:00
PinieP
596b6a7688
Add support for non-KIT shibboleth login ( #98 )
...
Co-authored-by: Mr-Pine <git@mr-pine.de >
Co-authored-by: I-Al-Istannen <I-Al-Istannen@users.noreply.github.com >
2024-11-05 18:30:34 +01:00
Tim
5983200247
Treat headings as folders in kit-ipd crawler ( #99 )
2024-11-04 23:53:48 +01:00
Tim
26e802d88b
Add clickable links to file names in the printed report ( #100 )
...
Co-authored-by: I-Al-Istannen <i-al-istannen@users.noreply.github.com >
2024-11-04 00:32:32 +01:00
I-Al-Istannen
f5c4e82816
Delay ilias loop detection after transform
...
This allows users to filter out duplicated elements and suppress the
warning.
2024-11-02 22:46:51 +01:00
I-Al-Istannen
f5273f7ca0
Collapse ilias url crawling into normal page crawling
2024-11-02 22:46:51 +01:00
I-Al-Istannen
fa71a9f44f
Add support for mob videos in page descriptions
2024-10-28 20:35:30 +01:00
I-Al-Istannen
81d6ff53c4
Respect row flex in descriptions
2024-10-28 19:41:03 +01:00
I-Al-Istannen
d7a2b6e019
Delete videos from course descriptions
2024-10-28 19:41:03 +01:00
I-Al-Istannen
71c65e89d1
Internalize images in course descriptions
2024-10-28 19:41:03 +01:00
I-Al-Istannen
c1046498e7
Fix download of links without a target URL
...
They are now downloaded as links to the empty url.
2024-10-28 19:41:03 +01:00
I-Al-Istannen
8fbd1978af
Fix crawling of nested courses
2024-10-28 18:52:27 +01:00
Tim
739dd95850
Use Last-Modified and ETag headers to determine KIT-IPD file versions ( #95 )
...
Co-authored-by: I-Al-Istannen <i-al-istannen@users.noreply.github.com >
2024-10-27 19:03:47 +01:00
I-Al-Istannen
c54c3bcfa1
Fix crawling of favorites
2024-10-27 10:50:59 +01:00
I-Al-Istannen
52fdeae752
Crawl custom item groups as folders
2024-10-21 23:43:48 +02:00
I-Al-Istannen
f9bb2e41cf
Sanitize slashes in exercise container names
2024-10-21 22:30:16 +02:00
I-Al-Istannen
c897d9e2f5
Support finding entries for course overview page
...
Related to issue #93
2024-06-26 16:54:07 +02:00
Joscha
778517d8c6
Fix KIT crawler requiring base_url and client_id options
2024-05-10 14:12:45 +02:00
Joscha
428b0179fc
Remove IliasConfig
...
Also uses urljoin() in a few places that previously used string
concatenation or fstrings.
At this point, there isn't yet a need for IliasConfig, so I'd rather
keep the code base simpler and more consistent. Should we need a
structure like IliasConfig in the future (maybe because we have a few
more ilias parsers), it's easy to add back.
2024-05-10 14:09:14 +02:00
Philipp Fruck
b01f093474
fix: Element detection for other universities
...
Other universities might use other URL schemes
for different element types
2024-05-04 17:52:06 +02:00
Philipp Fruck
3a05b90525
fix circular import for _io_repeat
2024-05-04 17:51:59 +02:00
Philipp Fruck
7a00f73e0e
feat: Add authentication to generic ilias dl
2024-05-04 17:51:38 +02:00
Philipp Fruck
5d0621420e
feat: Generic ilias_web command
2024-05-04 17:44:37 +02:00
