2f0e792670
Increase default http timeout to 30
...
Otherwise larger forums will fail to download in time
2025-02-19 12:19:13 +01:00
5f88539f7e
Fix page size increase for forum threads
2025-02-19 12:19:11 +01:00
bd9d7efe64
"Fix" mypy errors
...
Thank you mypy, very cool. These types make things *so much better*.
They don't just complicate everything and don't really help because they
can not detect that an element queried by a tag is no navigable
string...
2025-02-19 12:15:41 +01:00
16a2dd5b15
fix: totp
2025-02-19 12:15:41 +01:00
678283d341
Use Python facilities to convert paths to file:// urls
2024-11-15 00:09:11 +01:00
287173b0b1
Bump version to 3.7.0
2024-11-13 20:38:27 +01:00
712217e959
Handle groups in cards
2024-11-11 12:53:08 +01:00
6dda4c55a8
Add doctype header to forum threads
...
This should fix mimetype detection on most systems and is more relevant
now that the report is clickable
2024-11-05 18:36:21 +01:00
596b6a7688
Add support for non-KIT shibboleth login ( #98 )
...
Co-authored-by: Mr-Pine <git@mr-pine.de >
Co-authored-by: I-Al-Istannen <I-Al-Istannen@users.noreply.github.com >
2024-11-05 18:30:34 +01:00
5983200247
Treat headings as folders in kit-ipd crawler ( #99 )
2024-11-04 23:53:48 +01:00
26e802d88b
Add clickable links to file names in the printed report ( #100 )
...
Co-authored-by: I-Al-Istannen <i-al-istannen@users.noreply.github.com >
2024-11-04 00:32:32 +01:00
f5c4e82816
Delay ilias loop detection after transform
...
This allows users to filter out duplicated elements and suppress the
warning.
2024-11-02 22:46:51 +01:00
f5273f7ca0
Collapse ilias url crawling into normal page crawling
2024-11-02 22:46:51 +01:00
fa71a9f44f
Add support for mob videos in page descriptions
2024-10-28 20:35:30 +01:00
81d6ff53c4
Respect row flex in descriptions
2024-10-28 19:41:03 +01:00
d7a2b6e019
Delete videos from course descriptions
2024-10-28 19:41:03 +01:00
71c65e89d1
Internalize images in course descriptions
2024-10-28 19:41:03 +01:00
c1046498e7
Fix download of links without a target URL
...
They are now downloaded as links to the empty url.
2024-10-28 19:41:03 +01:00
8fbd1978af
Fix crawling of nested courses
2024-10-28 18:52:27 +01:00
739dd95850
Use Last-Modified and ETag headers to determine KIT-IPD file versions ( #95 )
...
Co-authored-by: I-Al-Istannen <i-al-istannen@users.noreply.github.com >
2024-10-27 19:03:47 +01:00
c54c3bcfa1
Fix crawling of favorites
2024-10-27 10:50:59 +01:00
d7f2229978
Bump version to 3.6.0
2024-10-23 20:17:47 +02:00
52fdeae752
Crawl custom item groups as folders
2024-10-21 23:43:48 +02:00
f9bb2e41cf
Sanitize slashes in exercise container names
2024-10-21 22:30:16 +02:00
4f9e2ab48d
Support named capture groups in regex transformers ( #94 )
2024-10-21 15:21:33 +02:00
19beb8f07b
Document course overview downloading in config.md
2024-07-31 22:02:43 +02:00
c897d9e2f5
Support finding entries for course overview page
...
Related to issue #93
2024-06-26 16:54:07 +02:00
21a266e302
Update upload-artifact action to v4
...
https://github.com/actions/upload-artifact/blob/main/docs/MIGRATION.md#multiple-uploads-to-the-same-named-artifact
2024-05-11 16:33:14 +02:00
b29b6f93f8
run ci twice
...
Co-authored-by: Garmelon <joscha@plugh.de >
2024-05-11 16:09:46 +02:00
318226d7cb
fix bump-version script
2024-05-11 10:27:54 +02:00
422cf05f15
Move all configuration into pyproject.toml, add x86 mac to CI
2024-05-11 10:26:19 +02:00
819c6673c7
Update changelog
2024-05-10 14:40:25 +02:00
89b44c69a7
Update docs
...
All config file options must be documented in CONFIG.md. The README.md
is just a starting point. To avoid duplicated info, I've moved most of
the docs to CONFIG.md.
2024-05-10 14:36:01 +02:00
4b4f72b2ca
Fix command name
2024-05-10 14:34:20 +02:00
778517d8c6
Fix KIT crawler requiring base_url and client_id options
2024-05-10 14:12:45 +02:00
428b0179fc
Remove IliasConfig
...
Also uses urljoin() in a few places that previously used string
concatenation or fstrings.
At this point, there isn't yet a need for IliasConfig, so I'd rather
keep the code base simpler and more consistent. Should we need a
structure like IliasConfig in the future (maybe because we have a few
more ilias parsers), it's easy to add back.
2024-05-10 14:09:14 +02:00
ade6309dd9
Update copyright information
2024-05-05 02:34:26 +02:00
fd6cb7b966
docs: Remove some filler words
2024-05-05 02:34:00 +02:00
5c87517ceb
docs: Explain usage with generic ilias
2024-05-04 17:52:12 +02:00
b01f093474
fix: Element detection for other universities
...
Other universities might use other URL schemes
for different element types
2024-05-04 17:52:06 +02:00
3a05b90525
fix circular import for _io_repeat
2024-05-04 17:51:59 +02:00
7a00f73e0e
feat: Add authentication to generic ilias dl
2024-05-04 17:51:38 +02:00
5d0621420e
feat: Generic ilias_web command
2024-05-04 17:44:37 +02:00
df98153169
refactor: Extract generic settings from ilias command
...
Preparation for generic ilias_web command
2024-05-04 17:44:30 +02:00
fc1f68ccd9
refactor: Separate generic and KIT ilias functions
2024-05-04 17:44:18 +02:00
3e831c7e23
Fix normalization of meeting names in cards
2024-04-24 22:32:26 +02:00
bbcfe9c8dd
Fix typo in CONFIG.md ( #89 )
2024-04-19 16:52:18 +02:00
eb01aa86cb
Bump version to 3.5.2
2024-04-14 12:10:17 +02:00
3db186a978
Fix personal desktop crawling HTML warnings
2024-04-10 11:15:25 +02:00
4a5959fd58
Fix personal desktop crawling without favorites
2024-04-10 11:15:25 +02:00
