mirrors/pferd
1
0
Fork 0
mirror of https://github.com/Garmelon/PFERD.git synced 2025-11-04 22:52:44 +01:00
Code Issues Packages Projects Releases Wiki Activity

Add basic auth to KIT-IPD crawler

Browse Source
This commit is contained in:
I-Al-Istannen
2025-10-29 13:02:18 +01:00
parent bd7b384e8f
commit 3453bbc991
5 changed files with 39 additions and 3 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
CONFIG.md
View File

@@ -153,6 +153,7 @@ requests is likely a good idea.
- `link_regex`: A regex that is matched against the `href` part of links. If it
matches, the given link is downloaded as a file. This is used to extract
files from KIT-IPD pages. (Default: `^.*?[^/]+\.(pdf|zip|c|cpp|java)$`)
- `auth`: Name of auth section to use for basic authentication. (Optional)
### The `ilias-web` crawler