Philipp Fruck d512fc24c5

split generic ilias crawler and KIT functionality ...

In order to support other universities as well, a generic
IliasWebCrawler using the internal Ilias authentication is created. This
crawler is then extended to add KIT specific functionality like
Shibboleth login.

2023-03-23 17:05:35 +01:00

..

auth

Add pass authenticator

2022-06-05 10:04:42 +02:00

cli

add client_id and base_url to crawler section

2023-03-23 17:04:09 +01:00

crawl

split generic ilias crawler and KIT functionality

2023-03-23 17:05:35 +01:00

__init__.py

Single-source version number

2021-05-14 21:27:44 +02:00

__main__.py

Make PFERD executable via python -m

2022-04-27 22:52:50 +02:00

config.py

Try to detect unsupported config file encoding

2022-04-27 22:03:47 +02:00

deduplicator.py

Use fixed windows path for video cache

2022-01-15 12:00:30 +01:00

limiter.py

Change limiter logic

2021-05-15 15:25:05 +02:00

logging.py

Add forum crawling

2022-05-24 23:43:53 +02:00

output_dir.py

Use utf-8 for report

2022-04-29 23:11:27 +02:00

pferd.py

Collect crawler warnings/errors and include them in the report

2021-11-07 21:48:55 +01:00

report.py

Use utf-8 for report

2022-04-29 23:11:27 +02:00

transformer.py

Error when using multiple segments with -name->

2021-07-01 11:14:50 +02:00

utils.py

Always use '/' as path separator for regex rules

2021-06-04 18:12:45 +02:00

version.py

Bump version to 3.4.3

2022-11-29 18:22:19 +01:00