Julius Rüberg 6b2a657573 Fix IPD crawler for different subpages (#42) ...

This patch reworks the IPD crawler to support subpages which do not use
"/intern" for links and fetches the folder names from table headings.

2021-11-02 01:25:01 +00:00

..

auth

Add 'skip' option to crawlers

2021-06-04 18:47:13 +02:00

cli

Add kit-ipd crawler

2021-10-21 13:20:21 +02:00

crawl

Fix IPD crawler for different subpages (#42)

2021-11-02 01:25:01 +00:00

__init__.py

Single-source version number

2021-05-14 21:27:44 +02:00

__main__.py

Disable interpolation of ConfigParser

2021-10-25 23:37:42 +02:00

config.py

Load credential file from correct path

2021-06-01 09:18:08 +00:00

deduplicator.py

Deduplicate path names in crawler

2021-05-25 12:11:15 +02:00

limiter.py

Change limiter logic

2021-05-15 15:25:05 +02:00

logging.py

Align paths in status messages and progress bars

2021-05-31 12:32:42 +02:00

output_dir.py

Align paths in status messages and progress bars

2021-05-31 12:32:42 +02:00

pferd.py

Add --skip option

2021-07-01 11:02:21 +02:00

report.py

Allow storing crawler-specific data in reports

2021-10-30 18:09:05 +02:00

transformer.py

Error when using multiple segments with -name->

2021-07-01 11:14:50 +02:00

utils.py

Always use '/' as path separator for regex rules

2021-06-04 18:12:45 +02:00

version.py

Bump version to 3.2.0

2021-08-04 18:27:26 +00:00