e41a22149e
Add default show-not-deleted option
...
If set to `no`, PFERD won't print status or report messages for not deleted files
2023-08-26 17:13:45 +02:00
46fb782798
Add forum crawling
...
This downloads all forum posts when needed and saves each thread in its
own html file, named after the thread title.
2022-05-24 23:43:53 +02:00
da72863b47
Placate newer mypy
2022-04-03 13:19:08 +02:00
4bf0c972e6
Update types for rich 11
2022-01-09 11:48:26 +01:00
64a2960751
Align paths in status messages and progress bars
...
Also print "Ignored" when paths are ignored due to transforms
2021-05-31 12:32:42 +02:00
17879a7f69
Print box around message for unexpected exceptions
2021-05-31 12:05:49 +02:00
27b5a8e490
Rename log.action to log.status
2021-05-23 22:40:33 +02:00
ce1dbda5b4
Overhaul colours
...
"Crawled" and "Downloaded" are now printed less bright than "Crawling" and
"Downloading" as they're not as important. Explain topics are printed in yellow
to stand out a bit more from the cyan action messages.
2021-05-23 21:33:04 +02:00
463f8830d7
Add warn_contd
2021-05-23 18:14:54 +02:00
7e0bb06259
Clean up TODOs
2021-05-23 12:47:30 +02:00
803e5628a2
Clean up logging
...
Paths are now (hopefully) logged consistently across all crawlers
2021-05-23 11:37:19 +02:00
afac22c562
Handle abort in exclusive output state correctly
...
If the event loop is stopped while something holds the exclusive output, the
"log" singleton is now reset so the main thread can print a few more messages
before exiting.
2021-05-22 18:58:19 +02:00
dfde0e2310
Improve reporting of unexpected exceptions
2021-05-22 18:36:25 +02:00
54dd2f8337
Clean up main and improve error handling
2021-05-22 16:47:24 +02:00
3300886120
Explain config file loading
2021-05-19 18:11:43 +02:00
0d10752b5a
Configure explain log level via cli and config file
2021-05-19 17:50:10 +02:00
4b68fa771f
Move logging logic to singleton
...
- Renamed module and class because "conductor" didn't make a lot of sense
- Used singleton approach (there's only one stdout after all)
- Redesigned progress bars (now with download speed!)
2021-05-18 22:45:19 +02:00
a673ab0fae
Delete old files
...
I should've done this earlier
2021-05-14 21:27:44 +02:00
c978e9edf4
Resolve a few pylint warnings
2020-12-30 14:45:46 +01:00
d9ea688145
Use pretty logger for summaries
2020-06-26 17:24:36 +02:00
6c034209b6
Add deleted files to summary
2020-06-25 22:00:28 +02:00
f6faacabb0
Move FatalException to errors.py
2020-05-09 00:11:21 +02:00
2d20d2934c
Color warning differently
2020-05-08 19:52:45 +02:00
2c48ab66d4
Use rich for log colorization
2020-05-08 19:31:54 +02:00
920d521d68
Change PrettyLogger.warn to PrettyLogger.warning
2020-04-25 20:11:51 +02:00
e0b46a306a
Use warn method in IliasCrawler
2020-04-25 20:07:40 +02:00
8a42a2a396
Move logging into its own file
2020-04-25 20:02:01 +02:00
