mirror of
https://github.com/Garmelon/PFERD.git
synced 2023-12-21 10:23:01 +01:00
Document possible redownload settings
This commit is contained in:
parent
e7a51decb0
commit
a8dcf941b9
@ -41,6 +41,15 @@ crawlers:
|
|||||||
- `type`: The types are specified in [this section](#crawler-types).
|
- `type`: The types are specified in [this section](#crawler-types).
|
||||||
- `output_dir`: The directory the crawler synchronizes files to. A crawler will
|
- `output_dir`: The directory the crawler synchronizes files to. A crawler will
|
||||||
never place any files outside of this directory. (Default: crawler's name)
|
never place any files outside of this directory. (Default: crawler's name)
|
||||||
|
- `redownload`: When to download again a file that is already present locally.
|
||||||
|
(Default: `never-smart`)
|
||||||
|
- `never`: If a file is present locally, it is not downloaded again.
|
||||||
|
- `never-smart`: Like `never`, but PFERD tries to detect if an already
|
||||||
|
downloaded files has changed via some (unreliable) heuristics.
|
||||||
|
- `always`: All files are always downloaded, regardless of whether they are
|
||||||
|
already present locally.
|
||||||
|
- `always-smart`: Like `always`, but PFERD tries to avoid unnecessary
|
||||||
|
downloads via some (unreliable) heuristics.
|
||||||
- `transform`: Rules for renaming and excluding certain files and directories.
|
- `transform`: Rules for renaming and excluding certain files and directories.
|
||||||
For more details, see [this section](#transformation-rules). (Default: empty)
|
For more details, see [this section](#transformation-rules). (Default: empty)
|
||||||
|
|
||||||
|
Loading…
Reference in New Issue
Block a user