mirrors/pferd
1
0
Fork 0
mirror of https://github.com/Garmelon/PFERD.git synced 2023-12-21 10:23:01 +01:00
Code Issues Packages Projects Releases Wiki Activity

Fixed minor spelling mistakes

Browse Source
This commit is contained in:
Toorero 2021-10-25 21:34:51 +02:00
parent ad3f4955f7
commit d6f38a61e1
1 changed files with 7 additions and 7 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

4
CONFIG.md
View File

@ -53,7 +53,7 @@ common to all crawlers:
crawler can still be executed manually using the `--crawler` or `-C` flags. crawler can still be executed manually using the `--crawler` or `-C` flags.
(Default: `no`) (Default: `no`)
- `output_dir`: The directory the crawler synchronizes files to. A crawler will - `output_dir`: The directory the crawler synchronizes files to. A crawler will
never place any files outside of this directory. (Default: the crawler's name) never place any files outside this directory. (Default: the crawler's name)
- `redownload`: When to download a file that is already present locally. - `redownload`: When to download a file that is already present locally.
(Default: `never-smart`) (Default: `never-smart`)
- `never`: If a file is present locally, it is not downloaded again. - `never`: If a file is present locally, it is not downloaded again.
@ -138,7 +138,7 @@ crawler simulate a slower, network-based crawler.
### The `kit-ipd` crawler ### The `kit-ipd` crawler
This crawler crals a KIT ipd page by url. The root page can be crawled from This crawler crawls a KIT ipd page by url. The root page can be crawled from
outside the KIT network so you will be informed about any new/deleted files, outside the KIT network so you will be informed about any new/deleted files,
but downloading files requires you to be within. Adding a show delay between but downloading files requires you to be within. Adding a show delay between
requests is likely a good idea. requests is likely a good idea.