From a8dcf941b94d8f474f2606a92d1caf57ccb61665 Mon Sep 17 00:00:00 2001 From: Joscha Date: Fri, 30 Apr 2021 15:32:56 +0200 Subject: [PATCH] Document possible redownload settings --- CONFIG.md | 9 +++++++++ 1 file changed, 9 insertions(+) diff --git a/CONFIG.md b/CONFIG.md index 05f3363..a004dc3 100644 --- a/CONFIG.md +++ b/CONFIG.md @@ -41,6 +41,15 @@ crawlers: - `type`: The types are specified in [this section](#crawler-types). - `output_dir`: The directory the crawler synchronizes files to. A crawler will never place any files outside of this directory. (Default: crawler's name) +- `redownload`: When to download again a file that is already present locally. + (Default: `never-smart`) + - `never`: If a file is present locally, it is not downloaded again. + - `never-smart`: Like `never`, but PFERD tries to detect if an already + downloaded files has changed via some (unreliable) heuristics. + - `always`: All files are always downloaded, regardless of whether they are + already present locally. + - `always-smart`: Like `always`, but PFERD tries to avoid unnecessary + downloads via some (unreliable) heuristics. - `transform`: Rules for renaming and excluding certain files and directories. For more details, see [this section](#transformation-rules). (Default: empty)