Added alias functionality

This commit is contained in:
Julius Rüberg 2021-11-02 03:42:08 +01:00
parent d6f38a61e1
commit 9e12e96d90
2 changed files with 23 additions and 5 deletions

View file

@ -86,6 +86,9 @@ common to all crawlers:
load for the crawl target. (Default: `0.0`)
- `windows_paths`: Whether PFERD should find alternative names for paths that
are invalid on Windows. (Default: `yes` on Windows, `no` otherwise)
- `alias`: List of strings that are considered as an alias when invoking with
the `--crawler` or `-C` flag. If there is more then one crawl section with
the same alias all are selected. Thereby you can group different crawlers.
Some crawlers may also require credentials for authentication. To configure how
the crawler obtains its credentials, the `auth` option is used. It is set to the
@ -100,6 +103,7 @@ username = foo
password = bar
[crawl:something]
alias = [sth, some]
type = some-complex-crawler
auth = auth:example
on_conflict = no-delete