Commit graph

8 commits

Author SHA1 Message Date
bce3dc384d Deduplicate path names in crawler
Also rename files so they follow the restrictions for windows file names if
we're on windows.
2021-05-25 12:11:15 +02:00
6ca0ecdf05 Load and store reports 2021-05-23 20:46:29 +02:00
b4d97cd545 Improve output dir and report error handling 2021-05-22 20:54:42 +02:00
989032fe0c Fix cookies getting deleted 2021-05-15 22:25:48 +02:00
d565df27b3 Add HttpCrawler 2021-05-13 22:28:14 +02:00
60cd9873bc Add local file crawler 2021-05-06 01:02:40 +02:00
bbfdadc463 Implement output directory 2021-05-05 18:08:34 +02:00
07e831218e Add sync report 2021-05-02 00:56:10 +02:00