Commit graph

313 commits

Author SHA1 Message Date
be7a
c800d307db
Add warning about event-loop in ILIASCrawler 2021-04-29 00:02:03 +02:00
be7a
3eab236b99
update sync_url.py and fix event_loop housekeeping 2021-04-28 23:58:21 +02:00
be7a
2d6be9f5c1
run autopep8 and fix formatting 2021-04-28 23:09:38 +02:00
be7a
1d3e169ead
merge upstream 2021-04-28 01:53:42 +02:00
be7a
c0ba8b9528
Use shared ILIASCrawler 2021-04-28 01:52:56 +02:00
be7a
e3a13143bc
Use shared ILIASCrawler 2021-04-28 01:50:28 +02:00
be7a
54a446c43c
await authentication in ilias crawler 2021-04-24 16:21:48 +02:00
be7a
ad730f5259
fix another bad search and replace 2021-04-24 00:05:22 +02:00
be7a
4f966c5ee2
fix incorrect httpx vs requests replace 2021-04-23 22:56:45 +02:00
be7a
07218e6cab
remove false help text and fix httpx auth 2021-04-23 22:07:30 +02:00
be7a
411d4b91d5
use the async client to crawl illias 2021-04-23 21:43:52 +02:00
be7a
44aeb6c2eb
transition from requests to httpx 2021-04-23 18:12:19 +02:00
I-Al-Istannen
c1ab7485e2 Bump version to 2.6.1 2021-04-19 11:21:56 +02:00
I-Al-Istannen
29cd5d1a3c Reflect totality of sanitize_windows_path in return type 2021-04-19 11:10:02 +02:00
I-Al-Istannen
6d5d9333ad Force folder to be file-system path 2021-04-19 11:07:25 +02:00
I-Al-Istannen
7cc40595dc Allow synchronizing to directory "." 2021-04-14 20:25:25 +02:00
I-Al-Istannen
80ae5ddfaa Bump version to v2.6.0 2021-04-14 19:47:41 +02:00
I-Al-Istannen
4f480d117e Install keyring in CI 2021-04-14 19:24:05 +02:00
I-Al-Istannen
1f2af3a290 Retry on more I/O Errors 2021-04-13 11:43:22 +02:00
I-Al-Istannen
14cdfb6a69 Fix typo in date demangler doc 2021-04-13 11:19:51 +02:00
I-Al-Istannen
e2bf84392b [sync_url] Properly declare "no-videos" as flag 2021-04-08 18:12:27 +02:00
I-Al-Istannen
946b7a7931 Also crawl .c/.java/.zip from IPD page 2021-02-09 12:30:59 +01:00
I-Al-Istannen
9a9018751e Bump version 2021-02-06 22:54:05 +01:00
I-Al-Istannen
83b75e8254 syncurl: Sanitize element name on windows if it is used as folder name
Otherwise the name of the course might not be a invalid file name.
2021-02-06 22:53:26 +01:00
Toorero
35c3fa205d
Fixed description of activating venv (#22)
Add 'source' to the venv activate command in the readme

`source` was picked over `.` to conform to the python recommendation
(https://docs.python.org/3/library/venv.html#module-venv).

This patch also adds the `egg-info` you get when building to the
gitignore.
2021-01-28 21:24:09 +01:00
I-Al-Istannen
0b606f02fa Bump version 2021-01-17 10:33:10 +01:00
I-Al-Istannen
fb78a6e98e Retry ILIAS downloads a few times and only fail that file 2021-01-06 13:08:10 +01:00
I-Al-Istannen
5de68a0400 Bump version 2020-12-30 17:20:30 +01:00
I-Al-Istannen
f0562049b6 Remove Python 3.9 method in crawler 2020-12-30 17:18:04 +01:00
I-Al-Istannen
0e1077bb50 Bump version 2020-12-30 14:50:49 +01:00
I-Al-Istannen
c978e9edf4 Resolve a few pylint warnings 2020-12-30 14:45:46 +01:00
I-Al-Istannen
2714ac6be6 Send CSRF token to Shibboleth 2020-12-30 14:34:11 +01:00
I-Al-Istannen
9b048a9cfc Canonize meeting names to a properly formatted date 2020-12-30 14:32:59 +01:00
I-Al-Istannen
1c2b6bf994 Bump version 2020-12-13 19:57:29 +01:00
I-Al-Istannen
ee39aaf08b Fix merge marker in LICENSE 2020-12-07 22:55:28 +01:00
I-Al-Istannen
93e6329901 Use the least destructive conflict resolver if there are multiple 2020-12-06 13:28:08 +01:00
I-Al-Istannen
f47b137b59 Fix ILIAS init.py and Pferd.py authenticators 2020-12-06 13:15:32 +01:00
Scriptim
83ea15ee83 Use system keyring service for password auth 2020-12-06 13:15:30 +01:00
I-Al-Istannen
75471c46d1 Use credential file 2020-12-05 23:44:09 +01:00
Lucas
1e0343bba6 sync_url: Add username and password args 2020-12-05 23:30:09 +01:00
I-Al-Istannen
0f5e55648b Tell user when the conflict resolver kept existing files 2020-12-05 14:12:45 +01:00
I-Al-Istannen
57259e21f4 Print download summary in sync_url 2020-12-05 14:09:09 +01:00
I-Al-Istannen
4ce385b262 Treat file overwrite and marked file overwrite differently 2020-12-05 14:03:43 +01:00
I-Al-Istannen
2d64409542 Fix handling of empty args.folder 2020-12-05 13:50:46 +01:00
I-Al-Istannen
fcb3884a8f Add --remote-first, --local-first and --no-delete flags 2020-12-05 13:49:05 +01:00
I-Al-Istannen
9f6dc56a7b Use a strategy to decide conflict resolution 2020-12-02 19:32:57 +01:00
I-Al-Istannen
56ab473611
Merge pull request #17 from TheChristophe/master
Add flag to make sync_url use defaults instead of prompting
2020-12-02 19:04:46 +01:00
Christophe
6426060804 Fix relative paths bug
Introduced in 74ea039458
2020-12-02 18:40:45 +01:00
Christophe
49a0ca7a7c Add myself to LICENSE
This should've been done back when I added a PR for adding sync_url but people are lazy smh.
2020-12-02 18:24:07 +01:00
Christophe
f3a4663491 Add passive/no_prompt flag 2020-12-02 18:24:07 +01:00