I-Al-Istannen
ec80e7ba35
Fix KIT shibboleth login
2024-11-05 18:05:23 +01:00
I-Al-Istannen
2b370fc069
Remove iorepeat from ilias authenticate as calling functions will do that
2024-11-05 16:33:27 +01:00
I-Al-Istannen
84ee1b4578
Remove overriden authenticate for kit ilias crawler
2024-11-05 16:33:27 +01:00
I-Al-Istannen
131dc919dc
Call super authenticate method in resolve_link_target
2024-11-05 16:22:14 +01:00
I-Al-Istannen
e86eccec7a
Explain exception message on io repeat
2024-11-05 16:22:14 +01:00
PinieP
a1101e9126
Fix CONFIG.md and change elif to if
2024-11-05 16:22:14 +01:00
PinieP
79bfaa2556
Join URLs with urljoin again
...
The base URL needs a trailing "/", so the part after the first "/" won't
be ignored.
2024-11-05 16:22:14 +01:00
PinieP
998abc3afd
Fix line wrapping
2024-11-05 16:22:13 +01:00
PinieP
27667822eb
Implement switch from ShibbolethLogintype to Literal["shibboleth"]
2024-11-05 16:22:05 +01:00
PinieP
d219dd6337
Clarify docs
2024-11-05 16:22:05 +01:00
PinieP
76460436fe
Update PFERD/crawl/ilias/ilias_web_crawler.py
...
Co-authored-by: I-Al-Istannen <I-Al-Istannen@users.noreply.github.com>
2024-11-05 16:22:05 +01:00
PinieP
115fb02571
Update PFERD/crawl/ilias/ilias_web_crawler.py
...
Co-authored-by: I-Al-Istannen <I-Al-Istannen@users.noreply.github.com>
2024-11-05 16:22:05 +01:00
PinieP
04e5df4bb8
Update PFERD/crawl/ilias/ilias_web_crawler.py
...
Co-authored-by: I-Al-Istannen <I-Al-Istannen@users.noreply.github.com>
2024-11-05 16:22:05 +01:00
PinieP
1d3880f840
Collapse multi-line f-string that gives an error on version <= 3.11
2024-11-05 16:22:04 +01:00
PinieP
7797301288
Update docs and changelog
2024-11-05 16:21:41 +01:00
PinieP
38cd1888c2
Restore KIT URL and remove debug log
2024-11-05 16:21:13 +01:00
PinieP
66f196e582
Formatting and License
2024-11-05 16:21:13 +01:00
PinieP
1f417ec87d
Add shibboleth config option for non KIT
...
Co-authored-by: MrPine <git@mr-pine.de>
2024-11-05 16:21:11 +01:00
PinieP
d27640b3f2
abstract shibboleth login for non KIT
...
Co-authored-by: Mr-Pine <git@mr-pine.de>
2024-11-05 16:20:27 +01:00
Tim
5983200247
Treat headings as folders in kit-ipd crawler ( #99 )
2024-11-04 23:53:48 +01:00
Tim
26e802d88b
Add clickable links to file names in the printed report ( #100 )
...
Co-authored-by: I-Al-Istannen <i-al-istannen@users.noreply.github.com>
2024-11-04 00:32:32 +01:00
I-Al-Istannen
f5c4e82816
Delay ilias loop detection after transform
...
This allows users to filter out duplicated elements and suppress the
warning.
2024-11-02 22:46:51 +01:00
I-Al-Istannen
f5273f7ca0
Collapse ilias url crawling into normal page crawling
2024-11-02 22:46:51 +01:00
I-Al-Istannen
fa71a9f44f
Add support for mob videos in page descriptions
2024-10-28 20:35:30 +01:00
I-Al-Istannen
81d6ff53c4
Respect row flex in descriptions
2024-10-28 19:41:03 +01:00
I-Al-Istannen
d7a2b6e019
Delete videos from course descriptions
2024-10-28 19:41:03 +01:00
I-Al-Istannen
71c65e89d1
Internalize images in course descriptions
2024-10-28 19:41:03 +01:00
I-Al-Istannen
c1046498e7
Fix download of links without a target URL
...
They are now downloaded as links to the empty url.
2024-10-28 19:41:03 +01:00
I-Al-Istannen
8fbd1978af
Fix crawling of nested courses
2024-10-28 18:52:27 +01:00
Tim
739dd95850
Use Last-Modified and ETag headers to determine KIT-IPD file versions ( #95 )
...
Co-authored-by: I-Al-Istannen <i-al-istannen@users.noreply.github.com>
2024-10-27 19:03:47 +01:00
I-Al-Istannen
c54c3bcfa1
Fix crawling of favorites
2024-10-27 10:50:59 +01:00
I-Al-Istannen
d7f2229978
Bump version to 3.6.0
2024-10-23 20:17:47 +02:00
I-Al-Istannen
52fdeae752
Crawl custom item groups as folders
2024-10-21 23:43:48 +02:00
I-Al-Istannen
f9bb2e41cf
Sanitize slashes in exercise container names
2024-10-21 22:30:16 +02:00
Mr. Pine
4f9e2ab48d
Support named capture groups in regex transformers ( #94 )
2024-10-21 15:21:33 +02:00
I-Al-Istannen
19beb8f07b
Document course overview downloading in config.md
2024-07-31 22:02:43 +02:00
I-Al-Istannen
c897d9e2f5
Support finding entries for course overview page
...
Related to issue #93
2024-06-26 16:54:07 +02:00
21a266e302
Update upload-artifact action to v4
...
https://github.com/actions/upload-artifact/blob/main/docs/MIGRATION.md#multiple-uploads-to-the-same-named-artifact
2024-05-11 16:33:14 +02:00
Pavel Zwerschke
b29b6f93f8
run ci twice
...
Co-authored-by: Garmelon <joscha@plugh.de>
2024-05-11 16:09:46 +02:00
Pavel Zwerschke
318226d7cb
fix bump-version script
2024-05-11 10:27:54 +02:00
Pavel Zwerschke
422cf05f15
Move all configuration into pyproject.toml, add x86 mac to CI
2024-05-11 10:26:19 +02:00
819c6673c7
Update changelog
2024-05-10 14:40:25 +02:00
89b44c69a7
Update docs
...
All config file options must be documented in CONFIG.md. The README.md
is just a starting point. To avoid duplicated info, I've moved most of
the docs to CONFIG.md.
2024-05-10 14:36:01 +02:00
4b4f72b2ca
Fix command name
2024-05-10 14:34:20 +02:00
778517d8c6
Fix KIT crawler requiring base_url and client_id options
2024-05-10 14:12:45 +02:00
428b0179fc
Remove IliasConfig
...
Also uses urljoin() in a few places that previously used string
concatenation or fstrings.
At this point, there isn't yet a need for IliasConfig, so I'd rather
keep the code base simpler and more consistent. Should we need a
structure like IliasConfig in the future (maybe because we have a few
more ilias parsers), it's easy to add back.
2024-05-10 14:09:14 +02:00
Philipp Fruck
ade6309dd9
Update copyright information
2024-05-05 02:34:26 +02:00
Philipp Fruck
fd6cb7b966
docs: Remove some filler words
2024-05-05 02:34:00 +02:00
Philipp Fruck
5c87517ceb
docs: Explain usage with generic ilias
2024-05-04 17:52:12 +02:00
Philipp Fruck
b01f093474
fix: Element detection for other universities
...
Other universities might use other URL schemes
for different element types
2024-05-04 17:52:06 +02:00