Commit graph

  • a0b348785a
    Merge afe5819388 into e246053de2 Niklas 2026-01-21 00:54:46 +00:00
  • 0dbf9e27f4
    Merge 6dae86df7d into e246053de2 MisterPine 2026-01-08 23:36:52 +00:00
  • cb0a05333a
    Merge 555c8ac341 into e246053de2 Florian Raith 2026-01-08 06:27:46 +00:00
  • 4eab927899 Save stacktraces in context manager and print on error debug/async-crash I-Al-Istannen 2025-12-09 17:01:24 +01:00
  • e246053de2 Crawl the info tab of courses again master I-Al-Istannen 2025-12-02 16:33:04 +01:00
  • 555c8ac341 Merge remote-tracking branch 'origin' into language-translator-crawler Florian Raith 2025-11-11 14:37:51 +01:00
  • afe5819388 Merge branch 'simpleSAML-integration' of https://github.com/NIKL45/PFERD-FAU into simpleSAML-integration NIKL45 2025-11-03 21:29:13 +01:00
  • 5ba56f71c9 added simple-saml to documentation, added name to LICENSE NIKL45 2025-11-03 21:28:57 +01:00
  • 31758e7cfb checked and formatted NIKL45 2025-11-03 21:28:57 +01:00
  • 40715d648b fixed and tested TFA (OTP) for FAU NIKL45 2025-11-03 21:28:57 +01:00
  • 31d2c86a05 impemented SimpleSAMLLogin option into the IliasWebCrawler NIKL45 2025-11-03 21:28:57 +01:00
  • e59a9dbf2d created class SimpleSAMLLogin by duplicating the class ShibbolethLogin and making the two changes mentioned in Garmelon/PFERD/issues/126. TFA not tested yet. NIKL45 2025-11-03 21:28:57 +01:00
  • 8f7748dc11 Merge commit '6353571eb4' NIKL45 2025-11-03 21:27:43 +01:00
  • c21a9f080d Revert to commit 207af51aa4. Discard testing in master branch (moved to branch"quickNdirty-SAML"). NIKL45 2025-11-03 21:24:27 +01:00
  • 3f5637366e Sanitize / in kit-ipd heading hierarchy I-Al-Istannen 2025-10-30 20:19:30 +01:00
  • 3453bbc991 Add basic auth to KIT-IPD crawler I-Al-Istannen 2025-10-29 13:02:18 +01:00
  • bd7b384e8f Manually set event loop on windows I-Al-Istannen 2025-10-27 12:43:51 +01:00
  • b10b75d56b added simple-saml to documentation, added name to LICENSE NIKL45 2025-10-24 22:18:31 +02:00
  • 2509711d62 checked and formatted NIKL45 2025-10-24 21:59:51 +02:00
  • afbfea6ba5 fixed and tested TFA (OTP) for FAU NIKL45 2025-10-24 21:46:45 +02:00
  • 8d37f42ce8 impemented SimpleSAMLLogin option into the IliasWebCrawler NIKL45 2025-10-24 21:26:06 +02:00
  • 77c6e7d816 created class SimpleSAMLLogin by duplicating the class ShibbolethLogin and making the two changes mentioned in Garmelon/PFERD/issues/126. TFA not tested yet. NIKL45 2025-10-24 21:25:07 +02:00
  • 6353571eb4 Added Ilias configuration for HHU Duesseldorf to Congig file randomNumber101 2025-10-18 17:46:37 +02:00
  • 1e56976b9f Update nix flake.lock I-Al-Istannen 2025-10-19 16:31:16 +02:00
  • bb0d68da65 Switch to pyright I-Al-Istannen 2025-10-19 16:28:41 +02:00
  • c1c78673aa Switch to uv I-Al-Istannen 2025-10-19 16:17:13 +02:00
  • ebcfb2a2f3 Fix some typing errors I-Al-Istannen 2025-10-19 15:59:08 +02:00
  • 5646e933fd Ignore reformat in git blame I-Al-Istannen 2025-10-19 15:46:04 +02:00
  • 6e563134b2 Fix ruff errors I-Al-Istannen 2025-10-19 15:25:40 +02:00
  • 2cf0e060ed Reformat and switch to ruff I-Al-Istannen 2025-10-19 15:19:43 +02:00
  • ee4625be78 Hardcode max line length in scripts/check I-Al-Istannen 2025-10-19 15:08:29 +02:00
  • f6c713d621 Fix mypy errors I-Al-Istannen 2025-10-19 15:08:21 +02:00
  • ac7bf13656 adapted shibboleth login for FAU (slightly different POST url and payload) NIKL45 2025-10-19 00:21:53 +02:00
  • 2c22794c69 removed TFA shibboleth because cant be tested for FAU by me NIKL45 2025-10-19 00:18:53 +02:00
  • e9eebe0fa9 gitignore NIKL45 2025-10-18 23:44:11 +02:00
  • 4301dda48f duplicated files for integration of FAU login NIKL45 2025-10-18 23:43:57 +02:00
  • 229949bbf3 Added Ilias configuration for HHU Duesseldorf to Congig file randomNumber101 2025-10-18 17:46:37 +02:00
  • 207af51aa4 Include description in internet-shortcut links I-Al-Istannen 2025-07-27 20:13:05 +02:00
  • 3755f593ff Update nix flake to 25.05 I-Al-Istannen 2025-07-01 14:33:11 +02:00
  • 465f8b28c0 Bump version to 3.8.3 v3.8.3 latest I-Al-Istannen 2025-07-01 14:28:30 +02:00
  • 27e69af2f3 Update changelog for 8caad00 I-Al-Istannen 2025-07-01 14:26:10 +02:00
  • ef1cc0eca1 Add Language Translator Cralwer Florian Raith 2025-06-15 01:39:21 +02:00
  • 6dae86df7d
    Don't recursively walk local-only dirs with NO_DELETE Mr-Pine 2025-06-08 12:36:21 +02:00
  • 56e3065950
    Document usage of pilot.ilias.studium.kit.edu (#111) Christian Schliz 2025-05-30 17:13:45 +02:00
  • 549ce6cce9
    Ignore unavailable elements (#119) Mr. Pine 2025-05-28 17:04:57 +02:00
  • f510a5b94b
    Explain when ignoring elements Mr-Pine 2025-05-28 16:53:42 +02:00
  • b6b94c3d34
    Ignore unavailable elements Mr-Pine 2025-05-28 11:47:39 +02:00
  • 34564cedb4 Add support for link collections I-Al-Istannen 2025-05-26 15:59:25 +02:00
  • 2b0d20a1f6 Fix crawling of exercises with instructions I-Al-Istannen 2025-04-29 18:30:33 +02:00
  • f0e56a8e12 Dump html after login failure debug/dump-html-in-login I-Al-Istannen 2025-05-09 11:37:34 +02:00
  • 8caad0008d
    Fix check for nonexistent ilias_url command attribute to base_url (#113) PinieP 2025-05-05 22:05:54 +02:00
  • 57e94f35ca Fix check for nonexistent ilias_url command attribute to base_url PinieP 2025-05-05 21:11:06 +02:00
  • dd2fedf1a2 Fix crawling of exercises with instructions fix/exercises-with-instructions I-Al-Istannen 2025-04-29 18:30:33 +02:00
  • 77a23265a9 Bump version to 3.8.2 v3.8.2 I-Al-Istannen 2025-04-29 17:55:57 +02:00
  • 4c230ef6dd Fix exercise crawling I-Al-Istannen 2025-04-25 13:45:57 +02:00
  • b305e1ce23 Fix login using the native ilias login form Nikolas Heise 2025-04-22 13:30:32 +02:00
  • bdf17f5c87 Ignore wikis I-Al-Istannen 2025-04-23 16:03:37 +02:00
  • b6b77b6aa7
    Document usage of pilot.ilias.studium.kit.edu Christian Schliz 2025-04-22 17:08:48 +02:00
  • 77fce7daf8 Bump version to 3.8.1 v3.8.1 I-Al-Istannen 2025-04-17 11:22:35 +02:00
  • 653bf139f0 Fix encoding of descriptions and force images to light mode I-Al-Istannen 2025-04-16 10:45:06 +02:00
  • 3f60638d33 Bump version to 3.8.0 I-Al-Istannen 2025-04-16 00:47:05 +02:00
  • b97b6fae6b Update minimum Python version to 3.11 I-Al-Istannen 2025-04-14 21:13:25 +02:00
  • 477234ad0d Support ILIAS 9 I-Al-Istannen 2025-04-12 14:54:58 +02:00
  • 7291382430 Bump version to 3.8.0 v3.8.0 I-Al-Istannen 2025-04-15 11:32:22 +02:00
  • 1a430ad5d1 Update minimum Python version to 3.11 I-Al-Istannen 2025-04-14 21:13:25 +02:00
  • f6bdeb6b9d Support ILIAS 9 I-Al-Istannen 2025-04-12 14:54:58 +02:00
  • 117efa4f40 Update LICENSE file compilebreak 2025-04-09 14:23:48 +02:00
  • 6a441a169e WIP: Ilias9: Fix warning "Didn't find identity" compilebreak 2025-04-09 13:58:09 +02:00
  • 9bc6ab7f93 Ilias9: Fix invalid course id compilebreak 2025-04-09 13:48:45 +02:00
  • 53065fe74e
    Merge 1a93a4a8a5 into 63f25277b0 Pavel Zwerschke 2025-04-06 10:31:16 +00:00
  • 63f25277b0 Fix crawling of empty forum threads I-Al-Istannen 2025-03-09 23:44:25 +01:00
  • c8eff04ae0 Make thread titles link to original ILIAS thread I-Al-Istannen 2025-02-19 14:56:32 +01:00
  • edc482cdf4 Internalize images in forum threads I-Al-Istannen 2025-02-19 14:45:18 +01:00
  • 72cd0f77e2 Prettify forum thread exports I-Al-Istannen 2025-02-19 14:29:37 +01:00
  • be175f9347 Download only new/updated forum threads I-Al-Istannen 2025-02-19 14:18:43 +01:00
  • ba2833dba5 Crawl all threads in a forum I-Al-Istannen 2025-02-19 12:07:19 +01:00
  • 2f0e792670 Increase default http timeout to 30 I-Al-Istannen 2025-02-19 12:06:07 +01:00
  • 5f88539f7e Fix page size increase for forum threads I-Al-Istannen 2025-02-19 12:05:20 +01:00
  • bd9d7efe64 "Fix" mypy errors I-Al-Istannen 2025-02-12 22:41:43 +01:00
  • 16a2dd5b15 fix: totp Aurelia 2025-02-12 21:48:05 +01:00
  • 678283d341 Use Python facilities to convert paths to file:// urls I-Al-Istannen 2024-11-14 20:06:13 +01:00
  • 4af02012bc Strip long path prefix from file links in report debug/windows-links I-Al-Istannen 2024-11-14 20:06:13 +01:00
  • 1a93a4a8a5
    Add additional project metadata Pavel Zwerschke 2024-11-13 22:53:36 +01:00
  • 287173b0b1 Bump version to 3.7.0 v3.7.0 I-Al-Istannen 2024-11-13 20:38:27 +01:00
  • 712217e959 Handle groups in cards I-Al-Istannen 2024-11-11 12:52:55 +01:00
  • 6dda4c55a8 Add doctype header to forum threads I-Al-Istannen 2024-11-05 18:36:21 +01:00
  • 596b6a7688
    Add support for non-KIT shibboleth login (#98) PinieP 2024-11-05 18:30:34 +01:00
  • 5c4051d600 Cross request site forgery is an unsolved problem I-Al-Istannen 2024-11-05 18:10:48 +01:00
  • ec80e7ba35 Fix KIT shibboleth login I-Al-Istannen 2024-11-05 16:36:04 +01:00
  • 2b370fc069 Remove iorepeat from ilias authenticate as calling functions will do that I-Al-Istannen 2024-11-05 16:10:23 +01:00
  • 84ee1b4578 Remove overriden authenticate for kit ilias crawler I-Al-Istannen 2024-11-05 16:09:35 +01:00
  • 131dc919dc Call super authenticate method in resolve_link_target I-Al-Istannen 2024-11-05 16:06:34 +01:00
  • e86eccec7a Explain exception message on io repeat I-Al-Istannen 2024-11-05 16:05:58 +01:00
  • a1101e9126 Fix CONFIG.md and change elif to if PinieP 2024-11-05 00:01:15 +01:00
  • 79bfaa2556 Join URLs with urljoin again PinieP 2024-11-02 22:30:06 +01:00
  • 998abc3afd Fix line wrapping PinieP 2024-11-02 21:54:57 +01:00
  • 27667822eb Implement switch from ShibbolethLogintype to Literal["shibboleth"] PinieP 2024-11-02 21:32:46 +01:00
  • d219dd6337 Clarify docs PinieP 2024-11-02 21:15:07 +01:00
  • 76460436fe Update PFERD/crawl/ilias/ilias_web_crawler.py PinieP 2024-11-02 20:26:29 +01:00
  • 115fb02571 Update PFERD/crawl/ilias/ilias_web_crawler.py PinieP 2024-11-02 20:26:15 +01:00