Commit graph

Select branches

Hide pull requests

master

old-filter-stuff

Mono Color

• d85b61d419 Add some old files old-filter-stuff Joscha 2025-08-28 18:55:37 +02:00
• ee66509dd8 Remove now-obsolete Counter master Joscha 2025-01-03 02:43:40 +01:00
• d9fd29c1c3 Add progress bars to ingest command Joscha 2025-01-01 15:59:39 +01:00
• 8016bbfc83 Port and rename pg command Joscha 2025-01-01 00:59:03 +01:00
• b2a8597c6f Add longest-path command Joscha 2024-12-31 19:54:43 +01:00
• 3045d6d6c6 Improve link degree formatting Joscha 2024-12-31 18:33:50 +01:00
• 698b6590d1 Remove unused method Joscha 2024-12-31 18:27:18 +01:00
• cdf9a7d7ae Compute article rankings by link degrees Joscha 2024-12-31 18:26:12 +01:00
• 5b8feb6368 Add general stats command Joscha 2024-12-31 17:38:27 +01:00
• 76efd6d728 Add redirects command Joscha 2024-12-31 17:14:21 +01:00
• e90864a097 Add -I and -c cli options Joscha 2024-12-31 16:41:19 +01:00
• 04482f9f2f Detect redirect cycles Joscha 2024-12-31 16:40:55 +01:00
• 1f20e0519a Fix off-by-one in consistency check Joscha 2024-12-31 16:40:42 +01:00
• 6611dd3160 Add --bidi flag to path command Joscha 2024-12-31 15:51:58 +01:00
• 535d7ff236 Add export command Joscha 2024-12-31 15:38:03 +01:00
• c573f1b0b0 Allow transforming graph before commands Joscha 2024-12-31 15:30:11 +01:00
• ab7b7295ca Remove unused code Joscha 2024-12-31 15:13:17 +01:00
• 693ae9eb81 Show more info and optionally links Joscha 2024-12-31 15:13:11 +01:00
• ceb987bbbc Add show command Joscha 2024-12-31 14:48:59 +01:00
• aa4187fcd8 Group pages, links, and graph in Data struct Joscha 2024-12-31 12:16:34 +01:00
• 0168373509 Move dijkstra to new file Joscha 2024-12-31 11:26:32 +01:00
• 6ca20c9740 Remove some old code Joscha 2024-12-31 11:20:09 +01:00
• 4e41084f2a Port path command Joscha 2024-12-31 02:48:28 +01:00
• abd6b3519c Get rid of rustc_hash Joscha 2024-12-31 02:48:07 +01:00
• e04215802e Speed up ingest using rustc_hash Joscha 2024-12-31 02:37:15 +01:00
• eb631250d7 Fix ingest logic yet again Joscha 2024-12-31 02:18:39 +01:00
• a3d0136ad2 Fix ingest logic and panics Joscha 2024-12-31 01:34:25 +01:00
• 3aa8222b6b Rewrite ingest command Joscha 2024-12-31 00:48:24 +01:00
• f819f5bf69 Remove adjlist-based path implementation Joscha 2024-12-30 19:34:33 +01:00
• 18e54c4ce1 Implement new graph data structure and dijkstra Joscha 2024-12-30 18:19:20 +01:00
• 778cb6748d Remove petgraph Joscha 2024-12-30 16:00:09 +01:00
• 34df6c9f14 Try out petgraph Joscha 2024-12-30 13:12:49 +01:00
• e3e191b748 Improve philosophy game trace output Joscha 2024-12-30 13:12:25 +01:00
• 49665f74ce List links to and from an article Joscha 2024-12-30 13:12:14 +01:00
• f5f4f99a2f Update dependencies Joscha 2024-12-29 23:28:55 +01:00
• c2c1b1234c Change link data with page info Joscha 2024-12-29 23:22:02 +01:00
• 7af2a4e06f Print nicer sift stats Joscha 2024-12-29 20:48:52 +01:00
• 27416cf782 Add philosophy-game trace command Joscha 2024-08-26 19:42:47 +02:00
• a12f79d864 Extract cluster ends in more easy-to-use way Joscha 2024-08-26 11:50:06 +02:00
• 9c73e691a8 Add more philosophy game subcommands Joscha 2024-08-26 11:32:34 +02:00
• ed611d0841 Add philosophy-game command Joscha 2024-08-26 01:29:45 +02:00
• 8642778402 Fix in_structure some more Joscha 2024-08-26 01:03:38 +02:00
• e85e17634f Speed up sift using multiprocessing Joscha 2024-08-26 01:03:26 +02:00
• 72a4c11b85 Fix in_structure not being computed correctly Joscha 2024-08-25 23:25:05 +02:00
• 159f155e4a Add option to filter links on reexport Joscha 2024-08-25 22:54:49 +02:00
• 76abf5ea6e Remove PageIdx and LinkIdx again Joscha 2024-08-25 22:45:20 +02:00
• 17b118693f Add PageIdx::MAX Joscha 2024-08-25 22:04:55 +02:00
• 7a2372fedd Refactor data representation and storage Joscha 2024-08-25 21:40:11 +02:00
• 0eb745e928 Remove leon wiki graph command Joscha 2024-08-25 20:32:06 +02:00
• c612bd35ad Satisfy clippy Joscha 2024-08-25 20:30:48 +02:00
• 4bdfc34706 Support new info in brood Joscha 2024-08-25 20:27:49 +02:00
• c075e43e2d Extract additional link info Joscha 2024-08-25 17:23:31 +02:00
• 32ce86682c Switch from simd-json back to serde_json Joscha 2024-06-27 21:51:29 +02:00
• 7a52c818fb Remove unused ciborium dependency Joscha 2024-06-27 21:45:02 +02:00
• ae83abe67e Update dependencies Joscha 2024-06-27 21:30:23 +02:00
• 8605f8d43f Implement leon-wiki-graph command Joscha 2022-11-01 01:22:15 +01:00
• 60ba7721db Add longest-shortest-path command Joscha 2022-10-23 01:14:38 +02:00
• 1265dd4a41 Move some functions to util Joscha 2022-10-23 01:14:31 +02:00
• a7b9849183 Add --flip flag to path command Joscha 2022-10-22 20:46:26 +02:00
• d5f55d2855 Print more stuff Joscha 2022-10-22 19:58:19 +02:00
• 8bb94b1847 Allow redirects to have 0 links Joscha 2022-10-22 19:54:08 +02:00
• 2e6539cbc5 Fix redirect importing Joscha 2022-10-22 19:38:35 +02:00
• e91a2db1b1 Allow specifying redirects as path start and end Joscha 2022-10-22 19:30:44 +02:00
• 0e3d61d632 Add list-pages command Joscha 2022-10-22 19:24:58 +02:00
• c40153be9f Try out different costs Joscha 2022-10-22 19:14:16 +02:00
• d99b3d49e0 Refactor changing data Joscha 2022-10-22 19:14:03 +02:00
• 32b72c10c8 Assign redirects a cost of 0 Joscha 2022-10-22 18:46:55 +02:00
• d1a80a6ae6 Print redirects differently Joscha 2022-10-22 18:41:47 +02:00
• 0d4087fdde Detect if no path exists Joscha 2022-10-22 18:41:40 +02:00
• 179e6b74a5 Implement simple dijkstra Joscha 2022-10-22 17:12:35 +02:00
• 8b62ff78bd Prepare dijkstra in path command Joscha 2022-10-22 16:23:35 +02:00
• 67f405a21e Make data representation more flexible Joscha 2022-10-22 15:52:07 +02:00
• 49b27715f0 Print duplicate page map entries Joscha 2022-10-22 15:40:45 +02:00
• 786b180b09 Add imhex patterns Joscha 2022-10-22 01:03:16 +02:00
• 853e09517f Add unfinished path command Joscha 2022-10-22 01:02:33 +02:00
• 345462915b Change AdjacencyMap associated data Joscha 2022-10-22 01:02:22 +02:00
• 5656f65b6c Refactor ingestion Joscha 2022-10-22 01:01:49 +02:00
• 3296f6d15a Fix page link_idx computation Joscha 2022-10-22 00:01:58 +02:00
• a9435e4f64 Lowercase only first char when normalizing Joscha 2022-10-22 00:01:04 +02:00
• 3a75089e5a Make adjacency list extensible Joscha 2022-10-21 20:39:53 +02:00
• 78aa27c019 Add more checks Joscha 2022-10-21 19:53:15 +02:00
• 23463522f0 Don't print escape characters directly Joscha 2022-10-04 21:47:43 +02:00
• f71092058b Refactor export and add page length Joscha 2022-10-03 22:14:58 +02:00
• d910047b48 Perform consistency check when reexporting Joscha 2022-10-03 18:11:37 +02:00
• e74eee89e6 Add reexport command Joscha 2022-10-03 18:07:30 +02:00
• 266f001d46 Move commands to own module Joscha 2022-10-03 18:04:24 +02:00
• 969fd01914 Export links to custom binary format Joscha 2022-10-03 18:01:15 +02:00
• 0e0789cc4d Ingest new json format Joscha 2022-10-03 17:35:11 +02:00
• 78a5aa5169 Ignore all namespaces except 0 Joscha 2022-10-03 16:26:08 +02:00
• ecdeb4086a Make json format more consistent Joscha 2022-10-03 15:00:23 +02:00
• 51096c99e1 Make stored data more compact Joscha 2022-10-01 01:46:42 +02:00
• f6bcb39c52 Import data and check consistency Joscha 2022-09-30 19:53:41 +02:00
• 1ea09a9be9 Export data to CBOR Joscha 2022-09-30 19:49:54 +02:00
• 499642cda9 Convert first stage data into proper adjacency list Joscha 2022-09-30 19:30:47 +02:00
• 11c4ff699f Try out faster hash algorithm Joscha 2022-09-30 19:02:57 +02:00
• 5e8589f73e Load input into adjacency-list-like structure Joscha 2022-09-30 18:53:56 +02:00
• b1f2af9577 Use simd-json Joscha 2022-09-30 18:07:50 +02:00
• c195fbb8d4 Load sift data from stdin Joscha 2022-09-30 18:06:42 +02:00
• 2e2045a74d Set up brood subproject Joscha 2022-09-30 16:01:09 +02:00
• d29e7257ba Include namespace in info Joscha 2022-09-30 02:17:06 +02:00