42 Commits

Author SHA1 Message Date
045930025c Don't log to file 2026-01-26 08:11:34 +01:00
386cf59523 Refactor all run args to env variables 2026-01-25 12:50:35 +01:00
4d969f1641 Rework main to be an nsq pipeline instead of direct ingest 2026-01-25 12:31:58 +01:00
5e7cdde5b8 Update 2026-01-25 01:25:17 +01:00
0a7d911da9 Remove legacy code 2026-01-24 23:51:51 +01:00
352fcd331e Update 2026-01-24 22:34:57 +01:00
1c94f5f1b8 Wire up the flat killmails to clickhouse 2026-01-24 22:15:43 +01:00
6962be0e53 Fix the god damn url qUeRyEsCaPe 2026-01-24 22:06:56 +01:00
c4e9f85f2b Wire up the new flatten functions 2026-01-24 21:57:20 +01:00
30151a06c7 Rework the query again 2026-01-06 18:38:48 +01:00
65a3cb587b Rehallucinate the API 2026-01-06 18:11:14 +01:00
b5f1d4cf3a Rework the statistics to be calculated on the database 2026-01-06 17:25:28 +01:00
f875df5718 Rename ExpandGroups 2026-01-06 16:05:44 +01:00
fcc1b1807e Update 2026-01-06 15:26:26 +01:00
96440e242b Do some more cleanup 2026-01-06 13:57:09 +01:00
14dfc480aa Redo the cache 2026-01-06 13:40:36 +01:00
04276c8c35 Nuke everything and start reworking with ExpandGroup 2026-01-06 12:03:25 +01:00
3bb919f8d1 Add db tests 2026-01-06 10:57:31 +01:00
41a96258a4 Refactor QueryFits to handle module and group typeID expansion based on presence of modules; update calculateModuleStats to use filtered killmailIDs for improved accuracy. Adjust Dockerfile for better build efficiency. 2026-01-06 00:28:34 +01:00
689a485e1c Print some sort of statistics when running as cli 2026-01-06 00:09:38 +01:00
2249076bcf Update mprocs with frontend and api 2026-01-05 22:12:48 +01:00
b74745f043 Add an API layer for the frontend 2026-01-05 22:06:09 +01:00
8c51f0c721 Implement ship breakdown too 2026-01-05 21:55:48 +01:00
2f0af9f7b1 Add support for module groups 2026-01-05 21:26:08 +01:00
a506dd6e10 Actually make shit work 2026-01-05 21:13:27 +01:00
13b968779b Move flattening logic to flatten killmail in killmail and deduplicate killmails 2026-01-05 20:26:36 +01:00
03a0152541 Fix auth 2026-01-05 19:49:23 +01:00
c9b682ba58 Rehallucinate postgres to clickhouse 2026-01-05 19:49:20 +01:00
decd9e0e51 Add the logs that we unhallucinated 2026-01-05 17:21:54 +01:00
e6d9346ee1 Hallucinate some fit statistics
This is to be the corner stone of our shit
2026-01-05 17:14:55 +01:00
5607c7f3f6 Hallucinate the fits together 2026-01-05 16:53:31 +01:00
2cfbfe67b1 Migrate only when ingesting
Sloooooooowwwwww
2026-01-05 16:30:03 +01:00
03b9b8af1d Implement a skeleton for querying fits and ships 2026-01-05 16:28:50 +01:00
5e6209a8ea Make ingestion conditional 2026-01-05 16:08:30 +01:00
4372d66a5c Print file index and "progress" 2026-01-05 13:01:27 +01:00
fc5149f520 Implement reading all files 2026-01-05 12:20:16 +01:00
8c2f6a9093 Implement saving killmails to database 2026-01-05 12:15:44 +01:00
973ed525cb Add logs and add a sync load killmail function 2026-01-05 12:13:07 +01:00
f614233bd4 Fix up the database 2026-01-05 12:08:49 +01:00
c661bed027 Properly implement reading bz2 files into killmails 2026-01-05 11:57:48 +01:00
b67fcbde3a Hallucinate bz2 extractors 2026-01-05 11:49:53 +01:00
1dcaf2ba04 Initial commit 2026-01-05 11:39:28 +01:00