Commit Graph

46 Commits

Author SHA1 Message Date
a506dd6e10 Actually make shit work 2026-01-05 21:13:27 +01:00
d25a30c5cb Add systemstats like modulestats 2026-01-05 20:47:02 +01:00
e31965e428 Fix fat ass query 2026-01-05 20:43:45 +01:00
13b968779b Move flattening logic to flatten killmail in killmail and deduplicate killmails 2026-01-05 20:26:36 +01:00
98b8f58fbb Fix some fucking ints 2026-01-05 20:20:11 +01:00
cbee688bfa Host clickhouse on linux
Doesn't work on windows something something fs permissions something
something linux api
Whatever. Works on linux
2026-01-05 20:12:37 +01:00
03a0152541 Fix auth 2026-01-05 19:49:23 +01:00
c9b682ba58 Rehallucinate postgres to clickhouse 2026-01-05 19:49:20 +01:00
dab88ffa9e Migrate models to sqlite 2026-01-05 19:29:42 +01:00
f1de97a51e Add flatkillmail for clickhouse 2026-01-05 19:29:42 +01:00
3a33e4caad Migrate from postgres to clickhouse 2026-01-05 19:29:42 +01:00
96c3fc1c3c Add indices to queried columns 2026-01-05 17:34:47 +01:00
decd9e0e51 Add the logs that we unhallucinated 2026-01-05 17:21:54 +01:00
e6d9346ee1 Hallucinate some fit statistics
This is to be the corner stone of our shit
2026-01-05 17:14:55 +01:00
5607c7f3f6 Hallucinate the fits together 2026-01-05 16:53:31 +01:00
016a473619 Figure out how modules are read 2026-01-05 16:45:50 +01:00
205f6851aa Utilize gorm for the query 2026-01-05 16:42:15 +01:00
5dac8523d0 Implement fetching items for killmail victims 2026-01-05 16:35:25 +01:00
2cfbfe67b1 Migrate only when ingesting
Sloooooooowwwwww
2026-01-05 16:30:03 +01:00
03b9b8af1d Implement a skeleton for querying fits and ships 2026-01-05 16:28:50 +01:00
b50b04b3d8 Fix weird bug in model 2026-01-05 16:26:41 +01:00
f5cdbd5b10 Update models 2026-01-05 16:18:18 +01:00
9d9ddcbb99 Undo models
We have to redo them hold on...
2026-01-05 16:17:54 +01:00
5e6209a8ea Make ingestion conditional 2026-01-05 16:08:30 +01:00
81124ec477 Dump models 2026-01-05 13:01:30 +01:00
2c5f678427 dbgate depends on db 2026-01-05 13:01:27 +01:00
4372d66a5c Print file index and "progress" 2026-01-05 13:01:27 +01:00
457912cbec Add model dump instructions and mprocs 2026-01-05 13:01:27 +01:00
be23944060 Fix types
oopsie, no shishkebabs :(
2026-01-05 12:51:56 +01:00
b2ae6ae39b oops, use zkill instead of postgres 2026-01-05 12:37:02 +01:00
53c865b261 Update db.go to use postgres instead of sqlite 2026-01-05 12:36:03 +01:00
aa0519e73b Add dbgate to compose 2026-01-05 12:36:03 +01:00
7c1cae042f Add mprocs config 2026-01-05 12:36:03 +01:00
b540b7924f Migrate to postgres from sqlite 2026-01-05 12:33:44 +01:00
595759466a Ignore some common trash 2026-01-05 12:27:19 +01:00
fc5149f520 Implement reading all files 2026-01-05 12:20:16 +01:00
30dfeef9ce Ignore conflicts 2026-01-05 12:17:17 +01:00
8c2f6a9093 Implement saving killmails to database 2026-01-05 12:15:44 +01:00
973ed525cb Add logs and add a sync load killmail function 2026-01-05 12:13:07 +01:00
f614233bd4 Fix up the database 2026-01-05 12:08:49 +01:00
b89ed99c24 Add gorm tags to types 2026-01-05 12:08:46 +01:00
6afe42c014 Add a simple readme 2026-01-05 11:57:48 +01:00
c661bed027 Properly implement reading bz2 files into killmails 2026-01-05 11:57:48 +01:00
b67fcbde3a Hallucinate bz2 extractors 2026-01-05 11:49:53 +01:00
d7cf03fdbd Add killmail type from json 2026-01-05 11:49:20 +01:00
1dcaf2ba04 Initial commit 2026-01-05 11:39:28 +01:00