Commit Graph

Select branches

Hide Pull Requests

another-rework

master

v1.2.0

Mono Color

• 0da1fe064b Add some indices and hacks to the ddl v1.2.0 another-rework PhatPhuckDave 2026-01-27 11:41:56 +01:00
• ad0c84d640 Handle unknown items PhatPhuckDave 2026-01-27 09:25:52 +01:00
• ec8a61713f Fix the 100% entirely hallucinated topic depth calls PhatPhuckDave 2026-01-26 15:57:21 +01:00
• 8ae287f09e Make DB transient PhatPhuckDave 2026-01-26 15:45:42 +01:00
• e51efb4289 Run local database PhatPhuckDave 2026-01-26 15:44:17 +01:00
• 3c6f296927 Add user to ddl PhatPhuckDave 2026-01-26 15:33:56 +01:00
• b5aa63928a Increase the backoff PhatPhuckDave 2026-01-26 14:53:12 +01:00
• c9abd3936c Refactor NConsumers to nsq.go PhatPhuckDave 2026-01-26 14:39:19 +01:00
• 1fbe478378 Handle 404 and 400 with names PhatPhuckDave 2026-01-26 14:36:29 +01:00
• adde43563e Add db polling to readers PhatPhuckDave 2026-01-26 14:30:38 +01:00
• 61d2d14fb8 Implement name and solar system resolvers as well PhatPhuckDave 2026-01-26 14:20:25 +01:00
• 02baec430c Start touching messages PhatPhuckDave 2026-01-26 14:02:40 +01:00
• e2ff432d57 Update NSQ configuration and improve error handling in resolvers PhatPhuckDave 2026-01-26 13:52:12 +01:00
• d1c0a6ace0 Run multiple consumers for resolvers PhatPhuckDave 2026-01-26 13:44:41 +01:00
• d9cfceaceb Resolve all the other type information PhatPhuckDave 2026-01-26 13:41:58 +01:00
• fb57616d0d Refactor all the constants to lnsq PhatPhuckDave 2026-01-26 13:36:28 +01:00
• 0f926a139c Fix reading int32s for some readers PhatPhuckDave 2026-01-26 13:29:15 +01:00
• dc0796a547 Rename all the readers to MSB PhatPhuckDave 2026-01-26 13:26:13 +01:00
• d765c0335a Refactor reader and resolver to a generic interface PhatPhuckDave 2026-01-26 13:19:44 +01:00
• f42fb81594 Remove polling, again PhatPhuckDave 2026-01-26 12:59:19 +01:00
• 5968f0a8bf Great use of json you clanker... PhatPhuckDave 2026-01-26 12:58:04 +01:00
• 3cdf4036b2 lol... "completed"... PhatPhuckDave 2026-01-26 12:55:49 +01:00
• 7b2a63b55c Don't poll clickhouse PhatPhuckDave 2026-01-26 12:53:25 +01:00
• f8ea0232b5 Remove the fucking signals that, again, nobody ever asked for PhatPhuckDave 2026-01-26 12:51:11 +01:00
• 6a87a8bcda Ditch the memo for now PhatPhuckDave 2026-01-26 12:47:39 +01:00
• 8ab2a69654 FUCK OFF with the json and remove batching from resolver PhatPhuckDave 2026-01-26 12:40:33 +01:00
• 3db461a80a Update PhatPhuckDave 2026-01-26 12:32:21 +01:00
• 201f24a429 Print stats on nsq consumer PhatPhuckDave 2026-01-26 12:30:45 +01:00
• 43a49c4dbd Add character name readers PhatPhuckDave 2026-01-26 12:22:28 +01:00
• 61a0c835b0 Fix the db pathing PhatPhuckDave 2026-01-26 12:20:05 +01:00
• 5b015620c1 Implement item type resolver step PhatPhuckDave 2026-01-26 12:11:40 +01:00
• 004c273958 Rip clickhouse out of db.go PhatPhuckDave 2026-01-26 12:07:11 +01:00
• 424d2b9213 cLiEnT WAHBG JUSAGHEJWBFDRIOUASnaefhsbgktw jvskfgaehji bsšućaf PhatPhuckDave 2026-01-26 12:05:03 +01:00
• 794f0b0d04 Let go of fucking nsqlookupd PhatPhuckDave 2026-01-26 11:57:39 +01:00
• b6b7b9ec56 Fix the god damn fucking nsq containers PhatPhuckDave 2026-01-26 11:53:31 +01:00
• ecdb41217e Add item type reader PhatPhuckDave 2026-01-26 11:51:29 +01:00
• de5bffe9b1 Refactor nsq and clickhouse clients to their individual packages PhatPhuckDave 2026-01-26 11:51:25 +01:00
• 2448f76c1e Refactor connecting to nsq to separate package PhatPhuckDave 2026-01-26 11:41:15 +01:00
• caa1d97617 Refactor connecting to nsq PhatPhuckDave 2026-01-26 11:37:57 +01:00
• 233c67ff00 Implement stage2 - write into clickhouse PhatPhuckDave 2026-01-26 11:05:15 +01:00
• 0dfae49f94 Add a simple clickhouse client PhatPhuckDave 2026-01-26 10:26:47 +01:00
• 2b79c51837 Have stage1 flatten after reading PhatPhuckDave 2026-01-26 09:42:57 +01:00
• 1bc05dc81d Make pipelines programs on their own PhatPhuckDave 2026-01-26 09:40:44 +01:00
• e2e1ebe48f Hallucinate some wires PhatPhuckDave 2026-01-26 09:35:12 +01:00
• dfdd74f52e Hallucinate stage 1 disk reader PhatPhuckDave 2026-01-26 09:32:11 +01:00
• 725d6b8ee3 Move shit around to separate packages PhatPhuckDave 2026-01-26 09:26:53 +01:00
• 600fc0d7ff Rework the types to separate package PhatPhuckDave 2026-01-26 09:24:39 +01:00
• 045930025c Don't log to file master PhatPhuckDave 2026-01-26 08:11:34 +01:00
• 5b5e5ddf6b Duplicate inserter 8 times PhatPhuckDave 2026-01-25 19:56:45 +01:00
• c1c0291c2d Bigger nsq messages PhatPhuckDave 2026-01-25 18:26:18 +01:00
• 783284e3f5 Remove entirely gRaCeFuL eXiT PhatPhuckDave 2026-01-25 18:20:11 +01:00
• 342b0be467 Parallelize and memoize esi name lookup PhatPhuckDave 2026-01-25 15:38:12 +01:00
• 99f5899fbe Pause consumer on rate limit PhatPhuckDave 2026-01-25 14:46:35 +01:00
• 1dfed10c77 Remove the clickhouse port that we weren't previously using and was added just to break everything PhatPhuckDave 2026-01-25 14:15:02 +01:00
• ef42e1f52d Insert to prod clickhouse PhatPhuckDave 2026-01-25 14:09:07 +01:00
• 34fe95a911 Fix up the logs to not be as spammy PhatPhuckDave 2026-01-25 14:05:01 +01:00
• 6ce1758672 Memoize database functions to reduce disk reads PhatPhuckDave 2026-01-25 14:02:45 +01:00
• 2a6b903b58 Fix more god damn nsq garbage PhatPhuckDave 2026-01-25 13:47:18 +01:00
• 6bba290cd4 Get rid of broken nsq batching PhatPhuckDave 2026-01-25 13:34:54 +01:00
• ac67045ded Use 127.0.0.1 PhatPhuckDave 2026-01-25 13:31:28 +01:00
• 25e8c3335a Batch insert to nsq PhatPhuckDave 2026-01-25 12:58:01 +01:00
• c0dd32e90e Run nsq locally PhatPhuckDave 2026-01-25 12:50:33 +01:00
• 386cf59523 Refactor all run args to env variables PhatPhuckDave 2026-01-25 12:35:00 +01:00
• 4d969f1641 Rework main to be an nsq pipeline instead of direct ingest PhatPhuckDave 2026-01-25 12:31:58 +01:00
• e7f14278be Remove more legacy shit PhatPhuckDave 2026-01-25 12:19:27 +01:00
• 322aa8ab81 Add a docker compose PhatPhuckDave 2026-01-25 12:17:26 +01:00
• cd5716b7f0 Add a build script PhatPhuckDave 2026-01-25 12:08:56 +01:00
• 98fff24d94 Update PhatPhuckDave 2026-01-25 03:33:42 +01:00
• d16c3471cf Update PhatPhuckDave 2026-01-25 03:18:11 +01:00
• 5e79f1db1b Fix finding modules in cargo PhatPhuckDave 2026-01-25 03:06:17 +01:00
• 734a90ba7e Fix date strings PhatPhuckDave 2026-01-25 02:57:01 +01:00
• e3af9cd15b Implement an endpoint for fetching complete entire killmails PhatPhuckDave 2026-01-25 02:51:29 +01:00
• d5048bae89 Add a simple killmail fetch api PhatPhuckDave 2026-01-25 02:32:43 +01:00
• b2b06c93bb Update PhatPhuckDave 2026-01-25 02:26:35 +01:00
• 5a9ab78070 Use ids instead of names in the wheres PhatPhuckDave 2026-01-25 01:46:17 +01:00
• 36dbe79cc5 Proxy images PhatPhuckDave 2026-01-25 01:46:09 +01:00
• 5e7cdde5b8 Update PhatPhuckDave 2026-01-25 01:23:58 +01:00
• 22a76ff8ec Return ids with analytics PhatPhuckDave 2026-01-25 01:20:41 +01:00
• 0a7d911da9 Remove legacy code PhatPhuckDave 2026-01-24 23:43:40 +01:00
• 7afd388c54 Hallucinate a system name handler PhatPhuckDave 2026-01-24 23:42:26 +01:00
• b8826d37e8 Aggregate the statistics in api PhatPhuckDave 2026-01-24 23:35:21 +01:00
• 058db2a6e2 Fix some fucking stupid type issues PhatPhuckDave 2026-01-24 23:25:45 +01:00
• 6eb0cad899 Remove legacy code PhatPhuckDave 2026-01-24 23:18:26 +01:00
• ae02ded7e6 Remove limits that nobody ever asked for PhatPhuckDave 2026-01-24 23:13:05 +01:00
• e87f476b43 Wire up the API with the new methods PhatPhuckDave 2026-01-24 23:09:57 +01:00
• 18b176d812 Hallucinate some analytics tests PhatPhuckDave 2026-01-24 22:57:57 +01:00
• 1b3e3471b0 Hallucinate a read API PhatPhuckDave 2026-01-24 22:51:11 +01:00
• aa71fd73af Actually handle errors instead of ignoring them PhatPhuckDave 2026-01-24 22:44:03 +01:00
• 38e07aef1f Streamline error handling for character, corporation, and alliance name fetching by removing unnecessary error checks and simplifying logging. Update to return "unknown" for failed requests instead of empty strings. PhatPhuckDave 2026-01-24 22:38:04 +01:00
• 352fcd331e Update PhatPhuckDave 2026-01-24 22:34:57 +01:00
• 3bd88528ed Refactor some shit around PhatPhuckDave 2026-01-24 22:31:35 +01:00
• a3471013ae Deretardify some of the error handling PhatPhuckDave 2026-01-24 22:30:29 +01:00
• 5e205ffb51 Use CachedRequest instead of LimitedHTTP PhatPhuckDave 2026-01-24 22:27:39 +01:00
• 20a936ce0e Print some timings for all the api calls PhatPhuckDave 2026-01-24 22:25:25 +01:00
• a36a924d6f Make the fucking client global PhatPhuckDave 2026-01-24 22:20:57 +01:00
• 10a842b1a7 Make the damn cache global PhatPhuckDave 2026-01-24 22:16:32 +01:00
• f3c74318c1 Remove some retarded logs PhatPhuckDave 2026-01-24 22:15:47 +01:00
• 1c94f5f1b8 Wire up the flat killmails to clickhouse PhatPhuckDave 2026-01-24 22:12:00 +01:00
• 6962be0e53 Fix the god damn url qUeRyEsCaPe PhatPhuckDave 2026-01-24 22:06:56 +01:00
• c4e9f85f2b Wire up the new flatten functions PhatPhuckDave 2026-01-24 21:57:20 +01:00