ArchiveTeam
/
backfeed
11
0
Fork 0
Code Issues 5 Pull Requests 1 Releases 0 Wiki Activity

Commit Graph

  • *
  • *
  • *
  • *
  • *
  • *
  • *
  • *
  • *
  • *
  • *
  • *
  • *
  • *
  • *
  • *
  • *
  • *
  • *
  • *
  • *
  • | *
  • | *
  • |/
  • *
  • *
  • *
  • *
  • *
  • *
  • *
  • *
  • *
  • *
  • *
  • *
  • *
  • *
  • *
  • *
  • *
  • *
  • *
  • *
  • *
  • c500209 (refs/pull/10/head, custom-queue) Print queue name as well on failing to sadd items. by arkiver 2023-09-01 00:37:57 +0200
  • 23a5028 Make maps in maps before use. by arkiver 2023-09-01 00:35:31 +0200
  • 9f541a1 Support custom queue with queue parameter. Default queue is todo:backfeed. by arkiver 2023-08-31 23:56:13 +0200
  • 3b37b4f (HEAD -> master) fix skipbloom/skipfeed and merge initial item pop into loop logic by Fusl 2023-08-26 21:02:43 +0000
  • e756a64 buffer persistence writes by Fusl 2023-08-25 15:42:11 +0000
  • fece944 forgor to commit structs.go by Fusl 2023-08-25 15:37:27 +0000
  • 0f206f0 allow using backfeed without bloom filters or without feeding by Fusl 2023-08-25 15:27:32 +0000
  • f62e6f8 update modules by Fusl 2023-05-19 05:45:20 +0000
  • 82fb732 don't enter retry loop in case sAddItems is empty by Fusl 2023-05-19 05:43:17 +0000
  • 7c41d85 retry adding items to filter and tracker redis in case of transient failures by Fusl 2023-05-19 05:42:11 +0000
  • 4f08776 delete last_ts info for unlinked keys by Fusl 2023-05-05 19:00:05 +0000
  • c12f098 added redisinfo endpoint by Fusl 2023-04-20 04:31:32 +0000
  • 88c1489 added filter restore endpoint by Fusl 2023-04-19 23:08:37 +0000
  • bf974d9 lets reorganize some of this stuff by Fusl 2023-04-17 23:48:46 +0000
  • fdb0171 slight performance improvement by Fusl 2023-04-17 11:00:34 +0000
  • 1deefc4 fix last access logic by Fusl 2023-04-17 07:41:06 +0000
  • dc25393 early bf.scandump support by Fusl 2023-04-17 07:26:35 +0000
  • 1d6fc0f that was a patch and a half by Fusl 2023-03-18 12:27:14 +0000
  • 5cfe063 support gzip/deflate encoding by Fusl 2023-03-18 12:08:11 +0000
  • 45b2727 trigger ci/cd build at 2023-02-20T06:51:54Z by Fusl 2023-02-20 06:51:54 +0000
  • 0ceeadd access stats by Fusl 2023-02-20 06:47:53 +0000
  • 2f5c6b6 (refs/pull/9/head, backfeed-full-error) Attempt to write items to backfeed_retry set upon error. by arkiver 2023-02-19 14:00:17 +0100
  • 9e01b7d Reinstate 'backfeed channel full' error. by arkiver 2023-02-16 23:07:01 +0100
  • 6f89d42 disable channel overflow early return for now by Fusl 2022-12-05 19:56:47 +0000
  • 1b7cbab update deps by Fusl 2022-10-12 15:40:17 +0000
  • 91ac914 use go 1.19 during docker build by Fusl 2022-10-12 15:39:36 +0000
  • f08b65b entirely get rid of legacy stuff by Fusl 2022-10-12 15:37:21 +0000
  • 705dce8 upgrade to go1.19, remove legacy db, add last touch timestamp, inline some conditions by Fusl 2022-08-05 09:02:17 +0000
  • 65a98d4 reject request if backfeed channel is overloaded by Fusl 2022-05-02 13:18:45 +0000
  • 6d61987 lets increase the redis pool size by Fusl 2022-05-02 10:00:44 +0000
  • d14917c dont close the channel when we're done, avoids lock congestion by Fusl 2022-05-02 09:43:43 +0000
  • 53842ce add prometheus exports for redis by Fusl 2022-05-02 04:28:14 +0000
  • 2fe43ae forgot to initialize the abool struct by Fusl 2022-05-02 04:04:23 +0000
  • b88912c added health check endpoints by Fusl 2022-05-02 04:00:30 +0000
  • 699bb1f added metrics/debug, dont abort item batch on single server failure by Fusl 2022-05-02 01:47:45 +0000
  • 72c6cf3 remove that log line here by Fusl 2022-03-11 16:24:17 +0000
  • 00def81 need to make a []byte of length len(b), not capacity len(b) by Fusl 2022-03-11 16:14:53 +0000
  • c7bebb8 fix item name corruption + use native go-redis type-convert functions by Fusl 2022-03-11 16:04:20 +0000
  • 591252f respond with 200 with additional info instead of 204 by Fusl 2022-03-11 15:21:38 +0000
  • 384fadb simplify RedisConfigDiffers func, fix dedupe against legacy db by Fusl 2022-03-09 17:47:38 +0000
  • f1c0315 ping redis hosts on startup, add build files by Fusl 2022-03-08 22:59:59 +0000
  • f75ce46 add 2nd-stage deduplication using legacy backfeed database by Fusl 2022-03-05 18:08:31 +0000
  • fa467be stats for dupes by Fusl 2022-03-05 17:30:26 +0000
  • 69a851e initial code commit by Fusl 2022-03-05 17:13:45 +0000