Commit Graph

403 Commits

Author SHA1 Message Date
Miroslav Crnic
75dfd723c0 shuckle: fix ClearCdcInfoReq name 2024-09-17 10:05:46 +00:00
Miroslav Crnic
b2ea95091a shuckle: support cdc replica moving across hosts 2024-09-16 17:31:47 +01:00
Miroslav Crnic
59fc480e85 shuckle: remove unused requests 2024-09-16 15:21:06 +01:00
Miroslav Crnic
2b738e01c7 shard/cdc: location output in log 2024-09-12 14:06:38 +00:00
Miroslav Crnic
1dc770f15f shard: format app name to be same as service name 2024-09-12 13:52:31 +00:00
Miroslav Crnic
2dec9ec117 cdc: register location 2024-09-12 14:27:55 +01:00
Miroslav Crnic
f8c4096dc9 shard: register location 2024-09-12 14:27:27 +01:00
Miroslav Crnic
8ac93a4c54 shuckle: add location for all services 2024-09-11 16:59:19 +01:00
Nick Chapman
56b9dc192b Bump go version 1.18 --> 1.22. (#335)
The main change here is the updated go version in go.mod and the new
Docker build images which explicitly install go1.22 instead of relying
on the default 1.18 installation.
2024-09-10 17:05:03 +01:00
Miroslav Crnic
76695ec22b shard: check enough current block services 2024-09-02 16:49:31 +00:00
Miroslav Crnic
35fe242fe3 eggsshard: check shuckle gives services from different fd-s 2024-09-02 16:05:59 +01:00
Miroslav Crnic
9cd425d7f3 eggsblocks/kmod: add file_id to FetchBlockWithCrcReq 2024-08-22 14:11:01 +01:00
Miroslav Crnic
49bd2e6a2a eggsblocks: conversion as a separate request 2024-08-21 15:39:11 +01:00
Miroslav Crnic
73622ce637 eggsblocks: write/read from new block format with crc after page 2024-08-20 14:55:45 +01:00
Miroslav Crnic
8d3c593022 cdc: acquire target lock for soft unlink dir to avoid race with gc 2024-08-19 13:24:52 +00:00
Miroslav Crnic
204cf5bb8f eggsdbtools: output log entries from shard/cdc 2024-08-19 13:12:33 +00:00
Francesco Mazzoli
d92265d1ce Better assertion still 2024-08-15 13:55:28 +00:00
Francesco Mazzoli
2d79d7156f More informative assertion 2024-08-15 13:44:37 +00:00
Miroslav Crnic
5acdd2c6dc eggsdbtools: remove fix-name-hash-mismatch as fix deployed 2024-07-29 15:12:44 +00:00
Miroslav Crnic
95a2681121 eggsdbtools: fix nameHash mismatch in edge keys for shard 0 2024-07-29 16:08:28 +01:00
Miroslav Crnic
cf40e318ec shuckle: support BlockServicesWithFlagChangeReq 2024-07-24 10:08:01 +01:00
Miroslav Crnic
a41a4b7482 shuckle: drop BlockServiceInfoWithoutFlagsLastChanged 2024-07-23 15:40:44 +01:00
Miroslav Crnic
1b258dc422 all: migrate to new BlockServiceInfo 2024-07-23 13:53:07 +01:00
Miroslav Crnic
49723653f8 shuckle: BlockServiceInfo backward compatibility
* shuckle: rename BlockServiceInfo to BlockServiceInfoWithoutFlagsLastChanged

* shuckle: handle AllBlockServices
2024-07-23 13:10:57 +01:00
Miroslav Crnic
18ddaaf5ea shard: stop alerting on possible two migrations at once 2024-07-15 09:39:00 +00:00
Miroslav Crnic
e2bfb15c5f blockservice: add BlockFetchWithCrc 2024-07-12 14:24:37 +01:00
Miroslav Crnic
3195d39d9d stats: fully remove everywhere 2024-07-09 15:22:10 +00:00
Miroslav Crnic
c7b6a1cbeb stats: stop producing them 2024-07-09 15:57:01 +01:00
Francesco Mazzoli
285ffd66c7 Comment 2024-07-02 15:44:22 +00:00
Miroslav Crnic
f3b7ef4d94 eggsgc: destroy decommissioned blocks through shuckle 2024-07-02 09:52:20 +00:00
Miroslav Crnic
99aa882575 gcmigrate: support sharding 2024-06-20 15:30:51 +00:00
Miroslav Crnic
6cf8a01272 core: UDPSocketPair send in a loop to avoid sendmmsg UIO_MAXIOV limit 2024-06-19 17:23:10 +01:00
Miroslav Crnic
78baed62a5 cdc: request checkpoints from shard and push through log 2024-06-13 16:24:22 +01:00
Miroslav Crnic
9e13d6b56e shard: support checkpointed responses 2024-06-13 15:39:37 +01:00
Miroslav Crnic
9d06deeedc cdc: error part of shard response 2024-06-13 13:00:43 +01:00
Miroslav Crnic
2cd15fc0be core: various protocol changes 2024-06-13 09:13:11 +01:00
Miroslav Crnic
7aac745457 shard/cdc: fetch all replicas quickly unless in do not replicate mode 2024-06-12 16:08:29 +00:00
Miroslav Crnic
6eaed4ff0e core: remove Stopped (unused) 2024-06-12 15:10:58 +00:00
Miroslav Crnic
71ee6568c5 cdc: correctly name logsdb stats 2024-06-10 15:49:44 +00:00
Miroslav Crnic
170f2fbc61 logsdb: add stats and expose in shard/cdc 2024-06-10 16:24:49 +01:00
Miroslav Crnic
ffb5989692 cdc: increase amount of message received to account for LogsDB msgs 2024-06-02 11:22:20 +00:00
Miroslav Crnic
bb47c8f38d cdc: remove adaptive msg receive 2024-06-02 07:59:16 +00:00
Miroslav Crnic
98d0376fc9 cdc: dont forget requests until they are handed over to LogsDB 2024-05-24 10:16:54 +01:00
Miroslav Crnic
1f145c030e shard/cdc: support snapshoting 2024-05-23 10:17:59 +01:00
Miroslav Crnic
1446e4d0d2 cdc: force log cleanup after crash
Transactional db that CDC uses has a slightly
annoying property that it flushes WAL on transaction
start. As a result release point can get moved and
log records persisted even if we crash.
We want to remove them automatically for now.
2024-05-22 16:58:18 +00:00
Miroslav Crnic
a377536b40 cdc: correctly rewind assumed logIndex 2024-05-22 15:28:15 +00:00
Miroslav Crnic
f11b675807 shuckle: add cdc replicas to page 2024-05-22 11:57:34 +00:00
Miroslav Crnic
4e574374ca shard/cdc: cleanup logsdb options, hostmon name match service name 2024-05-22 10:21:41 +00:00
Miroslav Crnic
25e8264517 cdc: rewind expected LogIdx on append window full 2024-05-22 09:14:16 +00:00
Miroslav Crnic
b524748210 cdc: use DEFAULT_UDP_MTU for serialization of entries 2024-05-21 14:23:27 +00:00