Miroslav Crnic
75dfd723c0
shuckle: fix ClearCdcInfoReq name
2024-09-17 10:05:46 +00:00
Miroslav Crnic
b2ea95091a
shuckle: support cdc replica moving across hosts
2024-09-16 17:31:47 +01:00
Miroslav Crnic
59fc480e85
shuckle: remove unused requests
2024-09-16 15:21:06 +01:00
Miroslav Crnic
2b738e01c7
shard/cdc: location output in log
2024-09-12 14:06:38 +00:00
Miroslav Crnic
1dc770f15f
shard: format app name to be same as service name
2024-09-12 13:52:31 +00:00
Miroslav Crnic
2dec9ec117
cdc: register location
2024-09-12 14:27:55 +01:00
Miroslav Crnic
f8c4096dc9
shard: register location
2024-09-12 14:27:27 +01:00
Miroslav Crnic
8ac93a4c54
shuckle: add location for all services
2024-09-11 16:59:19 +01:00
Nick Chapman
56b9dc192b
Bump go version 1.18 --> 1.22. ( #335 )
...
The main change here is the updated go version in go.mod and the new
Docker build images which explicitly install go1.22 instead of relying
on the default 1.18 installation.
2024-09-10 17:05:03 +01:00
Miroslav Crnic
76695ec22b
shard: check enough current block services
2024-09-02 16:49:31 +00:00
Miroslav Crnic
35fe242fe3
eggsshard: check shuckle gives services from different fd-s
2024-09-02 16:05:59 +01:00
Miroslav Crnic
9cd425d7f3
eggsblocks/kmod: add file_id to FetchBlockWithCrcReq
2024-08-22 14:11:01 +01:00
Miroslav Crnic
49bd2e6a2a
eggsblocks: conversion as a separate request
2024-08-21 15:39:11 +01:00
Miroslav Crnic
73622ce637
eggsblocks: write/read from new block format with crc after page
2024-08-20 14:55:45 +01:00
Miroslav Crnic
8d3c593022
cdc: acquire target lock for soft unlink dir to avoid race with gc
2024-08-19 13:24:52 +00:00
Miroslav Crnic
204cf5bb8f
eggsdbtools: output log entries from shard/cdc
2024-08-19 13:12:33 +00:00
Francesco Mazzoli
d92265d1ce
Better assertion still
2024-08-15 13:55:28 +00:00
Francesco Mazzoli
2d79d7156f
More informative assertion
2024-08-15 13:44:37 +00:00
Miroslav Crnic
5acdd2c6dc
eggsdbtools: remove fix-name-hash-mismatch as fix deployed
2024-07-29 15:12:44 +00:00
Miroslav Crnic
95a2681121
eggsdbtools: fix nameHash mismatch in edge keys for shard 0
2024-07-29 16:08:28 +01:00
Miroslav Crnic
cf40e318ec
shuckle: support BlockServicesWithFlagChangeReq
2024-07-24 10:08:01 +01:00
Miroslav Crnic
a41a4b7482
shuckle: drop BlockServiceInfoWithoutFlagsLastChanged
2024-07-23 15:40:44 +01:00
Miroslav Crnic
1b258dc422
all: migrate to new BlockServiceInfo
2024-07-23 13:53:07 +01:00
Miroslav Crnic
49723653f8
shuckle: BlockServiceInfo backward compatibility
...
* shuckle: rename BlockServiceInfo to BlockServiceInfoWithoutFlagsLastChanged
* shuckle: handle AllBlockServices
2024-07-23 13:10:57 +01:00
Miroslav Crnic
18ddaaf5ea
shard: stop alerting on possible two migrations at once
2024-07-15 09:39:00 +00:00
Miroslav Crnic
e2bfb15c5f
blockservice: add BlockFetchWithCrc
2024-07-12 14:24:37 +01:00
Miroslav Crnic
3195d39d9d
stats: fully remove everywhere
2024-07-09 15:22:10 +00:00
Miroslav Crnic
c7b6a1cbeb
stats: stop producing them
2024-07-09 15:57:01 +01:00
Francesco Mazzoli
285ffd66c7
Comment
2024-07-02 15:44:22 +00:00
Miroslav Crnic
f3b7ef4d94
eggsgc: destroy decommissioned blocks through shuckle
2024-07-02 09:52:20 +00:00
Miroslav Crnic
99aa882575
gcmigrate: support sharding
2024-06-20 15:30:51 +00:00
Miroslav Crnic
6cf8a01272
core: UDPSocketPair send in a loop to avoid sendmmsg UIO_MAXIOV limit
2024-06-19 17:23:10 +01:00
Miroslav Crnic
78baed62a5
cdc: request checkpoints from shard and push through log
2024-06-13 16:24:22 +01:00
Miroslav Crnic
9e13d6b56e
shard: support checkpointed responses
2024-06-13 15:39:37 +01:00
Miroslav Crnic
9d06deeedc
cdc: error part of shard response
2024-06-13 13:00:43 +01:00
Miroslav Crnic
2cd15fc0be
core: various protocol changes
2024-06-13 09:13:11 +01:00
Miroslav Crnic
7aac745457
shard/cdc: fetch all replicas quickly unless in do not replicate mode
2024-06-12 16:08:29 +00:00
Miroslav Crnic
6eaed4ff0e
core: remove Stopped (unused)
2024-06-12 15:10:58 +00:00
Miroslav Crnic
71ee6568c5
cdc: correctly name logsdb stats
2024-06-10 15:49:44 +00:00
Miroslav Crnic
170f2fbc61
logsdb: add stats and expose in shard/cdc
2024-06-10 16:24:49 +01:00
Miroslav Crnic
ffb5989692
cdc: increase amount of message received to account for LogsDB msgs
2024-06-02 11:22:20 +00:00
Miroslav Crnic
bb47c8f38d
cdc: remove adaptive msg receive
2024-06-02 07:59:16 +00:00
Miroslav Crnic
98d0376fc9
cdc: dont forget requests until they are handed over to LogsDB
2024-05-24 10:16:54 +01:00
Miroslav Crnic
1f145c030e
shard/cdc: support snapshoting
2024-05-23 10:17:59 +01:00
Miroslav Crnic
1446e4d0d2
cdc: force log cleanup after crash
...
Transactional db that CDC uses has a slightly
annoying property that it flushes WAL on transaction
start. As a result release point can get moved and
log records persisted even if we crash.
We want to remove them automatically for now.
2024-05-22 16:58:18 +00:00
Miroslav Crnic
a377536b40
cdc: correctly rewind assumed logIndex
2024-05-22 15:28:15 +00:00
Miroslav Crnic
f11b675807
shuckle: add cdc replicas to page
2024-05-22 11:57:34 +00:00
Miroslav Crnic
4e574374ca
shard/cdc: cleanup logsdb options, hostmon name match service name
2024-05-22 10:21:41 +00:00
Miroslav Crnic
25e8264517
cdc: rewind expected LogIdx on append window full
2024-05-22 09:14:16 +00:00
Miroslav Crnic
b524748210
cdc: use DEFAULT_UDP_MTU for serialization of entries
2024-05-21 14:23:27 +00:00