Commit Graph

25868 Commits

Author SHA1 Message Date
Aaron Son
160b434dbd go: sqle/auto_gc: Some PR feedback. 2025-02-24 14:45:41 -08:00
reltuk
7f1e9dd3dd [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh 2025-02-23 19:55:06 +00:00
Aaron Son
df991698ec go: sqle/auto_gc: Add some simple tests for controller and hook. 2025-02-23 11:46:12 -08:00
Aaron Son
36b39dfc25 Merge remote-tracking branch 'origin/main' into aaron/autogc 2025-02-22 15:27:49 -08:00
Aaron Son
837ae43d35 integration-tests/go-sql-server-driver: auto_gc_test.go: Bring down amount of garbage produced by replication test to improve speed. 2025-02-22 06:34:22 -08:00
Aaron Son
c1b1b8b60d Merge pull request #8880 from dolthub/aaron/dolt-releases-macos-sdk-version
go: publishrelease: buildpgobinaries.sh: Manually specify the SDK version of our toolchain so it shows up in our release binaries.
2025-02-21 17:16:29 -08:00
Aaron Son
4ce49e6a24 go: store/nbs: store.go: Fix GetManyCompressed to not redeliver chunks on waitForGC retry. 2025-02-21 17:14:53 -08:00
Aaron Son
fd79008176 go: publishrelease: buildpgobinaries.sh: Manually specify the SDK version of our toolchain so it shows up in our release binaries. 2025-02-21 12:37:06 -08:00
Aaron Son
e4a4b5dadb go: store,remotesrv: Improve logging. Improve gRPC error statuses for certain errros that arise after a GC. 2025-02-21 11:31:23 -08:00
coffeegoddd
cd1ed7276b [ga-bump-release] Update Dolt version to 1.49.3 and release v1.49.3 v1.49.3 2025-02-21 19:07:30 +00:00
Dustin Brown
5fad9beeb6 [ga-bump-dep] Bump dependency in Dolt by max-hoffman (#8877)
Co-authored-by: max-hoffman <maximilian.wolfgang1@gmail.com>
2025-02-21 10:33:25 -08:00
Aaron Son
97fd0f8112 Merge remote-tracking branch 'origin/main' into aaron/autogc 2025-02-21 08:41:59 -08:00
Aaron Son
89fce6e919 Merge pull request #8861 from dolthub/aaron/remotestorage-cache-cleanup
[no-release-notes] go: remotestorage: chunk_store.go: Clean up ChunkCache.
2025-02-21 08:41:48 -08:00
Aaron Son
efb5edca30 go: sqle: auto_gc: Move to a background thread which periodically checks, plus gets triggered by a commit hook.
This helps handle the stanbdy replica case, where commits come in through
remotesrv directly into the ChunkStore, and not through the datas.Database.
2025-02-21 08:41:03 -08:00
Aaron Son
143893303b integration-tests: go-sql-server-driver: auto_gc_test: Add a skipped test for auto-gc occurring on a standby replica. 2025-02-20 16:15:21 -08:00
Neil Macneale IV
ed5eaaf407 Merge pull request #8872 from dolthub/macneale4/backups-table
Add the dolt_backups table
2025-02-20 11:25:54 -08:00
Aaron Son
d586d2a84c go: remotestorage: chunk cache: PR feedback. 2025-02-20 10:13:15 -08:00
Neil Macneale IV
389f4a95c3 Make tests resilient to windows file paths 2025-02-20 10:02:19 -08:00
Neil Macneale IV
7a04165354 Test updates for new system table 2025-02-20 09:30:10 -08:00
macneale4
0cc8177cef [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh 2025-02-20 00:30:29 +00:00
Aaron Son
7dadc7ceed go: remotestorage: PR feedback on ChunkCache. 2025-02-19 15:13:26 -08:00
Aaron Son
69630e1007 go: auto_gc: Add a heuristic which allows followers in cluster replication to also auto-gc. 2025-02-19 15:07:07 -08:00
Aaron Son
20f38cae6f Merge remote-tracking branch 'origin/main' into aaron/autogc 2025-02-19 13:30:33 -08:00
Neil Macneale IV
0401281800 Add the backups_table
Read only table which only lists the name and url of backups created
by the dolt_backups procedure
2025-02-19 11:23:37 -08:00
coffeegoddd
f9a5d44353 [ga-bump-release] Update Dolt version to 1.49.2 and release v1.49.2 v1.49.2 2025-02-17 20:37:56 +00:00
Dustin Brown
a4a5a75f1d [ga-bump-dep] Bump dependency in Dolt by max-hoffman (#8867)
Co-authored-by: max-hoffman <maximilian.wolfgang1@gmail.com>
2025-02-17 11:52:57 -08:00
Taylor Bantle
872b69e2af Merge pull request #8860 from dolthub/taylor/restore-perms
Add pointer for checking super user perms for backup restore for doltgres
2025-02-17 10:07:30 -06:00
Jason Fulghum
2ab63f2318 Merge pull request #8864 from dolthub/fulghum-dc03db8b
[auto-bump] [no-release-notes] dependency by fulghum
2025-02-16 14:53:24 -08:00
fulghum
6e19bfaf45 [ga-bump-dep] Bump dependency in Dolt by fulghum 2025-02-14 23:10:11 +00:00
Aaron Son
1e20b67c42 Merge remote-tracking branch 'origin/main' into aaron/autogc 2025-02-14 13:46:58 -08:00
Aaron Son
fc100694f6 Merge remote-tracking branch 'origin/main' into aaron/remotestorage-cache-cleanup 2025-02-14 13:33:45 -08:00
Aaron Son
4c93a25fbc Merge pull request #8863 from dolthub/reltuk-1e0e5e8f
[auto-bump] [no-release-notes] dependency by reltuk
2025-02-14 13:31:51 -08:00
Aaron Son
449318ac97 go: remotestorage: Fix data race in writebuffer_test.go. 2025-02-14 12:43:43 -08:00
reltuk
c9133db51f [ga-bump-dep] Bump dependency in Dolt by reltuk 2025-02-14 20:43:09 +00:00
Aaron Son
5d4d380f72 go: remotestorage: Make write buffer machinery more robust. Add some testing. 2025-02-14 12:32:59 -08:00
Aaron Son
9b267b47c5 go: remotestorage: writebuffer: Fix write buffer chunk caching on failed commits. 2025-02-14 11:22:34 -08:00
Aaron Son
bfa2739516 Merge remote-tracking branch 'origin/main' into aaron/remotestorage-cache-cleanup 2025-02-14 10:47:15 -08:00
Neil Macneale IV
eb91821ce1 Merge pull request #8857 from dolthub/macneale4/archive-clone-fetch
[no-release-notes] archive clone/fetch
2025-02-13 17:55:34 -08:00
Aaron Son
7c9c808bf3 Merge remote-tracking branch 'origin/main' into aaron/autogc 2025-02-13 17:32:18 -08:00
Aaron Son
2a47d402b2 go: sqle: auto_gc: Responding to PR feedback. Comments and cleanup. 2025-02-13 17:24:03 -08:00
Aaron Son
d4a62c13b7 Merge pull request #8848 from dolthub/aaron/async-push-hook-session-lifecycle
[no-release-notes] go: sqle: Change how we run background threads for replication hooks. Add session lifecycle callbacks for replication hooks.
2025-02-13 17:14:11 -08:00
Aaron Son
f662a63b1e Merge pull request #8858 from dolthub/aaron/gc-clear-caches
[no-release-notes] go: sqle: dolt_gc: Purge read caches associated with the DoltDB as we begin GC.
2025-02-13 17:12:50 -08:00
Neil Macneale IV
2cab73a144 Archive test updates to account for default dictionaries 2025-02-13 16:47:01 -08:00
Aaron Son
cd8372b9c8 go: prolly/tree: node_store.go: Doc comment on PurgeCaches. 2025-02-13 16:38:32 -08:00
Aaron Son
ced4653888 go: store: nbs: Improve goroutine cleanup on gc_copier, some robustness improvements on KillConnection safepoint controller. 2025-02-13 16:36:43 -08:00
Neil Macneale IV
b086492018 Account for empty chunks in archive.getManyCompressed 2025-02-13 16:05:48 -08:00
Neil Macneale IV
77a4e59fc2 More PR Feedback 2025-02-13 15:44:57 -08:00
Neil Macneale IV
2434b63eae PR Feedback 2025-02-13 15:39:06 -08:00
Neil Macneale IV
63e29a790d rollback the change to the getMany interface 2025-02-13 15:24:08 -08:00
Aaron Son
d459962770 Merge pull request #8851 from dolthub/aaron/valuestore-gc-states-unit-tests
[no-release-notes] go/store/types: value_store: Add some unit tests for gc states and gcAddChunk behavior.
2025-02-13 14:48:20 -08:00