Commit Graph

26986 Commits

Author SHA1 Message Date
Aaron Son
4f68ae838d Merge pull request #9411 from dolthub/aaron/statspro-do-not-cancel-for-autogc
go: sqle/statspro: Rework the way stats manages its session in order to make it safe to continue collecting stats during a GC run.
2025-07-01 14:07:31 -07:00
Jason Fulghum
b3f2caa8ac Merge pull request #9432 from dolthub/fulghum-8f7bd00c
[auto-bump] [no-release-notes] dependency by fulghum
2025-07-01 13:24:51 -07:00
Aaron Son
e4aa285d39 go: statspro/worker: PR feedback: Move openSessionCmds handling to execWithOptionalRateLimit. 2025-07-01 12:25:42 -07:00
fulghum
3d8ea161f7 [ga-bump-dep] Bump dependency in Dolt by fulghum 2025-07-01 18:24:07 +00:00
Neil Macneale IV
58e1456ae0 Merge pull request #9421 from dolthub/macneale4/more-overflow
Another overflow issue in archive reader
2025-06-30 13:32:27 -07:00
Neil Macneale IV
bfabd23803 Another overflow issue in archive reader 2025-06-30 11:54:28 -07:00
angelamayxie
7c16477b63 Merge pull request #9420 from dolthub/angelamayxie-635d803f
[auto-bump] [no-release-notes] dependency by angelamayxie
2025-06-30 11:11:00 -07:00
angelamayxie
c15c810151 [ga-bump-dep] Bump dependency in Dolt by angelamayxie 2025-06-30 16:12:43 +00:00
Nathan Gabrielson
8d3dcb92ed Merge pull request #9398 from dolthub/nathan/remove
dolt_rm stored procedure
2025-06-27 16:06:11 -07:00
reltuk
752040140f [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh 2025-06-27 21:47:18 +00:00
Neil Macneale IV
cbc5c9ecf2 Merge pull request #9389 from dolthub/macneale4/better-archive-cmd
Archive cmd improvements
2025-06-27 14:32:43 -07:00
Aaron Son
8df274314b go: sqle/statspro: Rework the way stats manages its session in order to make it safe to continue collecting stats during a GC run.
Previously GC, even with the session-aware safepoint controller, such as is used with Auto GC, would cancel any ongoing stats work and would restart it at the end of the run. Because Auto GC can run quite frequently and because stats can take a while to run to completion, this meant that on some workloads stats would never successfully populate.

This PR changes stats so that it more correctly integrates with the session-safe GC safepoint controller. That allows GC to ensure that the stuff stats is currently working on gets carried over to the collected view of database, and stats itself has a chance to run to completion regardless of what GC work is going on.

This PR leaves the cancel-stats-on-collect behavior enabled for the kill-connections safepoint controller, where that behavior is still the correct one.
2025-06-27 14:29:53 -07:00
Nathan Gabrielson
51c4d71af2 Small & (hopefully) last fixes 2025-06-27 14:29:27 -07:00
Neil Macneale IV
588b7904a0 PR Feedback: Use error group for parrallel compression 2025-06-27 13:29:10 -07:00
Neil Macneale IV
52ec75bb88 Merge pull request #9405 from dolthub/macneale4/archive-suffix-overflow
Don't overflow on suffix buffer allocation
2025-06-27 13:00:35 -07:00
angelamayxie
72d76418d7 Merge pull request #9408 from dolthub/angelamayxie-064b8245
[auto-bump] [no-release-notes] dependency by angelamayxie
2025-06-27 12:44:42 -07:00
angelamayxie
5056a9f134 [ga-bump-dep] Bump dependency in Dolt by angelamayxie 2025-06-27 19:03:05 +00:00
Neil Macneale IV
3b65d627cb PR Feedback: no spin wait 2025-06-27 11:48:32 -07:00
NathanGabrielson
f515cefdba [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh 2025-06-27 18:19:16 +00:00
Nathan Gabrielson
47cacd79b3 More tests, better FK handling 2025-06-27 11:11:00 -07:00
Nathan Gabrielson
97b6a84092 Neil changes + many edge cases 2025-06-27 11:11:00 -07:00
NathanGabrielson
ac820ba945 [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh 2025-06-27 11:11:00 -07:00
Nathan Gabrielson
220e9a123d working basic dolt rm procedure 2025-06-27 11:11:00 -07:00
Nathan Gabrielson
8063ad830b First rm stuff 2025-06-27 11:11:00 -07:00
Neil Macneale IV
1196495b4b Don't overflow on suffix buffer allocation 2025-06-27 11:05:40 -07:00
Jason Fulghum
a7bbe9b377 Merge pull request #9406 from dolthub/fulghum/fix-it
[no-release-notes] Fix merge errors
2025-06-27 10:58:16 -07:00
Jason Fulghum
20c5da65c4 Fixing merge error 2025-06-27 10:19:34 -07:00
Jason Fulghum
414b37bce6 Removing duplicate struct definition 2025-06-27 10:07:59 -07:00
Neil Macneale IV
48d33b493a Don't attempt to reuse dead table files during revert becasue we don't know how many chunks they have 2025-06-26 17:58:58 -07:00
Neil Macneale IV
8646e2695d PR Feedback: check journal file earlier 2025-06-26 17:45:01 -07:00
Elian
629d0c6a96 Merge pull request #9402 from dolthub/elianddb/fix-9390-max1Row-itr-gt-1-ret
Fixes #9391
Add dolt_commit_ancestors table query test
2025-06-26 12:07:38 -07:00
Tim Sehn
f33fd3e14d Merge pull request #9396 from dolthub/tim/dolt_diff_dolt_procedures
Implement `dolt_diff_dolt_procedures`
2025-06-26 12:06:34 -07:00
Tim Sehn
4cf3b08a29 Merge branch 'main' into tim/dolt_diff_dolt_procedures 2025-06-26 12:06:26 -07:00
Tim Sehn
a4be2be571 Merge pull request #9395 from dolthub/tim/dolt_history_dolt_procedures
Implement `dolt_history_dolt_procedures`
2025-06-26 12:05:46 -07:00
Neil Macneale IV
282698a3ae Merge pull request #9401 from dolthub/macneale4-claude/issue-8039
Renaming default branch results in updating local config.
2025-06-26 11:12:21 -07:00
Elian
211f6555fa add msg check 2025-06-26 11:09:38 -07:00
Elian
789030cec4 add dolt_commit_ancestors query test 2025-06-26 11:00:29 -07:00
Neil Macneale IV
6f8ea362ef Update archive --revert to handle newgen archive files 2025-06-26 10:49:03 -07:00
Neil Macneale IV
0e6fc64ce0 Drain all progress messages before terminating archive cmd 2025-06-26 10:49:03 -07:00
Neil Macneale IV
fa03ae2d0a Make archive less strict on chunk counts becasue of duplicate chunks in table files 2025-06-26 10:49:03 -07:00
Neil Macneale IV
e205655c5c Test update for new archive behavior
exit status 0 makes sense when there is nothing to do
2025-06-26 10:49:03 -07:00
Neil Macneale IV
4301f2adff Update bats tests for newgen archive support 2025-06-26 10:48:59 -07:00
Neil Macneale IV
07d09dfdae Print the TableFile name to convert while archiving 2025-06-26 10:46:51 -07:00
Neil Macneale IV
8b48b472a1 Allocate a buffer and copy compressed chunk rather
Otherwise the compression buffer will get stomped on before the results channel is consumed
2025-06-26 10:46:51 -07:00
Neil Macneale IV
21d8828eb5 fan out on compression work 2025-06-26 10:46:51 -07:00
Neil Macneale IV
0160615d7d expect the source set to switch out from under us when we swapTables 2025-06-26 10:46:51 -07:00
Neil Macneale IV
b1e2b92776 Avoid having the blockstore swap out from under us with a callback 2025-06-26 10:46:51 -07:00
Neil Macneale IV
d290a9f462 Refactor archive to convert all table files incrementally
By all table files, I mean both newgen and oldgen.
2025-06-26 10:46:51 -07:00
Neil Macneale IV
a8da9839a8 Merge pull request #9387 from dolthub/macneale4/archive-3
archive format 3. Supporting larger indexes
2025-06-26 10:30:14 -07:00
Elian
5e8f0f334e Merge pull request #9400 from dolthub/elianddb/fix-9390-max1Row-itr-gt-1-ret
Fixes #9390
Fixes #9391
Dolt history table indexes are never marked as unique, regardless of the underlying table’s index properties: prevents unique constraints from being incorrectly reported or exported for history tables
2025-06-26 10:02:40 -07:00