Commit Graph

26138 Commits

Author SHA1 Message Date
Aaron Son
decdc9ee4c integration-tests/bats: sql-server.bats: Remove redundant max-connections behavior tests. 2025-03-25 09:56:08 -07:00
Aaron Son
2ff00c2afc integration-tests/go-sql-server-driver: Implement max-connections testing to go-sql-server-driver. 2025-03-25 09:56:05 -07:00
Neil Macneale IV
24c4e7ca20 Make the last timeout test more reliable 2025-03-24 21:02:14 -07:00
Neil Macneale IV
ff8320fce5 More test goodness 2025-03-24 21:02:14 -07:00
Neil Macneale IV
cd407bcbc8 Update missed go test 2025-03-24 21:02:14 -07:00
Neil Macneale IV
44313be0d8 Cleanup 2025-03-24 21:02:14 -07:00
Neil Macneale IV
aacde670b0 Test the --max-connections-timeout has an effect 2025-03-24 21:02:14 -07:00
Neil Macneale IV
ae18118f31 Get max timeout for waiting connections all the way through 2025-03-24 21:02:14 -07:00
Neil Macneale IV
27ff3beaac Add max connections timeout 2025-03-24 21:02:14 -07:00
Neil Macneale IV
11dcccd1cc Add more tests for max cons and back log 2025-03-24 21:02:14 -07:00
Neil Macneale IV
66180b5623 Reliable first test for max-conns and back-log 2025-03-24 21:02:14 -07:00
Neil Macneale IV
309ba1d3d4 Test the --back-log value gets written to config.yaml 2025-03-24 21:02:14 -07:00
Neil Macneale IV
115aec82d7 Add support for back_log option to server config and flags.
No tests. No SQL support
2025-03-24 21:02:14 -07:00
macneale4
d5b2092702 [ga-bump-dep] Bump dependency in Dolt by macneale4 2025-03-25 03:19:27 +00:00
Aaron Son
f900d82500 Merge pull request #9021 from dolthub/aaron/gcctx-autoincrement-tracker-fix
go: gcctx,dsess: Move GCSafepointController into an independent package. Make dsess.AutoIncrementTracker background database access participate in GC lifecycle callbacks.
2025-03-24 13:59:02 -07:00
Aaron Son
21c2dee0c6 go: gcctx,dsess/autoincrement_tracker.go: PR feedback. 2025-03-24 12:24:58 -07:00
Maximilian Hoffman
26e9475fec [no-release-notes] Fix races in doltgres (#9018)
* [no-release-notes] fix doltgres stats

* build

* race

* more race

* delete old code

* error races

* fix build

* [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh

* better document stats startup dependencies

* more race

* [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh

---------

Co-authored-by: max-hoffman <max-hoffman@users.noreply.github.com>
2025-03-24 11:26:41 -07:00
Aaron Son
e8e54dfd31 Merge pull request #9019 from dolthub/aaron/fix-remotesrv-and-branch-ctx
[no-release-notes] go: Fix a few call sites where the wrong context was passed.
2025-03-24 10:17:27 -07:00
Aaron Son
950043ef73 Merge pull request #9020 from dolthub/aaron/branch-control-get-branch-context
go: branch_control,sqle/dsess: Pass the *sql.Context to the GetBranch accessor. Wrap it for the branch_control.Context conversion.
2025-03-24 10:14:13 -07:00
Aaron Son
29cf98a150 go: dsess: autoincrement_tracker.go: Only do gc lifecycle events if a safepoint controller exists. 2025-03-22 11:32:58 -07:00
Aaron Son
c38f1d468a format_repo.sh. 2025-03-22 10:31:39 -07:00
Aaron Son
a2075f4523 go: dsess: autoincrement_tracker: Ensure that a GC safepoint lifecycle correctly enbapsulates the async load of the autoincrement state. 2025-03-22 10:31:39 -07:00
Aaron Son
f91e87a4ae go: dsess,doltdb/gcctx: Move GCSafepointController and related machinery out of dsess and into its own, sql-agnostic package. 2025-03-22 10:31:36 -07:00
Aaron Son
f9f5af590f go: branch_control,sqle/dsess: Pass the *sql.Context to the GetBranch accessor. Wrap it for the branch_control.Context conversion. 2025-03-22 08:49:30 -07:00
Aaron Son
4f762733bc [no-release-notes] go: Fix a few call sites where the wrong context was passed. 2025-03-22 08:38:21 -07:00
Jason Fulghum
d108e834e5 Merge pull request #9017 from dolthub/max-hoffman-47285a54
[auto-bump] [no-release-notes] dependency by max-hoffman
2025-03-21 12:26:30 -07:00
max-hoffman
b53fc49b74 [ga-bump-dep] Bump dependency in Dolt by max-hoffman 2025-03-21 18:39:14 +00:00
Neil Macneale IV
f5cae4ca38 Merge pull request #8995 from dolthub/macneale4/archive-hot-convert
[no-release-notes] archive hot convert from snappy to zStd compressed chunks
2025-03-21 09:48:23 -07:00
Zach Musgrave
c1c677adff Merge pull request #9006 from Juneezee/backoff
Replace `jpillora/backoff` with `cenkalti/backoff/v4`
2025-03-20 17:42:58 -07:00
Neil Macneale IV
130e0be7a4 Merge pull request #8991 from Juneezee/mpb
Remove duplicate `github.com/vbauerster/mpb` dependency
2025-03-20 17:40:29 -07:00
Neil Macneale IV
1d8aacd782 Revert "Randomly disable archive STREAMER for each test"
This reverts commit ddf9cf4712.
2025-03-20 17:38:59 -07:00
Maximilian Hoffman
b8b2ff1c99 [stats] Rewrite stat management to use single threaded event loop (#8815)
* [stats] event loop

* more progress

* basic scheduler test working

* analyze

* add/drop hooks

* gc

* delete an alter

* drop index and table

* fix other tests

* branch management

* starter for kv

* gc and refactor maintanance

* fix bucket doubling

* delete log

* better bucket counting

* test for disk round trip

* more prolly stats gc tests

* rotate backing stats db

* progress towards swapping old for new, deleting old code

* fix gc bucket overflow

* test for gc overflow

* org and closers

* save progress update

* finally get first two bats running

* startup bound hash issue

* rewrite GC to be synchronous, fix more bugs

* fix session freshness

* fix branch gc

* cache writes and gc are serialized

* fix gc/branch update dropped hashes

* fix gc race, doubling race, jobs race

* fix more races

* docs

* convert bats to script tests

* more tests, purge/stop

* validate

* docs

* some PR cleanup

* more cleanup

* stash for pull

* fix bucket hash conflicts

* Fix more collection bugs.

* bump, timer proc

* more test fixes

* cache bats changes

* Another deadlock

* delete comment

* fmt

* no read replica stats

* fix plan tests

* branch qualified analyze fix

* [no-release-notes] go: statspro/jobqueue: Create a SerialQueue, which can perform asynchronous work on a worker thread.

* go: statspro/jobqueue: A bit of cleanup, fix a flakey test.

* rewrite with GDQ

* prog

* tests run

* fix info and storage

* outline for gc impl

* fix tests and races

* bump

* better error and panic management

* better start/stop/wait

* Add rate limiting

* gc ticker

* docs

* doc

* test prog

* fix more tests

* finish up listener tests

* add comments

* gc concurrency

* enginetests and statspro tests passing

* simplify listeners

* bats progress

* small edits

* tests progress

* bats are running

* fmt

* build

* edits

* fix interface

* fix build

* stats alternate index types

* fix mem test

* build

* fix more tests

* fmt

* more fmt

* copyright

* license

* fix races

* syntax error

* fix windows path

* nil mcv panic

* fix test races

* bump def job interval to 30ms

* deterministic tests

* more tests

* TEMP COMMIT: valctx plus some other stuff...

* shorter concurrency tests

* [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh

* nondeterministic test

* try to make queue tests less racy

* missed one start

* stats granular session locks

* simplify a little

* try to avoid serialq test deadlock

* try to fix flakes

* more races

* bump

* another race

* cleanup

* more cleanup

* revert ctx validation

* most zach comments

* more comments

* more race

* bump

* more race

* bump

* schemas

* skip windows racees

* standardize server config init, use background threads management

* [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh

* default stats noop

* threads management improvements

* undo change

* move stats initialization back to engine

* [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh

---------

Co-authored-by: Aaron Son <aaron@dolthub.com>
Co-authored-by: max-hoffman <max-hoffman@users.noreply.github.com>
2025-03-20 15:56:48 -07:00
Neil Macneale IV
0dd4217f60 Merge pull request #9002 from dolthub/macneale4/exp-slices
Replace `golang.org/x/exp/slices` with stdlib `slices`

https://github.com/dolthub/dolt/pull/8998
2025-03-20 11:15:36 -07:00
Zach Musgrave
721b0c7eda Merge pull request #9000 from jbampton/fix-spelling
Fix spelling
2025-03-20 10:05:53 -07:00
coffeegoddd
068a396f1c [ga-bump-release] Update Dolt version to 1.50.9 and release v1.50.9 v1.50.9 2025-03-20 05:40:14 +00:00
Dustin Brown
27cf104140 [ga-bump-dep] Bump dependency in Dolt by max-hoffman (#9012)
Co-authored-by: max-hoffman <maximilian.wolfgang1@gmail.com>
2025-03-19 22:06:38 -07:00
Eng Zer Jun
64cc94ebe5 Remove duplicate github.com/vbauerster/mpb dependency
Signed-off-by: Eng Zer Jun <engzerjun@gmail.com>
2025-03-20 12:50:41 +08:00
coffeegoddd
5749b98952 [ga-bump-release] Update Dolt version to 1.50.8 and release v1.50.8 v1.50.8 2025-03-20 01:42:01 +00:00
Jason Fulghum
07bbc261b2 Merge pull request #9011 from dolthub/max-hoffman-e787f4ee
[auto-bump] [no-release-notes] dependency by max-hoffman
2025-03-19 18:07:21 -07:00
max-hoffman
ca690bcfc6 [ga-bump-dep] Bump dependency in Dolt by max-hoffman 2025-03-20 00:29:37 +00:00
Jason Fulghum
b0ecc6d71e Merge pull request #9010 from dolthub/fulghum-8c915e51
[auto-bump] [no-release-notes] dependency by fulghum
2025-03-19 17:20:35 -07:00
fulghum
8b86e10c30 [ga-bump-dep] Bump dependency in Dolt by fulghum 2025-03-19 23:24:36 +00:00
coffeegoddd
b44a6aec46 [ga-bump-release] Update Dolt version to 1.50.7 and release v1.50.7 v1.50.7 2025-03-19 20:58:21 +00:00
Dustin Brown
63f0572c49 [ga-bump-dep] Bump dependency in Dolt by max-hoffman (#9009)
Co-authored-by: max-hoffman <maximilian.wolfgang1@gmail.com>
2025-03-19 13:21:04 -07:00
coffeegoddd
bb61d9b3ec [ga-bump-release] Update Dolt version to 1.50.6 and release v1.50.6 v1.50.6 2025-03-19 16:29:35 +00:00
Eng Zer Jun
1905ecc8d6 Replace jpillora/backoff with cenkalti/backoff/v4
A drop-in replacement.

Signed-off-by: Eng Zer Jun <engzerjun@gmail.com>
2025-03-19 23:20:14 +08:00
Aaron Son
6a3ae60016 Merge pull request #9005 from dolthub/aaron/s3-backup-sync-fix
go/store/nbs: Fix perf regression in taking backups.
2025-03-19 07:42:54 -07:00
Aaron Son
9d4950bc37 go/store/nbs: Fix perf regression in taking backups.
1.50.0 introduced a perf regression which mainly effects taking backups to AWS
or GCS. This is a partial fix which makes backups perform as before when they
are going to a completely new destination. Incremental backups to an existing
store are still slower. We continue to work on addressing the regression.
2025-03-18 17:33:00 -07:00
Neil Macneale IV
7e23451e69 Up server config default max conns from 100 to 1000 (#9003) 2025-03-18 16:29:08 -07:00
John Bampton
977064fc0d Fix spelling 2025-03-19 03:48:45 +10:00