Commit Graph

17223 Commits

Author SHA1 Message Date
Zach Musgrave 10049193ba Fixed bugginess in server shutdown wait for bats 2023-02-09 10:06:11 -08:00
Zach Musgrave 60b87d3f54 Fixed bats test, needed replica config. Added new test 2023-02-08 18:16:51 -08:00
Zach Musgrave 079d3b767b Merge branch 'zachmu/remote-ref-replication' of github.com:dolthub/dolt into zachmu/remote-ref-replication 2023-02-08 17:45:11 -08:00
Zach Musgrave d7d2b2a665 Missed error check 2023-02-08 17:45:07 -08:00
zachmu 499d3bd0fe [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh 2023-02-09 01:22:04 +00:00
Zach Musgrave a6317196f3 Test of connecting to a branch not on a remote 2023-02-08 17:09:44 -08:00
Zach Musgrave 92a85a6bad Test for replication pull creating new remote branches 2023-02-08 17:02:23 -08:00
Zach Musgrave bbe82f0c09 refactored for readability 2023-02-08 16:23:33 -08:00
Zach Musgrave 677e6819f9 Ripped out upstream tracking for now 2023-02-08 16:08:31 -08:00
Zach Musgrave dc70db6cbe Save upstream tracking info for new branches 2023-02-08 15:28:25 -08:00
Zach Musgrave a994e00bf8 Write remote tracking refs during replica pull 2023-02-08 15:10:42 -08:00
Zach Musgrave c8e8b88c87 Fixed race where a branch ref has been created but the working set ref has not 2023-02-08 14:44:29 -08:00
Zach Musgrave e2a895a9a2 looping logic bug fix 2023-02-08 14:33:37 -08:00
Zach Musgrave 18c9812f28 Better concurrency control, and some bug fixes in new branch creation 2023-02-08 13:57:45 -08:00
Zach Musgrave ebf123211f Separated pulling branches from updating working set (not necessary on newly pulled branch) 2023-02-08 11:07:23 -08:00
Zach Musgrave 034c5d19f1 Fixed bats test. No longer an error to connect to a locally created branch on a read replica (maybe should be an error to create a local branch in the first place but we don't enforce that) 2023-02-08 09:44:34 -08:00
zachmu 1fcbd1f9b6 [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh 2023-02-07 23:31:23 +00:00
Zach Musgrave bbc1824a40 Fixed race when multiple clients attempt to connect to the same branch the first time a replica fetches it 2023-02-07 15:29:34 -08:00
jennifersp 0ae04783b7 Merge pull request #5321 from dolthub/jennifersp-d7e788d3
[auto-bump] [no-release-notes] dependency by jennifersp
2023-02-07 10:50:05 -08:00
jennifersp 146ca895eb [ga-bump-dep] Bump dependency in Dolt by jennifersp 2023-02-07 15:46:27 +00:00
James Cor e725522364 Merge pull request #5315 from dolthub/james/prefix
slightly better prefix compare
2023-02-06 21:01:18 -08:00
jennifersp 463e93169b fix panic for unexpected json file format (#5302) 2023-02-06 17:55:14 -08:00
Zach Musgrave 5dc703d8a5 Merge pull request #5306 from dolthub/zachmu/all-branches
dolt_remote_branches table
2023-02-06 15:56:21 -08:00
Zach Musgrave 23098c8738 Test for no remotes 2023-02-06 14:41:06 -08:00
jennifersp f3f68b35c2 add --track flag for dolt_branch() procedure (#5312) 2023-02-06 14:37:25 -08:00
JCOR11599 7f2dc69134 [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh 2023-02-06 22:35:17 +00:00
Zach Musgrave 3d131a9ffd Updated bats tests 2023-02-06 14:33:17 -08:00
James Cor 98cb268ba3 slightly better prefix compare 2023-02-06 14:32:03 -08:00
Zach Musgrave b2323008eb PR feedback, took this in a different direction 2023-02-06 14:17:37 -08:00
stephanie 2d51348360 Merge pull request #5311 from dolthub/steph/dolt-4943
makes -f default behavior for dolt fetch
2023-02-06 11:17:12 -08:00
Aaron Son a01c6717c3 Merge branch 'fix-int-overflow' 2023-02-06 11:04:12 -08:00
Aaron Son a4a48e0ed7 go/store/skip/list.go: PR feedback. 2023-02-06 11:04:05 -08:00
Stephanie You ee7d6afe1a update dolt_fetch stored procedure to make --force default 2023-02-06 09:52:17 -08:00
James Cor add5284ac2 Merge pull request #5279 from dolthub/james/fk-stuff
reuse cursor when verifying fks using secondary indexes
2023-02-03 20:33:00 -08:00
reltuk acbc3976cf [ga-bump-release] Update Dolt version to 0.52.20 and release v0.52.20 v0.52.20 2023-02-04 02:51:15 +00:00
JCOR11599 b47151aa66 [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh 2023-02-04 01:22:53 +00:00
Aaron Son ddc9263eee Merge pull request #5307 from dolthub/aaron/nbs-chunkSource-reader
go/store/nbs: Make a chunkSource able to return a real io.Reader.
2023-02-03 17:21:52 -08:00
James Cor 82eb5129b7 cheaper compare 2023-02-03 16:42:25 -08:00
Stephanie You fd0e4d6faa makes -f default behavior for dolt fetch 2023-02-03 16:07:19 -08:00
James Cor 9d25a10e79 adding tests 2023-02-03 16:03:36 -08:00
Aaron Son 508f67554d go/store/nbs: Make a chunkSource able to return a real io.Reader.
With TableFileStore.WriteTableFile() being used on the clone path, we want to
turn chunk sources into an io.ReadCloser. In the past, store/nbs always did
this by using the ReaderAt to emulate an io.Reader. For files this maybe has OK
performance, but for AWS/Blobstore remotes it causes a serial sequence of lots
of small reads against blob storage as the io.Copy() implementation copies a
few dozen KBs at a time.

This change makes it so a chunkSource can return an actual Reader.
file_table_reader leaves the reader at emulation in place for now. One reason
to potentially get rid of even that layer is to enable something like
.WriteTo() -> sendfile() translations. Those are not currently directly in
place because we currently instrument the returned Reader with byte counting,
for example, so we can report on Clone progress. One reason to leave the
ReaderAt implementation in place, on the other hand, is interactions with file
descriptors and the file descriptor cache. This is an investigation for later;
it seemed most prudent to leave it for now since it's not currently causing
pain.
2023-02-03 14:56:15 -08:00
zachmu caf162eeb1 [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh 2023-02-03 22:13:17 +00:00
Zach Musgrave 09c52bd41e Tests and bug fix 2023-02-03 14:05:02 -08:00
James Cor 8745744f22 adding comments 2023-02-03 13:33:02 -08:00
Zach Musgrave fe3e12c957 dolt_all_branches table 2023-02-03 13:12:05 -08:00
AndyA 43907f3b0b Merge pull request #5300 from dolthub/andy/catch-gc-test-panic
go/doltcore/doltdb: catch panic in gc concurrency tests
2023-02-03 11:49:29 -08:00
Zach Musgrave 11325bb4b6 Merge pull request #5297 from dolthub/zachmu/enginetest-cleanup
[no-release-notes] engine tests changes from GMS cleanup
2023-02-03 11:01:12 -08:00
Zach Musgrave 21a8025ee7 Merge pull request #5258 from dolthub/zachmu/gc-panic
[no-release-notes] noms command to find dangling references
2023-02-03 10:42:27 -08:00
Zach Musgrave b954c2593e Merge branch 'main' into zachmu/enginetest-cleanup 2023-02-03 10:26:53 -08:00
Zach Musgrave 6f199b4400 Upgrade gms 2023-02-03 10:25:39 -08:00