Commit Graph

17209 Commits

Author SHA1 Message Date
Pavel Safronov
c0cd58c192 Add child refs to memtable only when a chunk was added.
Fixes https://github.com/dolthub/dolt/issues/5301
2023-02-07 17:03:59 -08:00
Maximilian Hoffman
826f5787d0 Trim compare string prefix (#5295)
* Prototype trim compare string prefix

* add tests

* [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh

* copyright header

---------

Co-authored-by: max-hoffman <max-hoffman@users.noreply.github.com>
2023-02-07 13:54:09 -08:00
Pavel Safronov
4534f16397 Merge pull request #5308 from dolthub/pavel/pprof-server-fix
Allow the pprof server to handle connections from non-localhost
2023-02-07 13:16:33 -08:00
jennifersp
0ae04783b7 Merge pull request #5321 from dolthub/jennifersp-d7e788d3
[auto-bump] [no-release-notes] dependency by jennifersp
2023-02-07 10:50:05 -08:00
jennifersp
146ca895eb [ga-bump-dep] Bump dependency in Dolt by jennifersp 2023-02-07 15:46:27 +00:00
James Cor
e725522364 Merge pull request #5315 from dolthub/james/prefix
slightly better prefix compare
2023-02-06 21:01:18 -08:00
jennifersp
463e93169b fix panic for unexpected json file format (#5302) 2023-02-06 17:55:14 -08:00
Zach Musgrave
5dc703d8a5 Merge pull request #5306 from dolthub/zachmu/all-branches
dolt_remote_branches table
2023-02-06 15:56:21 -08:00
Zach Musgrave
23098c8738 Test for no remotes 2023-02-06 14:41:06 -08:00
jennifersp
f3f68b35c2 add --track flag for dolt_branch() procedure (#5312) 2023-02-06 14:37:25 -08:00
JCOR11599
7f2dc69134 [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh 2023-02-06 22:35:17 +00:00
Zach Musgrave
3d131a9ffd Updated bats tests 2023-02-06 14:33:17 -08:00
James Cor
98cb268ba3 slightly better prefix compare 2023-02-06 14:32:03 -08:00
Zach Musgrave
b2323008eb PR feedback, took this in a different direction 2023-02-06 14:17:37 -08:00
stephanie
2d51348360 Merge pull request #5311 from dolthub/steph/dolt-4943
makes -f default behavior for dolt fetch
2023-02-06 11:17:12 -08:00
Aaron Son
a01c6717c3 Merge branch 'fix-int-overflow' 2023-02-06 11:04:12 -08:00
Aaron Son
a4a48e0ed7 go/store/skip/list.go: PR feedback. 2023-02-06 11:04:05 -08:00
Stephanie You
ee7d6afe1a update dolt_fetch stored procedure to make --force default 2023-02-06 09:52:17 -08:00
James Cor
add5284ac2 Merge pull request #5279 from dolthub/james/fk-stuff
reuse cursor when verifying fks using secondary indexes
2023-02-03 20:33:00 -08:00
reltuk
acbc3976cf [ga-bump-release] Update Dolt version to 0.52.20 and release v0.52.20 v0.52.20 2023-02-04 02:51:15 +00:00
JCOR11599
b47151aa66 [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh 2023-02-04 01:22:53 +00:00
Aaron Son
ddc9263eee Merge pull request #5307 from dolthub/aaron/nbs-chunkSource-reader
go/store/nbs: Make a chunkSource able to return a real io.Reader.
2023-02-03 17:21:52 -08:00
James Cor
82eb5129b7 cheaper compare 2023-02-03 16:42:25 -08:00
Stephanie You
fd0e4d6faa makes -f default behavior for dolt fetch 2023-02-03 16:07:19 -08:00
James Cor
9d25a10e79 adding tests 2023-02-03 16:03:36 -08:00
Pavel Safronov
aa2aab2353 Allow the pprof server to handle connections from non-localhost machines.
This change is necessary to reach a Docker pprof server from host machine.
2023-02-03 15:08:21 -08:00
Aaron Son
508f67554d go/store/nbs: Make a chunkSource able to return a real io.Reader.
With TableFileStore.WriteTableFile() being used on the clone path, we want to
turn chunk sources into an io.ReadCloser. In the past, store/nbs always did
this by using the ReaderAt to emulate an io.Reader. For files this maybe has OK
performance, but for AWS/Blobstore remotes it causes a serial sequence of lots
of small reads against blob storage as the io.Copy() implementation copies a
few dozen KBs at a time.

This change makes it so a chunkSource can return an actual Reader.
file_table_reader leaves the reader at emulation in place for now. One reason
to potentially get rid of even that layer is to enable something like
.WriteTo() -> sendfile() translations. Those are not currently directly in
place because we currently instrument the returned Reader with byte counting,
for example, so we can report on Clone progress. One reason to leave the
ReaderAt implementation in place, on the other hand, is interactions with file
descriptors and the file descriptor cache. This is an investigation for later;
it seemed most prudent to leave it for now since it's not currently causing
pain.
2023-02-03 14:56:15 -08:00
zachmu
caf162eeb1 [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh 2023-02-03 22:13:17 +00:00
Zach Musgrave
09c52bd41e Tests and bug fix 2023-02-03 14:05:02 -08:00
James Cor
8745744f22 adding comments 2023-02-03 13:33:02 -08:00
Zach Musgrave
fe3e12c957 dolt_all_branches table 2023-02-03 13:12:05 -08:00
AndyA
43907f3b0b Merge pull request #5300 from dolthub/andy/catch-gc-test-panic
go/doltcore/doltdb: catch panic in gc concurrency tests
2023-02-03 11:49:29 -08:00
Zach Musgrave
11325bb4b6 Merge pull request #5297 from dolthub/zachmu/enginetest-cleanup
[no-release-notes] engine tests changes from GMS cleanup
2023-02-03 11:01:12 -08:00
Zach Musgrave
21a8025ee7 Merge pull request #5258 from dolthub/zachmu/gc-panic
[no-release-notes] noms command to find dangling references
2023-02-03 10:42:27 -08:00
Zach Musgrave
b954c2593e Merge branch 'main' into zachmu/enginetest-cleanup 2023-02-03 10:26:53 -08:00
Zach Musgrave
6f199b4400 Upgrade gms 2023-02-03 10:25:39 -08:00
Aaron Son
c208615518 Merge pull request #5288 from dolthub/aaron/nbs-store-ioParallelism
go/store/nbs: tableReader, *NomsBlockStore: Use errgroup.SetLimit to enforce limit on io parallelism across the GetMany call, instead of just at the chunk source.
2023-02-03 10:17:40 -08:00
jennifersp
257b6b25fc allow different format options for dolt branch with track flag (#5286) 2023-02-03 09:34:40 -08:00
stephanie
a3ba461d1c Merge pull request #5291 from dolthub/steph/dolt-5241
update query timing to be accurate when using dolt sql-client
2023-02-03 09:25:46 -08:00
Andy Arthur
4bb30885d4 go/doltcore/doltdb: catch panic in gc concurrency tests 2023-02-03 09:11:42 -08:00
JCOR11599
6fe7161ba5 [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh 2023-02-03 05:49:43 +00:00
James Cor
56a1821b68 merge 2023-02-02 21:48:34 -08:00
James Cor
213433cc35 dolt1 only 2023-02-02 21:46:15 -08:00
JCOR11599
c3592419c2 [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh 2023-02-03 05:24:59 +00:00
James Cor
52c012fa96 adding test 2023-02-02 21:23:42 -08:00
AndyA
02167c3cd8 Merge pull request #5290 from dolthub/andy/concurrent-gc-tests
[no-release-notes] go/dolcore/doltdb: unskip concurrent GC integration tests
2023-02-02 19:34:07 -08:00
James Cor
0156e007aa cleaning up 2023-02-02 19:28:46 -08:00
James Cor
3c29983a57 Merge branch 'james/fk-stuff' of https://github.com/dolthub/dolt into james/fk-stuff 2023-02-02 17:08:49 -08:00
James Cor
9ed59ce529 skip nulls 2023-02-02 17:08:40 -08:00
James Cor
879c70f1a9 using too many tags 2023-02-02 16:40:29 -08:00