Commit Graph

2654 Commits

Author SHA1 Message Date
Daylon Wilkins 280bbb42f9 Updated the index interface 2021-11-01 19:34:44 -07:00
Maximilian Hoffman d11f5ec41b default session implements persistable interface, can save SQL variables (#2270)
* save version with defaultConfig in session -- todo remove and make PersistedSession

* add PersistedSession, and DoltSession interface to switch

* fmt

* fixup test for persistedSession

* PersistedSession progress, interfaces and enginetests

* All DsessFromSess references fixed

* delete unnuecessary lines

* Comments for dolt session

* Dolt session tests

* save bats progress

* formatting

* GMS version

* Bump GMS version

* add license header

* fix multi-db errors

* try copyright again

* make test deterministic

* higher connection timeout default

* sever config ordering

* PR fixes

* PR fixes

* config rewrite progress

* server config refactor

* PR cleanup

* delete lines

* add go tests, refactor persistent global initialization

* PR fixes

* delete more lines

* small PR cleanup

* try to fix data race

* better constructor names

* zach don't like --server flag

* edge cases around disabling replication

* missed line in merge

* Skip two tests i fixed in follow-on PR

* merge two config prs

* fix nondeterministic bats

* zach's comments

* bump bats sql-shell expect timeout

* GMS and integrator race to access system vars; need to decide whether to force integrator to initialize, or make GMS init private; leaving in GMS for now
2021-11-01 16:49:00 -07:00
Aaron Son bd04b35c98 Merge pull request #2302 from dolthub/aaron/dolt-deleted-branch-handling
checkout,sql-server: Make `dolt checkout` and sql-connect-to-branch functionality available even when configured default branches do not exist.
2021-10-29 10:46:07 -07:00
Maximilian Hoffman ca5ae29dd1 replica benchmark, no event progress for server (#2258)
* small push on write perf benchmark with no prog channel

* remove unused prog funcs

* remove unused prog funcs

* fix bench name

* [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh

Co-authored-by: max-hoffman <max-hoffman@users.noreply.github.com>
2021-10-28 15:34:04 -07:00
Maximilian Hoffman f12196df03 dolt_branches INSERT/UPDATE commit replication (#2301)
* branch table replicates

* Change param type
2021-10-28 15:28:31 -07:00
reltuk f45ef2091d [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh 2021-10-27 22:53:40 +00:00
Aaron Son 87d0f702f5 go/libraries/doltcore/sqle/dsess: Further rework sql database initialization to allow revision specifiers to work when @@GLOBAL.dolt_default_branch specifies a non-existant branch. 2021-10-27 15:52:18 -07:00
Aaron Son 0e907557fc go/libraries/doltcore/sqle: Rework InitialDbState to allow for revision specifiers to continue to work after the default branch is deleted. 2021-10-27 12:08:50 -07:00
Dustin Brown 9747423f42 /go/libraries/doltcore/remotestorage/chunk_store.go: capture has many error 2021-10-27 11:12:22 -07:00
Aaron Son 9e77f1cd13 go/libraries/doltcore/env/actions: branch.go: Fix dolt checkout so it works even if the currently checked out branch does not exist. 2021-10-27 11:09:54 -07:00
Vinai Rachakonda ce7db6b6d9 Get DoltMerge to ignore ErrIsAhead instead of error (#2288) 2021-10-26 11:48:06 -07:00
Brian Hendriks d11d3fdde3 comment for clarity 2021-10-22 10:02:35 -07:00
reltuk 5268bc9c45 [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh 2021-10-22 13:54:23 +00:00
Aaron Son 71e11e5986 go/libraries/doltcore/table/editor: Adds a test for committedEP handling in table_edit_accumulator. 2021-10-22 06:53:14 -07:00
Aaron Son f86a11de6b go/store/types/edits: Changes to ensure AsyncSortedEdits always returned edits in stable order based on how they were added.
The way the SQL layer issues UPDATE statements to the storage layer, combined
with the change which introduced table_edit_accumulator meant that a Map Delete
followed by a Map Insert at certain batch sizes were being sent to an edit
accumulator and then fetched back out of it. When those come back from the edit
accumulator, they need to come back in stable order, so that the update doesn't
turn into a set followed by a delete instead.

AsyncSortedEdits did not currently make attempts to keep these edits in stable
order. In some places it's explicitly backwards (sorted_edit_itr for example).

This fixes it so that it is always stable.

Potentially regresses a memory utilization and sort size smoothing optimization
based around pairing small buffers with large buffers early in the process.

Also includes a fix to table_edit_accumulator to correctly order its
currently-in-progress commited edit provider when it is doing its stable merge.
2021-10-21 14:25:43 -07:00
Vinai Rachakonda 4d50597424 Unblock Update Tests and add new bats test for Update Join #2274 2021-10-20 16:58:27 -07:00
Zach Musgrave 93bb59163d Skipped test broken on main 2021-10-18 16:45:14 -07:00
Zach Musgrave ee4e2ed441 Reskip test 2021-10-18 15:40:18 -07:00
zachmu 5572cf3086 [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh 2021-10-18 22:23:42 +00:00
Zach Musgrave a3ca429c38 Typo 2021-10-18 15:17:48 -07:00
Zach Musgrave 4141dfe11b Fixed more interface breakage 2021-10-18 15:15:06 -07:00
Zach Musgrave 5bc4388a5f Fully working with new view interface 2021-10-18 14:33:01 -07:00
Zach Musgrave cd1ad41834 Removed RegisterSchemaFramgments 2021-10-18 11:47:36 -07:00
Daylon Wilkins c8528e2e04 Reworked skipped fk test, display unresolved foreign keys 2021-10-14 03:17:36 -07:00
Andy Arthur 42c6164aa4 proper nested waiting for conflict streaming map 2021-10-12 14:45:56 -07:00
zachmu 1abdae8d55 [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh 2021-10-12 19:59:00 +00:00
Zach Musgrave c8c83c749b Merge branch 'main' into zachmu/scrip-tests 2021-10-12 12:54:37 -07:00
Zach Musgrave b094202323 Merge main 2021-10-12 12:52:58 -07:00
Daylon Wilkins 0198e77da2 Disabled FK checks allows delayed FK resolution and dropping referenced tables 2021-10-12 05:54:11 -07:00
Zach Musgrave b7770f8ea2 Added script tests specific to dolt 2021-10-11 12:49:29 -07:00
Vinai Rachakonda 493f035e88 Add Read Only Transaction Functionality To Dolt (#2213) 2021-10-08 14:20:49 -07:00
Daylon Wilkins 87b7ed61d1 Prevent panic when iea capacity is reached and undo operations are attempted 2021-10-07 15:19:46 -07:00
Brian Hendriks fe2fdd8ddd Use a Tuple Factory for inserts to decrease memory usage. (#2238) 2021-10-07 11:41:17 -07:00
Aaron Son 86307b6f8e Merge pull request #2230 from abmyii/arm-dolt-push
Fixes for dolt on arm devices
2021-10-07 09:05:55 -07:00
Maximilian Hoffman 4d97326080 noff doesn't surface constraint violations (#2233)
* noff doesn't surface constraint violations

* only no-ff merge if we can fast-forward HEAD safely

* daylon's comments

* same error skip for sql
2021-10-06 19:49:26 -07:00
Aaron Son 97ea3b8749 go/libraries/utils/iohelp: ReaderWithStats: Support > 4GB read stats. 2021-10-06 14:39:47 -07:00
Abdurrahmaan Iqbal 7e53ec8f38 Fix for dolt table import on arm devices 2021-10-06 21:22:15 +01:00
AndyA aced1275bf Merge pull request #2226 from dolthub/andy/kill-sql-package
[no-release-notes] go/doltcore/libraries/sql  Refactor to eliminate pkg `sql`
2021-10-06 13:08:05 -07:00
Abdurrahmaan Iqbal 7e760c4e31 Fix for dolt push on arm devices 2021-10-06 21:04:50 +01:00
Andy Arthur c32e455bb4 refactor keylessDiff.getDiffs to check timeout, context cancelled each time it checks diff against predicate 2021-10-06 12:09:31 -07:00
Andy Arthur 1aba803fe2 make a copy of keyless diff.Difference to avoid reference errors 2021-10-06 11:51:36 -07:00
Andy Arthur 7e6bd72a98 refactor to eliminate pkg /go/doltcore/libraries/sql 2021-10-06 09:55:43 -07:00
Vinai Rachakonda 08eb50be97 Unblock Keyless SQL Diffs and Minimize SQL Diffs (#2205)
1. Unblock the ability to get SQL diffs on keyless tables
2. Minimizes the update statements in a SQL diff
2021-10-06 09:44:47 -07:00
Brian Hendriks 14e70eb2a2 memory cap on in memory table editors (#2220) 2021-10-05 17:27:12 -07:00
Brian Hendriks 63a1bc5c14 Bh/update opt (#2219) 2021-10-05 16:25:46 -07:00
Aaron Son d219609d2e Merge pull request #2217 from dolthub/aaron/remotestorage-update-size-limited
go/libraries/doltcore/remotestorage: Interface for cache returns true if cache is full / truncated in size.
2021-10-05 16:12:58 -07:00
Aaron Son f87b9dad0a go/libraries/doltcore/remotestorage: Fix missing error check on chunk store Put. 2021-10-04 17:11:17 -07:00
Aaron Son abffd995df go/libraries/doltcore/remotestorage: Interface for cache returns true if cache is full / truncated in size. 2021-10-04 16:51:58 -07:00
Zach Musgrave 23df5c88fe Merge pull request #2211 from Juneezee/deprecate-ioutil
refactor: move from io/ioutil to io and os package
2021-10-04 14:10:04 -07:00
Maximilian Hoffman 9a7a49f516 initial dolt backup cli (#2208)
* prototype

* backup pushes noms root

* backup pushes root value, basic restore still needs origin drop

* bats tests, no origin on restore, only head ref on restore

* cleanup code, up to date bats test

* make backup restore a root sync also, to catch branches and remote refs

* [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh

* couple of tim's comments

couple of tim's comments

* zach's comments

* loosen restrictions for conflicting remote addresses

* [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh

Co-authored-by: max-hoffman <max-hoffman@users.noreply.github.com>
2021-10-04 11:53:05 -07:00