Commit Graph

10129 Commits

Author SHA1 Message Date
Aaron Son 2cca4d089a Add some tests for async sorted edits changes. 2021-10-21 17:19:10 -07:00
reltuk 615dedc374 [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh 2021-10-21 21:33:06 +00:00
Aaron Son f86a11de6b go/store/types/edits: Changes to ensure AsyncSortedEdits always returned edits in stable order based on how they were added.
The way the SQL layer issues UPDATE statements to the storage layer, combined
with the change which introduced table_edit_accumulator meant that a Map Delete
followed by a Map Insert at certain batch sizes were being sent to an edit
accumulator and then fetched back out of it. When those come back from the edit
accumulator, they need to come back in stable order, so that the update doesn't
turn into a set followed by a delete instead.

AsyncSortedEdits did not currently make attempts to keep these edits in stable
order. In some places it's explicitly backwards (sorted_edit_itr for example).

This fixes it so that it is always stable.

Potentially regresses a memory utilization and sort size smoothing optimization
based around pairing small buffers with large buffers early in the process.

Also includes a fix to table_edit_accumulator to correctly order its
currently-in-progress commited edit provider when it is doing its stable merge.
2021-10-21 14:25:43 -07:00
Vinai Rachakonda 4d50597424 Unblock Update Tests and add new bats test for Update Join #2274 2021-10-20 16:58:27 -07:00
Dustin Brown 1cc0df7c5c [ga-bump-dep] Bump dependency in Dolt by zachmu (#2272)
Co-authored-by: zachmu <zach@dolthub.com>
2021-10-20 11:56:47 -07:00
Dustin Brown bf5e43fecf Merge pull request #2273 from dolthub/db/fix-winget
[no-release-notes] /.github/workflows/ci-bump-winget.yaml: fix winget workflow
2021-10-20 11:12:37 -07:00
Dustin Brown 7fd2fb31d9 /.github/workflows/ci-bump-winget.yaml: fix winget workflow 2021-10-20 11:11:20 -07:00
Dustin Brown 7c723ffb0e Update cd-release.yaml 2021-10-20 10:41:26 -07:00
zachmu a8e599f93d [ga-bump-release] Update Dolt version to 0.31.0 and release v0.31.0 v0.31.0 2021-10-20 17:25:41 +00:00
Zach Musgrave 20588931c7 Merge pull request #2268 from dolthub/zachmu/views
Simpler engine construction
2021-10-19 08:51:12 -07:00
Zach Musgrave 93bb59163d Skipped test broken on main 2021-10-18 16:45:14 -07:00
Zach Musgrave 29ab1510ee Fixed two broken bats tests (also rewrote line endings in one file) 2021-10-18 16:25:22 -07:00
Zach Musgrave ee4e2ed441 Reskip test 2021-10-18 15:40:18 -07:00
Zach Musgrave cad95197aa Fixed broken bats test 2021-10-18 15:38:20 -07:00
Zach Musgrave e3ff64990d Merge branch 'zachmu/views' of github.com:dolthub/dolt into zachmu/views 2021-10-18 15:27:34 -07:00
Zach Musgrave 684cefad92 Fixed broken bats test, upgraded GMS 2021-10-18 15:27:27 -07:00
zachmu 5572cf3086 [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh 2021-10-18 22:23:42 +00:00
Zach Musgrave a3ca429c38 Typo 2021-10-18 15:17:48 -07:00
Zach Musgrave 4141dfe11b Fixed more interface breakage 2021-10-18 15:15:06 -07:00
Zach Musgrave 5bc4388a5f Fully working with new view interface 2021-10-18 14:33:01 -07:00
Zach Musgrave cd1ad41834 Removed RegisterSchemaFramgments 2021-10-18 11:47:36 -07:00
Dustin Brown fded10e248 [ga-bump-dep] Bump dependency in Dolt by VinaiRachakonda (#2264)
Co-authored-by: VinaiRachakonda <vinai@dolthub.com>
2021-10-15 12:26:41 -07:00
Dustin Brown 6b6d0789c1 Merge pull request #2263 from dolthub/db/add-label
[no-release-notes] /.github/scripts/fuzzer/get-fuzzer-job-json.sh: add job label
2021-10-15 09:17:57 -07:00
Dustin Brown 557e3a565f /.github/scripts/fuzzer/get-fuzzer-job-json.sh: add job label 2021-10-15 09:15:44 -07:00
Daylon Wilkins c8528e2e04 Reworked skipped fk test, display unresolved foreign keys 2021-10-14 03:17:36 -07:00
Vinai Rachakonda c95a51a733 Prevent pull from erroring on config with no email or name: (#2254) 2021-10-13 16:41:16 -07:00
Aaron Son 4db1834730 Merge pull request #2252 from dolthub/aaron/commit-parents-closure-find-common-ancestor
go/store/data: Use new parents_closure field for FindCommonAncestor.
2021-10-13 15:52:34 -07:00
Dustin Brown 310ddd5cf4 Merge pull request #2257 from dolthub/db/refactor-winget
[no-release-notes] /.github/workflows/ci-bump-winget.yaml: refactor winget workflow
2021-10-13 10:59:27 -07:00
Dustin Brown ab10713475 /.github/workflows/cd-release.yaml: trigger msi from release workflow 2021-10-13 10:46:36 -07:00
Zach Musgrave 411584565c Update roadmap.md 2021-10-13 10:31:33 -07:00
Dustin Brown bf54713bf9 /.github/workflows/ci-bump-winget.yaml: refactor winget workflow 2021-10-13 10:11:36 -07:00
AndyA 0926956243 Merge pull request #2256 from dolthub/andy/rationalize-merge-concurrency
[no-release-notes] /go/libraries/doltcore/merge: Proper nested waiting for conflict streaming map
2021-10-12 15:55:32 -07:00
Aaron Son 672bcececd Merge remote-tracking branch 'origin/main' into aaron/commit-parents-closure-find-common-ancestor 2021-10-12 15:39:55 -07:00
Aaron Son 459d98defe Add a TODO to seek in FindCommonAncestor implementation. 2021-10-12 15:39:49 -07:00
Andy Arthur 42c6164aa4 proper nested waiting for conflict streaming map 2021-10-12 14:45:56 -07:00
Zach Musgrave feca3225c4 Merge pull request #2255 from dolthub/zachmu/scrip-tests
Added scripted SQL tests that use DOLT_COMMIT
2021-10-12 13:44:08 -07:00
zachmu 1abdae8d55 [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh 2021-10-12 19:59:00 +00:00
Zach Musgrave c8c83c749b Merge branch 'main' into zachmu/scrip-tests 2021-10-12 12:54:37 -07:00
Zach Musgrave b094202323 Merge main 2021-10-12 12:52:58 -07:00
Zach Musgrave 73a84f82e0 Upgrade gms 2021-10-12 12:49:43 -07:00
Aaron Son dd5161f79b go/store/datas: Encapsulate some iterator logic for FindCommonAncestors in a struct. 2021-10-12 10:40:27 -07:00
Aaron Son 6129e9568e Merge remote-tracking branch 'origin/main' into aaron/commit-parents-closure-find-common-ancestor 2021-10-12 10:39:56 -07:00
Aaron Son 74adee855a Merge pull request #2235 from dolthub/aaron/commit-parents-closure
go/store/datas: Materialize a parents closure map at commit time.
2021-10-12 10:39:48 -07:00
Aaron Son 8cece700e8 go/store/datas: First pass at implementing FindCommonAncestor when parents_closure is present. 2021-10-12 09:40:55 -07:00
Daylon Wilkins 0198e77da2 Disabled FK checks allows delayed FK resolution and dropping referenced tables 2021-10-12 05:54:11 -07:00
Dustin Brown 1b82dc890e Update ci-bump-winget.yaml 2021-10-11 16:32:34 -07:00
Aaron Son 1aead8d4cf Fix up tests with hardcoded commit hashes for new parents_closure storage. 2021-10-11 14:21:10 -07:00
Zach Musgrave ac0cd8e5b1 Merge pull request #2247 from dolthub/zachmu/checkout-workingset
Added test of working set behavior for checkout
2021-10-11 14:09:16 -07:00
reltuk ad14ca9c44 [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh 2021-10-11 21:03:19 +00:00
Aaron Son 812c5fccd8 go/store/datas: Ref the parents_closure Map, instead of storing it inline. 2021-10-11 13:57:30 -07:00