Commit Graph

31 Commits

Author SHA1 Message Date
Maximilian Hoffman b4c5ccf461 Skip filter iter, with more test fixes (#8288)
* Revert "Revert "Skip filterIter match check when a key range is contiguous (#8242)""

This reverts commit 277c1d7d8b.

* fix string matching bug, test added in GMS#2639

* Better comment
2024-08-21 13:13:07 -07:00
Daylon Wilkins 277c1d7d8b Revert "Skip filterIter match check when a key range is contiguous (#8242)"
This reverts commit c33943f6b8.
2024-08-16 04:26:58 -07:00
Maximilian Hoffman c33943f6b8 Skip filterIter match check when a key range is contiguous (#8242)
* Skip filterIter match check when a key range is contiguous

* [skip actions] [ga-update-correctness] SQL Correctness updated to 99.960017

* certain encodings are imperfectly serialized, still need range.Matches check

* better comments

* inline contigous check

* [skip actions] [ga-update-correctness] SQL Correctness updated to 100

* bad default value

* [skip actions] [ga-update-correctness] SQL Correctness updated to 99.991949

* fix nil test (added in GMS 2630)

* [skip actions] [ga-update-correctness] SQL Correctness updated to 100

* zach comments

---------

Co-authored-by: coffeegoddd <coffeegoddd@users.noreply.github.com>
2024-08-13 17:20:58 -07:00
Maximilian Hoffman 81e45ba5c4 enable key range iter (#8084) 2024-07-18 16:36:25 -07:00
Daylon Wilkins e14c64baf6 Fixed keyless secondary indexing for Doltgres 2024-06-27 03:21:26 -07:00
Maximilian Hoffman fd67b0aeba Revert "[prolly] filteredIter optimization for exact prefix ranges (#7966)" (#8024)
This reverts commit 6ae4251c9d.
2024-06-13 17:19:50 -07:00
Maximilian Hoffman 6ae4251c9d [prolly] filteredIter optimization for exact prefix ranges (#7966)
* [prolly] filteredIter optimization for exact prefix ranges

* [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh

* strings and more correct

* [skip actions] [ga-update-correctness] SQL Correctness updated to 99.99936

* bug

* fix tests

* [skip actions] [ga-update-correctness] SQL Correctness updated to 100

* more test fixes

* docstrings

* renamings

* fulltext bug

* clearer names and docstings

* fix tests

---------

Co-authored-by: max-hoffman <max-hoffman@users.noreply.github.com>
Co-authored-by: coffeegoddd <coffeegoddd@users.noreply.github.com>
2024-06-11 14:26:43 -07:00
Daylon Wilkins 36efa2c8b5 Added storage capabilities for GMS Extended Types 2024-02-07 05:35:35 -08:00
Nick Tobey 60ccfec068 Propagate considerAllRowsModified to more relevant places, and add more meaningful comments and todos. 2023-11-28 12:48:08 -08:00
Nick Tobey 09d8c9db47 Propagate considerAllRowsModified to more relevant places, and add more meaningful comments and todos. 2023-11-28 12:21:03 -08:00
Jason Fulghum bd644b8774 Bug fix for panic in schema merge when schema contains BLOB columns 2023-08-15 13:39:10 -07:00
James Cor 4210d58ff2 pass along index sorting 2023-05-01 16:19:43 -07:00
Andy Arthur 98fff90f25 go/store/val: add TuplePrefix and TupleSuffix functions 2023-04-11 13:59:39 -07:00
Maximilian Hoffman b86b2b2011 Fix point lookup bug w/ prefix matching secondary (#5670)
* Fix point lookup bug w/ prefix matching secondary

* docstring
2023-04-03 11:39:44 -07:00
Maximilian Hoffman af987d213c Three way differ and merge optimizations (#5464)
* add three way differ for merge optimizations

* [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh

* docstrings

* prog

* [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh

* fix tests

* format

* more test fixes

* rewrite chunk of table merge, still need to rewrite unique lookup checking

* [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh

* more test fixes

* [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh

* test

* [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh

* fix tests

* batching test

* larger buffer for secondary mutableMap

* [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh

* refactor, fix buffer sizing

* fix more tests

* [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh

* restore proto

* sort unique checks by secondary

* [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh

* fix keyless pk len

* fmt

* revert edits

* merge conflicts

* merge conflict

---------

Co-authored-by: max-hoffman <max-hoffman@users.noreply.github.com>
2023-03-14 14:37:11 -07:00
Andy Arthur 31d4365ea1 go/store/prolly: revert deleted prolly.Map.IterKeyRange() 2023-03-13 10:29:06 -07:00
Andy Arthur 3eb8616bf9 go/store/prolly: add Map.HasPrefix to speedup FK checks on merge 2023-03-10 12:27:27 -08:00
Andy Arthur eb8a17a63b go/store/prolly: fix EOF handling for Map.HasRange 2023-03-10 08:10:26 -08:00
Andy Arthur 22ac8c0d6f go/store/prolly: update tests 2023-03-09 19:32:59 -08:00
Andy Arthur d3e0c4d378 go/store/prolly/tree: make node cursor pkg private 2023-03-09 17:27:18 -08:00
Taylor Bantle be862d796c Rename dolt diff --summary to dolt diff --stat, remove some unused code 2023-02-22 13:41:46 -08:00
Max Hoffman e2fa0bf30d starter 2023-01-28 20:18:29 -08:00
Andy Arthur 34b07fc21e go/store/prolly/tree: cleanup LaskKey() interface 2023-01-26 15:51:12 -08:00
coffeegoddd e0b8c3c69f /go/store/prolly/{tree, tuple_map.go}: some cleanup 2022-12-13 09:58:12 -08:00
coffeegoddd a1ecd44e81 /go/store/prolly: new format implementation of visit map level order 2022-12-12 11:39:04 -08:00
Dhruv Sringari d6a8cdeb57 Skip empty diffs caused by non-canonicalized tuples.
At one point, we started to trim null suffixes from tuples. In versions prior to this change,
tuples could have a null field at the end of the tuple. Now we always truncate the tuple.

If old versions insert rows with null values as the last column, it produces a tuple
that is longer than the tuple that would be inserted by the latest version. This leads to
empty diffs.
2022-11-15 12:55:11 -08:00
Dhruv Sringari 8c8f27d2ad Implement merge stats for the new format (#4384)
* Add prolly.MergeMapsWithStats

* don't use a callback to update merge stats

* thread merge stats through doltcore/merge
2022-09-21 10:55:49 -07:00
AndyA 8981c7e442 Merge pull request #4324 from dolthub/andy/svelt-node
go/store/prolly/{message, tree}: Reduce memory footprint of `message.ItemAccess`, `tree.Node`
2022-09-13 16:33:23 -07:00
Andy Arthur 05870038ae caching TreeLevel in tree.Node 2022-09-12 12:33:22 -07:00
Andy Arthur 7f9bd355fe converted prolly.MutableMap to pointer reciever, added periodic edit flushing 2022-09-09 13:58:35 -07:00
Andy Arthur 859f450fee cleanup 2022-09-08 14:45:16 -07:00