Commit Graph

35 Commits

Author SHA1 Message Date
Maximilian Hoffman
6f61ac5a08 [store] row length guards for prolly serial messages (#7533)
* Add row length guards

* tidy

* bump

* more check to integrator

* default panic

* comments

* bump

* better names

* more edits

* merge main

* [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh

* smaller default noms string type

* bats tests valid row lengths

* more tests

* more row len tests

* [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh

---------

Co-authored-by: max-hoffman <max-hoffman@users.noreply.github.com>
2024-02-26 17:46:59 -08:00
Andy Arthur
a7ff41c526 go/store/val: improve doc comments, remove todos 2023-05-11 15:24:27 -07:00
Andy Arthur
c91f4ec04f go: factored out common patterns for index key conversion, uniq key validation 2023-04-12 16:46:41 -07:00
Andy Arthur
98fff90f25 go/store/val: add TuplePrefix and TupleSuffix functions 2023-04-11 13:59:39 -07:00
Dhruv Sringari
00ae8c0808 Trim trailing nil fields from tuples (#4316)
* skip diffs caused by short tuples

* fix tests

* last fix

* trim null suffixes of val.Tuple's

* fix

* [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh

Co-authored-by: druvv <druvv@users.noreply.github.com>
2022-09-13 17:07:38 -07:00
Andy Arthur
8dc1322a72 refactor val.SlicedBuffer as message.ItemArray 2022-07-28 13:29:15 -07:00
Andy Arthur
9dc8425519 remove Addr field from val.TupleDescriptor, cleanup chunk address types in pkg val 2022-07-18 15:18:06 -07:00
Dhruv Sringari
d2d0864391 [no-release-notes] keyless diff for the new format (#3817)
* keyless diff for the new format

* [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh

* pr comment

Co-authored-by: druvv <druvv@users.noreply.github.com>
2022-07-13 14:42:43 -07:00
Zach Musgrave
5425b79a61 merge main 2022-06-24 09:56:53 -07:00
Maximilian Hoffman
ac80ba7770 New format blobs (#3588)
* [no-release-notes] New format blob read/write

Use blob chunker to write blobs out of band. Tests for
round tripping and address walking at the tree level.
Run Blob enginetests and extra large file blob tests.

* NodeStore ref refactors

* fix index

* run verify

* fix more bats

* small PR cleanup

* more changes

* last bats errors
2022-06-22 18:02:48 -07:00
Andy Arthur
3dffd113a0 added diff summary for prolly maps 2022-06-22 16:15:39 -07:00
Andy Arthur
f848a963a1 fix chunker overwrite for keyless tables, add valuestore validate to enginetests 2022-05-23 15:51:29 -07:00
Andy Arthur
b55b5cfa59 added write path for keyless tables 2022-04-20 14:57:09 -07:00
Andy Arthur
5032b6e4dc reverted prefetching, fixed tuple get field, refactored node cursor comparison 2022-02-22 09:08:58 -08:00
Andy Arthur
70db74d314 inlined sliced buffer get field 2022-02-21 16:55:02 -08:00
Andy Arthur
daa6256ede fixed edge case for get many slices 2022-02-21 15:08:57 -08:00
Andy Arthur
c4a13539ff updated comments 2022-02-21 11:16:56 -08:00
Andy Arthur
b0dab2cf79 refactored sliceManyFields 2022-02-21 11:10:38 -08:00
Andy Arthur
f1afe89743 added GetManyFields method to tuple 2022-02-18 15:35:12 -08:00
Andy Arthur
b0c12ba391 remove null bitmask from tuple 2022-02-18 14:15:01 -08:00
Andy Arthur
ffd3b41762 attempt to improve tuple access inlining 2022-02-18 08:15:50 -08:00
Andy Arthur
10cfe95c93 refactored Node to use SlicedBuffer 2022-02-10 14:36:09 -08:00
Andy Arthur
d621537191 refactored offsets array to slicedBuffer 2022-02-09 17:32:00 -08:00
Andy Arthur
553762ee14 made codec functions pkg private 2022-02-09 17:05:25 -08:00
Andy Arthur
2fad103f8e cleanup 2022-02-06 12:03:31 -08:00
Andy Arthur
f3faeb854c added index lookup row iter for new format 2022-01-31 15:01:34 -08:00
Andy Arthur
71fa7a3600 a few more enginetests passing 2022-01-31 15:01:28 -08:00
Andy Arthur
a729a63f76 first pass at secondary indexes 2022-01-31 15:00:45 -08:00
Andy Arthur
c80067d256 fixed failing niltable tests 2022-01-19 15:50:41 -08:00
Andy Arthur
94b92a983f broke off prolly pkg from research branch 2021-11-05 13:00:53 -07:00
AndyA
7da53a3a7d Update go/store/val/tuple.go
Co-authored-by: Brian Hendriks <brian@dolthub.com>
2021-11-03 13:45:11 -07:00
Andy Arthur
c25a4f9381 aaron's feedback, cleanup 2021-11-03 11:14:18 -07:00
Andy Arthur
1b498ebb83 fix typos 2021-11-02 17:16:05 -07:00
Andy Arthur
ae2eb6800f clean up 2021-11-02 16:56:06 -07:00
Andy Arthur
e70e5f846a broke off pkgs val and pool from research branch 2021-11-02 16:30:14 -07:00