Commit Graph

153 Commits

Author SHA1 Message Date
Andy Arthur
b48df04c76 refactoring tests in preparation for format flip 2022-09-28 15:32:43 -07:00
Aaron Son
526b9a3429 proto,go: Add RepoPath field to remotesapi Request messages. Pass it along in remotestorage ChunkStore. 2022-09-15 10:50:37 -07:00
Dhruv Sringari
86972d9c1d Adds dolt_merge_status system table (#4277)
* Add dolt merge status table

* [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh

Co-authored-by: druvv <druvv@users.noreply.github.com>
2022-09-07 15:12:43 -07:00
JCOR11599
22144c7573 [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh 2022-09-06 06:24:30 +00:00
Aaron Son
85a46e39de proto/dolt/services/remotesapi/v1alpha1: Allow GetUploadLocs TableFileDetails to come with num_chunks. 2022-08-31 14:04:45 -07:00
Maximilian Hoffman
b5f95c648f Secondary lookup cursor reuse (#4215)
* fix tests

* Point lookups reuse cursors

* fmt

* delete commented lines

* fix ld index

* fix some bugs

* bugs

* fix lb caching between table mutations

* [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh

* delete irrelevent conditional

* aaron's comments

Co-authored-by: max-hoffman <max-hoffman@users.noreply.github.com>
2022-08-29 18:10:25 -07:00
Daylon Wilkins
1ee14d9f74 Add support for table-level collations 2022-08-26 08:10:44 -07:00
Aaron Son
6eb9e6c17d proto,go/.../remotestorage: Add repo_token support.
doltremoteapi can return an opaque token which makes it cheaper to access the
repository than just using the RepoId. This updates protos and remotestorage
implementation to cache that token and use it for future accesses of the same
repository.
2022-08-25 12:12:42 -07:00
Aaron Son
7906c9e98f go/{store,libraries,gen}: Adopt new flatc, throw an error if we encounter unknown fields. 2022-08-16 11:57:14 -07:00
Andy Arthur
e99fca7e7a created dedicated flatbuffer message for blobs 2022-07-26 13:14:16 -07:00
Andy Arthur
ede8deba4d Merge remote-tracking branch 'origin/main' into andy/merge-artifacts 2022-07-26 08:44:21 -07:00
Andy Arthur
9b9f5ea79b Merge remote-tracking branch 'origin/main' into andy/remove-dolt-1-super-schema 2022-07-25 15:23:39 -07:00
Aaron Son
5fcd3ccee4 go/store/prolly/message: Move MessagePrefixSz, FinishMessage to serial package. 2022-07-22 14:16:34 -07:00
Andy Arthur
ef47f7a222 Remove Super Schema field from RootValue flatbuffer schema 2022-07-21 15:28:25 -07:00
Andy Arthur
3a8bea8295 pr feedback 2022-07-20 11:22:39 -07:00
Andy Arthur
744e027ce3 de/serialize prolly.ArtifactsMap with dedicated message, serializer 2022-07-18 15:45:00 -07:00
Andy Arthur
5ac0c340a8 sketched out MergeArtifacts flatbuffer message 2022-07-18 13:49:02 -07:00
Maximilian Hoffman
91690bee18 [no-release-notes] text and json written as byte trees (#3690)
* persistable vars

* [no-release-notes] text and json types written as byte trees

* fmt

* more tests, fix other failing tests

* GMS bump

* fix remaining tests

* small fixes

* [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh

* bats failures

* revert

* [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh

* tidy

* update plans

* [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh

* more plan changes

* delete todo

* better docstring

* zach comments

Co-authored-by: max-hoffman <max-hoffman@users.noreply.github.com>
2022-06-29 07:37:35 -07:00
Maximilian Hoffman
ac80ba7770 New format blobs (#3588)
* [no-release-notes] New format blob read/write

Use blob chunker to write blobs out of band. Tests for
round tripping and address walking at the tree level.
Run Blob enginetests and extra large file blob tests.

* NodeStore ref refactors

* fix index

* run verify

* fix more bats

* small PR cleanup

* more changes

* last bats errors
2022-06-22 18:02:48 -07:00
Andy Arthur
c4331473ce added flatbuffers schema for ForeignKey, ForeignKeyCollection 2022-06-17 11:44:15 -07:00
Andy Arthur
b29f1d260f Merge remote-tracking branch 'origin/main' into andy/schema-encoding 2022-06-16 09:39:08 -07:00
Andy Arthur
cfc8158f55 populating clustered index field for keyless schemas 2022-06-15 15:24:19 -07:00
Aaron Son
ac3fc4168b go/store/prolly: Create a CommitClosure ordered tree. Use it in go/store/datas for the commit closure. 2022-06-15 15:18:46 -07:00
Andy Arthur
73c9810984 iterating on schema encoding, added checks and secondary indexes 2022-06-15 12:54:33 -07:00
Andy Arthur
b5e7d9fad2 roundtripping simple schemas 2022-06-15 12:54:33 -07:00
Andy Arthur
362c0976e8 modified schema.fbs with FileID and separate fields for sql_type, default_value, and comment 2022-06-15 12:53:42 -07:00
Dhruv Sringari
b1a972dd31 [no-release-notes] store conflicts in unified merge artifacts table (#3579)
* Add Hash160Enc

* persist and read conflicts from merge artifacts table

* update some tests

* [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh

* comment / cleanup prolly/artifact_map.go

* ~copyright~

* reskip TestDoltMerge

* rename Hash160Enc to Address

* change ArtifactType from string to uint8

* fix zero value for ArtifactType

Co-authored-by: druvv <druvv@users.noreply.github.com>
2022-06-09 13:07:47 -07:00
zachmu
000485bb3f [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh 2022-06-08 17:33:03 +00:00
Aaron Son
74bf8541d8 Merge remote-tracking branch 'origin/main' into aaron/datas-storeroot-uses-prolly-tree 2022-06-06 17:18:46 -07:00
jennifersp
2da4ba7457 add to client event type 2022-06-06 09:42:15 -07:00
Aaron Son
e6c42fdad1 go/serial: Remove unused RefMap. 2022-06-02 16:57:30 -07:00
Aaron Son
f292de1bcb go/libraries/doltcore/doltdb/durable: Convert index storage to be AddressMap instead of RefMap. 2022-06-02 16:51:03 -07:00
Aaron Son
ff43e93f65 go/libraries/doltcore/doltdb: root_val: Tables in AddressMap instead of RefMap. 2022-06-02 16:13:11 -07:00
Aaron Son
bad143cbcb go/store/datas: StoreRoot RefMap -> AddressMap. 2022-06-02 14:41:13 -07:00
Andy Arthur
22e9d301f4 pr feedback from Aaron 2022-06-01 12:04:57 -07:00
Andy Arthur
2b7ff514b1 Merge remote-tracking branch 'origin/main' into andy/schema-encoding 2022-05-31 14:53:55 -07:00
Andy Arthur
6e33deb621 first pass at schema schema 2022-05-25 14:30:28 -07:00
Andy Arthur
dde1d31fd0 added value encodings to flatbuffers schema 2022-05-25 13:55:12 -07:00
Andy Arthur
225f1f186f added unsafe string conversion for serial.GetFileID, refactored prolly/benchmark 2022-05-10 16:20:33 -07:00
Andy Arthur
f49fdf78ee comment doc, cleanup 2022-05-03 10:05:01 -07:00
Andy Arthur
0087c58d8c added address map serialization 2022-05-03 09:39:29 -07:00
Andy Arthur
68c796ff49 Merge remote-tracking branch 'origin/main' into andy/generic-prolly-node 2022-05-02 16:01:25 -07:00
Andy Arthur
63e666a2ba added file identifier for prolly nodes 2022-04-29 15:42:59 -07:00
Maximilian Hoffman
c300fb63cb [no-release-notes] fb-database deprecated by rootvalue (#3328) 2022-04-29 15:00:53 -07:00
Andy Arthur
c9bee38f9f added subtree_counts array to RefMap 2022-04-29 11:51:09 -07:00
Andy Arthur
7d0520a54e Merge branch 'main' into andy/refactor-prolly-message 2022-04-28 15:53:08 -07:00
Aaron Son
3b12c6b242 go/serial/workingset.fbs: Store MergeState inline a WorkingSet.
Until this point, __DOLT_DEV__ has left MergeState in the working set
as an address pointing at a types.Struct with the root value ref and
the from commit inlined. This converts MergeState to store the commit
as an address and to store both addrs inline the MergeState table.
2022-04-27 15:17:39 -07:00
Andy Arthur
9252d1c1f8 cleanup, refactor node walks 2022-04-27 15:09:10 -07:00
Andy Arthur
ef39be360e refactored prolly.fbs with new schema for ProllyTreeNode (TupleMap) message 2022-04-27 13:49:30 -07:00
Aaron Son
a91fabd59b go/libraries/doltcore/doltdb/durable: table: Make __DOLT_DEV__ IndexSet and Table implementations. 2022-04-22 13:05:51 -07:00