Commit Graph

80 Commits

Author SHA1 Message Date
Aaron Son
7906c9e98f go/{store,libraries,gen}: Adopt new flatc, throw an error if we encounter unknown fields. 2022-08-16 11:57:14 -07:00
coffeegoddd
b68814c796 [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh 2022-08-05 17:21:26 +00:00
Aaron Son
5fcd3ccee4 go/store/prolly/message: Move MessagePrefixSz, FinishMessage to serial package. 2022-07-22 14:16:34 -07:00
Aaron Son
4f3f4e17af go/store/types: SerialMessage: Unify TupleRowStorage and SerialMessage.
Get rid of TupleRowStorage and use SerialMessage everywhere. In turn, change
SerialMessage so that it carries its kind and size prefix as part of itself.
2022-07-22 11:56:48 -07:00
Aaron Son
642f2e0ba7 go: More migration away from shim into NodeStore. 2022-07-05 14:16:36 -07:00
Maximilian Hoffman
ac80ba7770 New format blobs (#3588)
* [no-release-notes] New format blob read/write

Use blob chunker to write blobs out of band. Tests for
round tripping and address walking at the tree level.
Run Blob enginetests and extra large file blob tests.

* NodeStore ref refactors

* fix index

* run verify

* fix more bats

* small PR cleanup

* more changes

* last bats errors
2022-06-22 18:02:48 -07:00
Aaron Son
44e2991e04 go/store/datas: commit_closure: ByteStringEnc -> AddressEnc. 2022-06-14 09:09:13 -07:00
Aaron Son
e934040b25 go/store/datas: Small cleanup of code location and some function names for commit closures. 2022-06-13 14:41:25 -07:00
Aaron Son
7a734ccddb go/store/prolly: Add the ability to iterate a Map backwards from the end. 2022-06-09 16:37:58 -07:00
Aaron Son
c2a1b7c5a6 go/store/datas: Small cleanup for val.TupleDesc handling. 2022-06-09 14:43:22 -07:00
Aaron Son
115d218641 go/store/datas: repoformat. 2022-06-09 14:28:49 -07:00
Aaron Son
f3c19bce4e go/store/datas: Get TestCommitParentsClosure passing with DOLT_DEV. 2022-06-09 14:27:56 -07:00
Aaron Son
0679417dd4 go/store/datas: commit.go: First pass at writing a parents closure prolly.Map. 2022-06-09 12:01:47 -07:00
Aaron Son
0d25806b38 go/{store/datas,libraries/doltcore/doltdb/durable}: Move __DOLT_1__ format to flatbuffers top-of-DAG. 2022-05-05 12:48:58 -07:00
Aaron Son
ee8f41aa65 go/store/types: SerialCommitParentRefs -> SerialCommitParentAddrs. 2022-05-03 10:26:27 -07:00
Aaron Son
11090d90bd go/store/datas: Make some stuff package private. 2022-04-27 15:48:39 -07:00
Aaron Son
de2fcbad6a .github: Add __DOLT_DEV__ testing to GitHub CI. 2022-04-05 11:45:38 -07:00
reltuk
175341feeb [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh 2022-04-04 20:36:29 +00:00
Aaron Son
5b1957029e go/serial: commit.fbs: Remove ref heights from commit storage. Skip and fix store/cmd tests to pass with Format_DOLT_DEV. 2022-04-04 13:26:01 -07:00
Aaron Son
575b70615e go/store/datas: CommitForValue, LoadCommitAddr. 2022-04-04 13:26:01 -07:00
Aaron Son
7bc6d4ac89 go/store/datas: NewCommitForValue: Returns *Commit. 2022-04-04 13:26:01 -07:00
Aaron Son
f95b38eaa9 go/store/datas: FindCommonAncestor takes *Commit parameters. LoadCommitRef exported. 2022-04-04 13:26:01 -07:00
Aaron Son
8f4cb102db go/store/datas: GetCommitParents: Make parent walks work on commit structs/messages, not Refs. Step towards removing heights from message refs. 2022-04-04 13:26:01 -07:00
Aaron Son
be27368901 go/store/datas: GetCommitValue -> GetCommittedValue. 2022-04-04 13:26:01 -07:00
Aaron Son
d69ac33738 go/store/datas: FindCommonAncestor returns addr, not Ref. 2022-04-04 13:26:01 -07:00
Aaron Son
7b1406ccce Revert "Revert "Merge pull request #3077 from dolthub/aaron/datas-commit-as-fb-message""
This reverts commit ee68e00000.
2022-03-29 11:09:54 -07:00
Aaron Son
ee68e00000 Revert "Merge pull request #3077 from dolthub/aaron/datas-commit-as-fb-message"
This reverts commit 87bf948031, reversing
changes made to b9e2348472.
2022-03-28 17:40:09 -07:00
Aaron Son
d5faf42418 repoformat. 2022-03-23 14:57:18 -07:00
Aaron Son
ce1dee71ce store/datas: __DOLT_DEV__ format serializes commits as flatbuffer messages. 2022-03-23 14:07:56 -07:00
Aaron Son
28e0aa9796 go/store/datas: Iterator on commit_flatbuffer. 2022-03-22 10:29:17 -07:00
Aaron Son
35aafdf82d go/store/datas: Make the names of commit struct fields package private. 2022-03-17 16:22:00 -07:00
Aaron Son
b67c7ca41f store/datas,doltdb: Convert some Commit accesses to go through types.Value instead of types.Struct. 2022-03-17 14:05:41 -07:00
Aaron Son
d3dcafa57f go/store/datas: NewCommitForValue returns types.Value. 2022-03-17 10:38:23 -07:00
Aaron Son
be075c7cfb store/datas/commit.go: Fix unreachable code. 2022-03-17 09:30:00 -07:00
Aaron Son
39f571d17e go: doltdb: Remove commitSt field from Commit. 2022-03-16 16:40:26 -07:00
Aaron Son
94d141a0bd store/datas: GetCommitMeta accessor. 2022-03-16 16:40:26 -07:00
Aaron Son
be9df59968 store/datas: Add GetCommitParents accessor. 2022-03-16 16:40:26 -07:00
Aaron Son
d980fa15ca go/store/datas: Remove many uses of MaybeHeadRef. 2022-03-16 16:40:26 -07:00
Aaron Son
c4b74b8878 store/datas: CommitOptions: Remove types references. 2022-03-10 13:52:08 -08:00
Aaron Son
7e5326081f go/store/datas: Remove CommitDangling. 2022-02-02 15:07:13 -08:00
Aaron Son
ec014823a5 go/store/datas: Move around some Ref creation in doCommit. 2022-02-02 10:22:13 -08:00
Aaron Son
459d98defe Add a TODO to seek in FindCommonAncestor implementation. 2021-10-12 15:39:49 -07:00
Aaron Son
dd5161f79b go/store/datas: Encapsulate some iterator logic for FindCommonAncestors in a struct. 2021-10-12 10:40:27 -07:00
Aaron Son
8cece700e8 go/store/datas: First pass at implementing FindCommonAncestor when parents_closure is present. 2021-10-12 09:40:55 -07:00
Aaron Son
812c5fccd8 go/store/datas: Ref the parents_closure Map, instead of storing it inline. 2021-10-11 13:57:30 -07:00
Aaron Son
90061c2fd9 go/store/datas: Implement getParentsClosure to materialize the parents closure. 2021-10-08 10:07:54 -07:00
Aaron Son
646c91d093 go/store/datas: Add parents_closure to commit struct. 2021-10-08 10:07:54 -07:00
Aaron Son
17dc3e72c3 store/datas: NewCommit -> newCommit, start threading parentsSkipList parameter through.
store/datas: Add ability to store parents_skip_list field to Commit Struct.
2021-10-08 10:07:54 -07:00
Andy Arthur
9cdfc0e639 doc comments 2021-08-01 20:22:40 -07:00
Andy Arthur
61d09f56a9 added lazy ref closure 2021-07-31 11:15:31 -07:00