Commit Graph

495 Commits

Author SHA1 Message Date
Daylon Wilkins 1ee14d9f74 Add support for table-level collations 2022-08-26 08:10:44 -07:00
Andy Arthur 41a00a47e9 added integration test for TEXT, BLOB coersion 2022-08-23 18:13:46 -07:00
Andy Arthur 7e92878989 added integration tests for migration, schema 2022-08-23 17:34:02 -07:00
Andy Arthur 249b84e262 first pass at TEXT/BLOB -> VARCHAR/VARBINARY conversion 2022-08-23 17:34:02 -07:00
Aaron Son 0ff751a2f5 Merge remote-tracking branch 'origin/main' into aaron/fb-error-on-new-fields 2022-08-23 12:06:20 -07:00
Dhruv Sringari 9758e697c8 Allows diff to be performed across primary key renames (#4156)
* allow diff across pk renames

* pr comments
2022-08-22 14:58:55 -07:00
Aaron Son e16975e50c Merge remote-tracking branch 'origin/main' into aaron/fb-error-on-new-fields 2022-08-16 12:06:40 -07:00
Aaron Son 7906c9e98f go/{store,libraries,gen}: Adopt new flatc, throw an error if we encounter unknown fields. 2022-08-16 11:57:14 -07:00
Andy Arthur ede501b515 added failure messages to new format assertions 2022-08-15 16:42:33 -07:00
Daylon Wilkins 1d390d30d9 Added Real Collation Support 2022-08-12 12:55:06 -07:00
Andy Arthur 42f0d87bf4 cleanup lingering reference to __DOLT_1__ 2022-08-11 09:56:16 -07:00
AndyA 06e04abe22 Merge pull request #4047 from dolthub/andy/safe-format
[no-release-notes] Update NomsBinFormat string to `__DOLT__` to differentiate from alpha formats
2022-08-10 16:11:26 -07:00
Dhruv Sringari 15108c7d07 fix for #4037 (#4049)
The ordering of the primary key columns in returned by Schema.GetAllCols() should not determine diffability.

If and only if the primary key tags, their relative ordering, and their types (in the new format) are equal, two schemas are diffable.

Schema.GetPkCols() always returns the columns in ordinal order.
2022-08-10 15:32:27 -07:00
Andy Arthur 7a70fe1856 cleanup remaining references to __DOLT_1__ 2022-08-09 15:34:10 -07:00
Andy Arthur 967cf6ae79 remove __DOLT_1__ in favor of __DOLT__ 2022-08-09 14:44:26 -07:00
Dhruv Sringari 8bc8b3c87a When modifying a column, don't seed the new column tag with the old NomsKind (#3960)
* when modifying a column, don't seed the new column tag with the old NomsKind

* pr comments
2022-08-01 16:19:37 -07:00
Aaron Son 5fcd3ccee4 go/store/prolly/message: Move MessagePrefixSz, FinishMessage to serial package. 2022-07-22 14:16:34 -07:00
Aaron Son 4f3f4e17af go/store/types: SerialMessage: Unify TupleRowStorage and SerialMessage.
Get rid of TupleRowStorage and use SerialMessage everywhere. In turn, change
SerialMessage so that it carries its kind and size prefix as part of itself.
2022-07-22 11:56:48 -07:00
AndyA e603f5f488 Merge pull request #3863 from dolthub/andy/rip-out-super-schema
[no-release-notes] Stop reading/writing super schema
2022-07-20 10:25:20 -07:00
Dhruv Sringari 2cf9a2134f [no-release-notes] In __DOLT_1__, throw error if schemas have different primary key types (#3852)
* In __DOLT_1__, throw error if schemas have different primary key types

* [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh

* schema integration test fix

* [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh

* Compare SQL types

Co-authored-by: druvv <druvv@users.noreply.github.com>
2022-07-19 16:59:12 -07:00
Andy Arthur df99c228b2 stop reading/writing super schema 2022-07-19 14:02:32 -07:00
Dustin Brown 369508bee2 [auto-bump] [no-release-notes] Unskip foreign-keys-invert-pk.bats for new format (#3847)
* [ga-bump-dep] Bump dependency in Dolt by druvv

* Unskip foreign-keys-invert-pk.bats for new format

* pr comment

* fix pkToIdxMap

Co-authored-by: druvv <dhruvy427@gmail.com>
Co-authored-by: Dhruv Sringari <dhruv@dolthub.com>
2022-07-19 08:46:55 -07:00
Dhruv Sringari 14899d2909 Drop support for deleting conflicts through cli and add cardinality column for keyless table conflicts (#3777)
* reimplement dolt_transaction_merge_stomp at merge layer


add idx

* [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh

* fix tests

* remove stomp conflicts

* conflict reader must be reset each time PartitionRows is called

* reimplement dolt conflict resolve --theirs|--ours through sql path

Also drops manual conflict resolving through cli

* add cardinality columns to dolt_conflicts_table_name for keyless tables

* Adds keyless conflict deleting for new format

* dolt conflicts resolve sql impl for keyless tables

* [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh

* delete cli.ParseKeyValues

* fix tests

* temporarily allow dolt_docs to be mutated from SQL path

Because conflicts resolve uses the SQL path, dolt_docs needs to be editable.

* fix untested code, comment out docs tests

* bats

* fix a couple found merge bugs

* [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh

* if statements...

* add comments

Co-authored-by: druvv <druvv@users.noreply.github.com>
2022-07-12 17:34:20 -07:00
Maximilian Hoffman 6ca943a9a9 GMS type simplifications (#3757)
* gms bump

* add bound checks

* last PR reverted go.mod accidentally
2022-07-06 11:01:10 -07:00
Aaron Son 855895f378 Merge pull request #3760 from dolthub/aaron/no-shim-from-vrw-to-nodestore
[no-release-notes] go: Carry a NodeStore in DoltDB and datas.database, instead of shim'ing a new NodeStore from the VRW when we need one.
2022-07-06 09:18:07 -07:00
Aaron Son 829981ad64 doltdb: Remove some shims from VRW to NodeStore; carry NodeStores around. 2022-07-05 13:28:56 -07:00
Dhruv Sringari 1c0e7679d7 Adds our_diff_type and their_diff_type to dolt_conflicts_table_name (#3748)
* add our_diff_type and their_diff_type to dolt_conflicts_table_name

* pr comments

* [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh

Co-authored-by: druvv <druvv@users.noreply.github.com>
2022-07-05 12:11:23 -07:00
Daylon Wilkins 80e513cc4c Bump GMS to support collation IDs 2022-07-01 04:35:32 -07:00
Zach Musgrave 35446e675b Merge pull request #3644 from dolthub/zachmu/unskip-push
Reimplemented dolt diff command to use SQL queries
2022-06-29 09:29:32 -07:00
Maximilian Hoffman 91690bee18 [no-release-notes] text and json written as byte trees (#3690)
* persistable vars

* [no-release-notes] text and json types written as byte trees

* fmt

* more tests, fix other failing tests

* GMS bump

* fix remaining tests

* small fixes

* [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh

* bats failures

* revert

* [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh

* tidy

* update plans

* [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh

* more plan changes

* delete todo

* better docstring

* zach comments

Co-authored-by: max-hoffman <max-hoffman@users.noreply.github.com>
2022-06-29 07:37:35 -07:00
Zach Musgrave bf7734d3d5 Merge branch 'main' into zachmu/unskip-push 2022-06-27 17:31:45 -07:00
AndyA 6aa52a6858 Merge pull request #3628 from dolthub/andy/dolt-dev-schema-encoding
[no-release-notes] `__DOLT_DEV__` schema encoding
2022-06-24 10:55:09 -07:00
Zach Musgrave 5425b79a61 merge main 2022-06-24 09:56:53 -07:00
Maximilian Hoffman ac80ba7770 New format blobs (#3588)
* [no-release-notes] New format blob read/write

Use blob chunker to write blobs out of band. Tests for
round tripping and address walking at the tree level.
Run Blob enginetests and extra large file blob tests.

* NodeStore ref refactors

* fix index

* run verify

* fix more bats

* small PR cleanup

* more changes

* last bats errors
2022-06-22 18:02:48 -07:00
Zach Musgrave 1578db71e9 bug fix: tables are comparable if one is empty, in either direction 2022-06-21 12:22:36 -07:00
Zach Musgrave 3bff8a7867 Small bug fixes for schema methods with nil schemas 2022-06-21 09:30:03 -07:00
Zach Musgrave 044ff2747e Merge main 2022-06-17 15:53:15 -07:00
Andy Arthur c8393ea469 initialize objects consistently 2022-06-17 13:25:58 -07:00
Andy Arthur 4891d338c9 be less paranoid deserialized flatbuffer schema messages 2022-06-17 10:38:43 -07:00
Andy Arthur 02c5770f7d add caching for flatbuffers schema schemas 2022-06-16 14:45:30 -07:00
Andy Arthur 8a61f7ffac fix schema marshalling test 2022-06-16 10:28:57 -07:00
Andy Arthur ca1c7fa5ee replaced uses of types.UUID with types.InlineBlob, and replace types.Bool with types.Int 2022-06-16 09:39:22 -07:00
Andy Arthur 0081db96dc use flatbuffers serialization for __DOLT_DEV__ schemas 2022-06-16 09:39:22 -07:00
Andy Arthur 89063964cc fix schema marshalling test 2022-06-15 16:34:49 -07:00
Andy Arthur 3022ffc91d cleanup 2022-06-15 15:57:12 -07:00
Andy Arthur cfc8158f55 populating clustered index field for keyless schemas 2022-06-15 15:24:19 -07:00
Andy Arthur 8bb79d0831 roundtrip SRID, revert __DOLT_DEV__ to Noms un/marshalling 2022-06-15 12:54:33 -07:00
Andy Arthur 174f5601a0 added serial encodings, handling keyless schemas 2022-06-15 12:54:33 -07:00
Andy Arthur 380d39651f added integration tests for schema/encoding 2022-06-15 12:54:33 -07:00
Andy Arthur 73c9810984 iterating on schema encoding, added checks and secondary indexes 2022-06-15 12:54:33 -07:00