Commit Graph

203 Commits

Author SHA1 Message Date
Daylon Wilkins 1ee14d9f74 Add support for table-level collations 2022-08-26 08:10:44 -07:00
Zach Musgrave 4a5c568d08 More renaming, consolidating interfaces 2022-08-23 11:34:55 -07:00
Zach Musgrave b05235dae8 Fleshing out table diff writer interface and its needs, did some renaming of related interfaces 2022-08-23 10:26:49 -07:00
Vinai Rachakonda 1f119ef0d0 Integrate update ignore with gms (#3973) 2022-08-02 16:30:18 -07:00
Maximilian Hoffman 9dae75ed7d Better read only error messages (#3920)
* Better read only error messages

* GMS bump

* block table import for server lock
2022-07-25 18:02:14 -07:00
James Cor fc28171ddc best I got 2022-07-13 12:38:21 -07:00
James Cor 0c0216859f the best of both works...probably 2022-07-11 16:40:53 -07:00
James Cor 90137d5a2e replacing DoltEnvAsMultiEnv with MultiEnvForDirectory 2022-07-11 10:47:29 -07:00
James Cor 769e9f929d removing LoadMultiEnvFromDir and adding extra param to DoltEnvAsMultiDir 2022-07-11 09:40:16 -07:00
Maximilian Hoffman d5ec4382a6 Only rebase transaction start for read replica (#3722)
* Only rebase transaction start for read replica

* [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh

* missed var names

* another var name

* [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh

* server lock file

* put serverLockFile in dsess

* better multiEnv locking

* more doc comments

* zach's comments

Co-authored-by: max-hoffman <max-hoffman@users.noreply.github.com>
2022-07-01 17:02:09 -07:00
Vinai Rachakonda 36a921aca7 Add bulk export parameters to dump (#3620) 2022-06-17 16:27:34 -04:00
Vinai Rachakonda a4e28fa5b5 Support the bulk edit accumulator for dolt table import (#3591) 2022-06-14 13:28:23 -04:00
James Cor 91a4bfbe7b privilege file argument 2022-06-07 16:32:42 -07:00
James Cor 0bccc9c6a5 adding a config struct 2022-06-06 11:41:21 -07:00
James Cor 83b47ce74b merge and adding default file path 2022-05-24 14:51:05 -07:00
James Cor 617b0ed0cd more missing clients 2022-05-19 15:38:08 -07:00
James Cor 40919822d7 consolidated logic 2022-05-19 14:19:03 -07:00
Vinai Rachakonda c11db5a55b Make import work with FKs and add disableFks check (#3412) 2022-05-17 14:11:30 -04:00
Aaron Son afab5f544c doltdb: Commit: Store a *datas.Commit intsead of rootV, CommitMeta, stref, etc. 2022-04-04 13:26:01 -07:00
Maximilian Hoffman 65ed7401bc GMS bump for transform refactor (#3128)
* GMS bump for transform refactor

* [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh

* bump GMS

* bump GMS

Co-authored-by: max-hoffman <max-hoffman@users.noreply.github.com>
2022-04-01 15:36:44 -07:00
Maximilian Hoffman 2049664ff9 Simplify RebuildIndex (#3053)
* Simplify RebuildIndex

Two improvements with index rewriting:

1) Brian's `TupleFactory` optimizations were being skipped, and 70% of
the runtime was spent building `newBinaryNomsWriter` instances for tuple
construction. Removing this restores index inserts as the only memory
pressure.

2) Brian's `BulkEditAccumulator` lets the final Map sort skip
work materializing intermediate prolly trees.

On a 2000 row table, fix (1) reduces the runtime by 50% (80ms -> 40ms),
and fix (2) reduces the runtime by another 40% (40ms -> 10ms)%, for a
cumulative ~90% improvement.

* fixes
2022-03-22 07:07:45 -07:00
Vinai Rachakonda 99b0028b6d Escape the given tablename in the engine_table_reader (#2958) 2022-03-11 11:15:45 -08:00
James Cor aa8b613631 Merge pull request #2912 from dolthub/james/dump-batch
SQL dump now has `--batch` option for batched `INSERTS`
2022-03-07 12:16:06 -08:00
James Cor 06892bb6ce removing nil row at end 2022-03-07 11:24:33 -08:00
Vinai Rachakonda 6b13ae0a61 Edit Stats display in Import and fix stats computation (#2901) 2022-03-05 18:55:41 -08:00
James Cor cb86c2bfed fixing test 2022-03-03 15:53:41 -08:00
James Cor 517eb2bb56 fixing tests 2022-03-03 15:35:38 -08:00
James Cor 22ce2a26bc moving option inside of datamover 2022-03-03 13:40:04 -08:00
James Cor e492b543e8 fixing test 2022-03-02 14:56:10 -08:00
James Cor 5f81928b96 working, probably 2022-03-02 14:49:54 -08:00
James Cor 165b10928c compiles 2022-03-02 14:06:19 -08:00
James Cor 88b6a6f197 working for sql format; not sure if i need any other formats 2022-03-01 15:42:33 -08:00
Daylon Wilkins f54d64f87a Added interface methods 2022-02-15 07:06:10 -08:00
Zach Musgrave bdd769960f Added new param to sql.RowIterToRows 2022-02-07 16:03:58 -08:00
Daylon Wilkins 9a38087ee6 Updated GMS and updated interface changes 2022-01-24 06:53:23 -08:00
Vinai Rachakonda ccfd213e58 Simplify dolt dump to use the sql engine and purge old data mover code (#2572) 2022-01-14 14:20:56 -08:00
Vinai Rachakonda 7637e2028f Rewrite portion of the import path to better support partials (#2601) 2022-01-12 18:12:40 -08:00
Andy Arthur 6c74aaa651 reverting import shuffles 2022-01-04 16:18:01 -08:00
Andy Arthur c56a658440 moved write session, sessioned table editor to sqle/writer 2021-12-17 15:42:29 -08:00
Aaron Son 034d49629c Bump GMS, pick up ctx parameter for RowIter.Next(). 2021-12-16 15:00:18 -08:00
Vinai Rachakonda 54cc1d5f1e Refactor the Export path to read from the engine (#2495) 2021-12-14 12:02:18 -08:00
Maximilian Hoffman 0cbd7e780c Async push for replication (#2369)
* starter code

* async replication prototype

* benchmark async push

* [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh

* delete hanging line

* add comment for concurrent map access

* move replication into databaseProvider

* top-level wait group for async threads

* fix testsg

* standardize wg format

* missing header

* address data race

* make async test shorter

* delete unnecessary lines

* starter code for new sqlEngine interface

* new engine interface with background threads

* brian's comments

* [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh

* missed a datarace

* fix bats

* bad go.sum

* add latest GMS commit

* bump GMS

Co-authored-by: max-hoffman <max-hoffman@users.noreply.github.com>
2021-12-11 13:41:58 -08:00
Vinai Rachakonda 473910158f Need to fix sqlCtx uses 2021-12-09 22:33:37 -08:00
Vinai Rachakonda 2172fd7401 nits and export method for ld 2021-12-09 22:19:15 -08:00
Andy Arthur 791365a7c0 first cleanup pass 2021-12-09 16:06:37 -08:00
James Cor c4c8ac3c11 Merge pull request #2443 from dolthub/james/fix-2442-read-only-flag-test
stop ignoring read_only flag
2021-12-07 14:29:53 -08:00
Maximilian Hoffman 5976e99c52 default PrimaryKeySchema, maintain primary key ordinals (#2446)
Use `sql.PrimaryKeySchema` in Dolt for PK ordered indexes. Applies to Table and Foreign Key indexes. Column mutation tracks PK Ordinal changes.
2021-12-03 15:56:33 -08:00
Dustin Brown 70bd56e534 /go/{cmd,libraries}: run format script 2021-12-01 13:37:02 -08:00
James Cor 288862540e changed NewSqlEngine to take in auth instead of always assuming auth.None 2021-12-01 11:56:34 -08:00
jennifersp 3741bec499 fix merge conflict 2021-11-29 11:23:06 -08:00