Commit Graph

133 Commits

Author SHA1 Message Date
Daylon Wilkins 1d33bde91b Reworked verify-constraints and renamed to constraints verify 2021-07-20 18:16:38 -07:00
Daylon Wilkins 8d971dcd35 Added fast forward handling and fleshed out constraint violation messages 2021-07-15 17:16:16 -07:00
Daylon Wilkins 6b2b68923b Further attempts to fix ACCESS_DENIED error on Windows 2021-07-15 13:26:59 -07:00
Zach Musgrave 475a6c4787 Merge pull request #1890 from dolthub/zachmu/tx-enabled
Enable SQL transactions by default, and begin writing working set to database instead of repo_state.json file
2021-07-06 18:12:47 -07:00
Brian Hendriks 88fd93e7cc Bh/push pull temptf (#1885) 2021-07-06 17:09:16 -07:00
Zach Musgrave e78ed3b263 Merge master 2021-07-04 09:30:24 -07:00
Brian Hendriks 86bd20a4cd dolt roots command (#1891) 2021-07-04 07:51:07 -07:00
Zach Musgrave d8dfd68383 Migrating workingset from existing repo state file on load 2021-06-23 17:33:40 -07:00
Aaron Son 9b763af5a6 libraries/utils/async/ring_buffer.go: PR feedback. Return error on epoch mismatch. 2021-03-24 15:45:58 -07:00
Aaron Son b77f2bad8c go/libraries/doltcore/sqle/async_indexed_lookups.go: Fix leaking of results from one index lookup to another.
When a query with an index lookup as a LIMIT, it's possible for the result
iterator to be closed before all the index results have been streamed. When
that happens, we can end up with queueRows goroutine which is enqueuing rows
into a ring buffer that is going to be used by a different query later.

This PR adds two mechanisms, one to stop the wrong results from being seen and
to cancel the unnecessary work.

1. RingBuffer gets an epoch, which is incremented on each Reset(). If a given
   Push does not match the current epoch, then nothing is added to the ring
   buffer.

2. queueRows is run with a cancelable (sub-)Context, and that Context is
   canceled when the corresponding iterator is Closed().
2021-03-24 14:11:09 -07:00
Brian Hendriks c8264ef610 add file copy helper method to iohelp package (#1403) 2021-03-09 16:46:50 -08:00
Brian Hendriks 04d189937e chunk store in a file no manifest needed (#1401) 2021-03-09 16:46:08 -08:00
Brian Hendriks 69de83a757 Fixed worker pool used for index lookups (#1304) 2021-02-16 17:28:20 -08:00
Aaron Son 2ed61f501f go/libraries/utils/tracing: Add pluggable context-aware Tracing function. 2021-01-07 11:59:18 -08:00
Aaron Son a1bf8b62fd repofmt: Hygiene. 2021-01-06 15:02:24 -08:00
Aaron Son a654f02e14 go/cmd/dolt: Add debugging flag to run with Jaeger span reporting to localhost.
This adds a --jaeger flag to dolt CLI which installs a Jaeger Tracer as the
global opentracing Tracer. The Tracer is configured to report to an HTTP
collector running on http://localhost:14268, which is the port that docker
image `jaegertracing/all-in-one` listens on.

Also adds some parameters in places where Dolt constructs sql.Contexts to pass
the correct Tracer through.

Also adds a few new Span points, in things like nbs.Get and
metaSequenceImpl.getChildSequence.
2021-01-06 14:50:06 -08:00
Andy Arthur b635b72e7b match keyless tables by column intersection, ddl diff bats 2020-12-17 11:54:00 -08:00
Brian Hendriks 602f0ae2c0 partition ranges, covering indexes, smarter iterators (#1116) 2020-12-15 18:44:57 -08:00
Brian Hendriks ffab301d8c PR feedback 2020-11-24 15:39:54 -08:00
Brian Hendriks d26d82065b Merge remote-tracking branch 'remotes/origin/master' into bh/pipelinev2 2020-11-05 11:43:18 -08:00
Brian Hendriks ea852be8b2 test fixes 2020-11-04 17:09:35 -08:00
Brian Hendriks 493713eec5 Merge remote-tracking branch 'remotes/origin/master' into bh/pipelinev2 2020-11-02 16:02:41 -08:00
Aaron Son 8f2414ee1e go/libraries/util/async/errgroup{,_test}.go: Update copyright headers for Dolthub. 2020-11-02 11:09:44 -08:00
Aaron Son eb96988abb Merge remote-tracking branch 'origin/master' into aaron/diff-summary-error-handling 2020-11-02 11:07:55 -08:00
Aaron Son 84c3066348 go/**/*.go: Update copyright headers for company name change. 2020-11-02 10:17:02 -08:00
Brian Hendriks 8ca5b603a6 tabular printing 2020-11-02 10:09:34 -08:00
Aaron Son 87f5333fa6 go/libraries/utils/async: Fix copyright headers in errgroup{,_test}.go 2020-11-02 10:03:14 -08:00
Aaron Son 3fef3fdaaf Merge remote-tracking branch 'origin/master' into aaron/diff-summary-error-handling 2020-11-02 08:40:20 -08:00
Aaron Son c8750708b7 go/libraries/utils/async: Have ActionExecutor use sync.WaitGroup. 2020-11-01 06:47:04 -08:00
Aaron Son 4fcae36a50 go/libraries/utils/async: Add small utility, GoWithCancel. 2020-10-31 08:29:15 -07:00
Brian Hendriks 45921566b8 Merge remote-tracking branch 'remotes/origin/master' into bh/pipelinev2 2020-10-29 16:23:21 -07:00
Brian Hendriks 3f2062e3cf tests and cleanup 2020-10-13 00:39:12 -07:00
Brian Hendriks 2fa739a368 cleanup 2020-10-12 18:11:31 -07:00
Brian Hendriks 13cd408a54 move more of sql to pipelinev2 2020-10-09 14:18:49 -07:00
Aaron Son 66a9b055ea go/go.mod: Adopt dolthub/fslock fork. Forked version uses Open(RDRW) for lock file on *nix, which works on NFS. 2020-10-09 13:10:42 -07:00
Brian Hendriks 3a59a1bdda pipeline v2 2020-10-08 13:57:02 -07:00
Daylon Wilkins b5bb663233 Reference new org name and updated trigger logic 2020-09-25 15:35:04 -07:00
Daylon Wilkins 7b852f47e6 Fixed ActionExecutor causing duplicate key error loop 2020-09-14 10:31:53 -07:00
Brian Hendriks d84fe9af41 add ReadAheadTableReader.go (#847) 2020-08-31 11:16:50 -07:00
Daylon Wilkins 2fa2b8fd63 Heavily improved SQL write performance 2020-06-02 17:45:00 -07:00
Brian Hendriks f250da8a15 Bh/remotes bat fixes (#701) 2020-05-29 10:22:28 -07:00
Andy Arthur a17914549d ugh parsing 2020-05-21 16:56:27 -05:00
Andy Arthur 7286431588 fixed help flag 2020-05-21 15:52:21 -05:00
Andy Arthur c52d3bdc54 repo fmt 2020-05-21 14:59:35 -05:00
Andy Arthur 48533f66e4 updated parsing 2020-05-21 14:43:59 -05:00
Andy Arthur b1cecda946 updated tests 2020-05-21 14:43:49 -05:00
Andy Arthur 85e94a2d7f better arg parsing 2020-05-20 18:16:34 -05:00
Andy Arthur 75b1044723 updated tests 2020-05-20 16:27:26 -05:00
Andy Arthur 544c10a13d reorganized schema import 2020-05-15 02:45:20 -07:00
Andy Arthur f6ddadaa63 first pass at schema inferrence with typeinfo 2020-05-13 10:18:31 -07:00