Commit Graph

181 Commits

Author SHA1 Message Date
Brian Hendriks
683b8d39b0 comments 2022-08-23 12:08:02 -07:00
Brian Hendriks
30722658b3 refactor 2022-08-23 11:40:27 -07:00
jennifersp
f42712b240 allow optional empty value for string value for arg parsing (#4093)
* arg value should allow optional empty value

* fix godocs
2022-08-15 20:05:44 -07:00
coffeegoddd
b68814c796 [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh 2022-08-05 17:21:26 +00:00
Andy Arthur
c811935149 close files in filesys.CopyFile 2022-07-28 20:08:05 -07:00
Andy Arthur
c95153ca6c added temp migration environment 2022-07-25 14:52:47 -07:00
Andy Arthur
226da75db3 added temp file method to utils/filesys 2022-07-25 14:52:47 -07:00
Taylor Bantle
0e0e5d9893 Attempt to fix windows unit test 2022-07-22 15:10:25 -07:00
Taylor Bantle
3c53115480 Copyright header 2022-07-22 13:54:33 -07:00
Taylor Bantle
5225c27946 Use go gen_keys for auth bats 2022-07-22 13:37:44 -07:00
Taylor Bantle
5090f66984 Aaron feedback 2022-07-22 13:24:59 -07:00
Taylor Bantle
f230900d52 Bats, more plugin tests 2022-07-20 14:41:47 -07:00
Taylor Bantle
7b2bac8f81 Add tests 2022-07-19 17:45:19 -07:00
Taylor Bantle
c197a51ef6 Start on jwtauth changes 2022-07-19 16:40:06 -07:00
James Cor
e1c706b0e6 Merge branch 'main' into james/local-user 2022-07-08 11:04:06 -07:00
Aaron Son
f81f02eed1 go: Migrate from opentracing to opentelemetry. 2022-07-08 10:18:47 -07:00
James Cor
48d7a52715 appears to be working, need tests 2022-07-01 15:23:16 -07:00
Zach Musgrave
b79bbc9646 SQL diff writer implementation and interface 2022-06-23 15:08:15 -07:00
Aaron Son
edf0485148 go/libraries/utils/pipeline/stage.go: Fix how we finalize a stage so that every consumer can still see nil in the success case. 2022-05-18 14:31:09 -07:00
Aaron Son
ec7af0c507 go/libraries/utils/pipeline: Fix unit test for new semantics. 2022-05-18 14:07:14 -07:00
Aaron Son
a8f5e44786 go/libraries/utils/pipeline: stage.go: Another pass at finalization strategy. 2022-05-18 12:17:35 -07:00
Aaron Son
f4b6b6fe50 go/libraries/utils/pipeline: Fix racey finalization of a pipeline.
Before this change, when an initial stage function returned a non-nil err, it
would return non-nil, resulting in closing its output channel and leaving the
errgroup responsible for canceling the egCtx.

The next transform stage would read `nil, false` on its inCh. That stage would
forward the `nil` down the transform pipeline. If the inCh selects all resolved
down the transform pipeline before any of the `<- ctx.Done()` selects, then the
pipeline would see the exact same behavior for the error case as it would see
for an `io.EOF` being reached in the first stage.

Instead, transform stages in the pipeline should abort without forwarding data
if they see a closed input channel. In turn, input stages should forward one
last `nil` sentinel value to their output channel when the see an `io.EOF`
before they close the channel.
2022-05-18 10:11:27 -07:00
Dhruv Sringari
c0c54db5d2 Fix bad upload table file retries 2022-03-25 14:09:46 -07:00
James Cor
0cadc528e5 renamed WriteNoNewLine to WriteWithoutNewLine 2022-03-02 12:16:56 -08:00
James Cor
88b6a6f197 working for sql format; not sure if i need any other formats 2022-03-01 15:42:33 -08:00
Lars Lehtonen
bf727113cc libraries/utils/editor: fix dropped error 2022-02-21 18:54:48 -08:00
Dhruv Sringari
009bb85d8d fix bats 2022-02-17 14:22:46 -08:00
Dhruv Sringari
c662e2fa8c self-review 2022-02-16 16:29:00 -08:00
Dhruv Sringari
a18bfc6c27 wip 2022-02-16 14:52:34 -08:00
Zach Musgrave
576753d38c Added failsafe values to dolt CLI config, only in sql context for now 2021-11-08 12:26:52 -08:00
Zach Musgrave
c76f4bde26 Fixed bug in config hierarchy construction -- it was being constructed backwards, so globals were being returned instead of locals 2021-11-08 11:43:13 -08:00
Zach Musgrave
37c2137557 merge main 2021-11-04 14:12:38 -07:00
Zach Musgrave
4a236171e7 More clean up of session setup 2021-11-04 09:51:30 -07:00
jennifersp
efef83b167 dolt dump: Add dolt dump command and bats tests. 2021-11-03 15:21:46 -07:00
Zach Musgrave
92f175a37a Merge branch 'main' into zachmu/create-db 2021-11-02 10:46:50 -07:00
Zach Musgrave
037f249e91 First pass at getting something working for create db 2021-11-02 10:46:12 -07:00
Maximilian Hoffman
d11f5ec41b default session implements persistable interface, can save SQL variables (#2270)
* save version with defaultConfig in session -- todo remove and make PersistedSession

* add PersistedSession, and DoltSession interface to switch

* fmt

* fixup test for persistedSession

* PersistedSession progress, interfaces and enginetests

* All DsessFromSess references fixed

* delete unnuecessary lines

* Comments for dolt session

* Dolt session tests

* save bats progress

* formatting

* GMS version

* Bump GMS version

* add license header

* fix multi-db errors

* try copyright again

* make test deterministic

* higher connection timeout default

* sever config ordering

* PR fixes

* PR fixes

* config rewrite progress

* server config refactor

* PR cleanup

* delete lines

* add go tests, refactor persistent global initialization

* PR fixes

* delete more lines

* small PR cleanup

* try to fix data race

* better constructor names

* zach don't like --server flag

* edge cases around disabling replication

* missed line in merge

* Skip two tests i fixed in follow-on PR

* merge two config prs

* fix nondeterministic bats

* zach's comments

* bump bats sql-shell expect timeout

* GMS and integrator race to access system vars; need to decide whether to force integrator to initialize, or make GMS init private; leaving in GMS for now
2021-11-01 16:49:00 -07:00
Aaron Son
86307b6f8e Merge pull request #2230 from abmyii/arm-dolt-push
Fixes for dolt on arm devices
2021-10-07 09:05:55 -07:00
Aaron Son
97ea3b8749 go/libraries/utils/iohelp: ReaderWithStats: Support > 4GB read stats. 2021-10-06 14:39:47 -07:00
Abdurrahmaan Iqbal
7e760c4e31 Fix for dolt push on arm devices 2021-10-06 21:04:50 +01:00
Zach Musgrave
23df5c88fe Merge pull request #2211 from Juneezee/deprecate-ioutil
refactor: move from io/ioutil to io and os package
2021-10-04 14:10:04 -07:00
Maximilian Hoffman
9a7a49f516 initial dolt backup cli (#2208)
* prototype

* backup pushes noms root

* backup pushes root value, basic restore still needs origin drop

* bats tests, no origin on restore, only head ref on restore

* cleanup code, up to date bats test

* make backup restore a root sync also, to catch branches and remote refs

* [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh

* couple of tim's comments

couple of tim's comments

* zach's comments

* loosen restrictions for conflicting remote addresses

* [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh

Co-authored-by: max-hoffman <max-hoffman@users.noreply.github.com>
2021-10-04 11:53:05 -07:00
Eng Zer Jun
8164a625c7 refactor: move from io/ioutil to io and os package
The io/ioutil package has been deprecated as of Go 1.16, see
https://golang.org/doc/go1.16#ioutil. This commit replaces the existing
io/ioutil functions with their new definitions in io and os packages.

Signed-off-by: Eng Zer Jun <engzerjun@gmail.com>
2021-10-05 01:40:59 +08:00
Maximilian Hoffman
8a5f3f54be config, clone, backups refactor (#2196)
* shittiest read replica imaginable is kind of working

* import cycle progress

* delete unecessary files and fix  db type switch bug

* Add bats test

* delete comments

* fix working set updates for cli

* [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh

* clean comments

* comment racy server test

* move env variables to local dolt config

* refactor clone, fix multienv test

* cleanup comments

* missing copyright

* brian's comments, add compile time checks for config interfaces

* format

* fix windows filepaths issue

* file:/// with three slashes should work on windows

* more windows problems

* three slashes didn't work for clone, do chdir to ref local dolt db

Co-authored-by: max-hoffman <max-hoffman@users.noreply.github.com>
2021-09-29 19:10:37 -07:00
Brian Hendriks
3070d3af9f merge rows on dolt table import -u when import data only represents a subset of the columns (#2105) 2021-09-16 14:06:45 -07:00
Brian Hendriks
775ac0af51 Import Performance and Garbage Generation improvements. 2021-09-08 14:52:42 -07:00
Maximilian Hoffman
f5d63f4e3d move common merge/push/pull code into doltcore/env (#2063)
* Start moving code out of cmd

* hacky cmd -> action/evn refactor

* progress

* String verbose error from lib, mostly not reconstructed on cli side

* Missing verbose errors in lib, still not handled in cli. Refactor vinai's doc diffs to not depend on merge

* Small progress commit on other laptop

* Merge bats passing

* format

* progress

* Remotes bats tests working

* More error fixes

* Fix cyclic foreign keys bats

* Fix import cycle

* Start cleaning up code

* Fix a couple bats

* Clean up comments and println

* Brian's comments
2021-08-31 15:23:23 -07:00
Brian Hendriks
0a0ce2181c Bh/gen cs (#1938) 2021-08-05 18:20:19 -07:00
Daylon Wilkins
1d33bde91b Reworked verify-constraints and renamed to constraints verify 2021-07-20 18:16:38 -07:00
Daylon Wilkins
8d971dcd35 Added fast forward handling and fleshed out constraint violation messages 2021-07-15 17:16:16 -07:00