Commit Graph

133 Commits

Author SHA1 Message Date
Maximilian Hoffman 24544035bc Systab edits (#4974)
* edit

* no median or variance

* revert readme edit

* Edits

* edits

* all read/write tests
2022-12-12 18:46:12 -08:00
Maximilian Hoffman cde420a5cb [no-release-notes] systab bench edits (#4964)
* edit

* no median or variance

* revert readme edit
2022-12-09 14:15:05 -08:00
Max Hoffman 6748bdae99 restore all systab CI tests 2022-12-09 11:59:01 -08:00
Maximilian Hoffman 7b473fd892 new sysbench runner and CI for systab (#4942)
* prototype for new sysbench runner

* [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh

* CI jobs

* edits

* nightly and release workflows

* param tweaks

* testing edits

* fixes

* fix test

Co-authored-by: max-hoffman <max-hoffman@users.noreply.github.com>
2022-12-09 09:50:45 -08:00
Andy Arthur edcc243c13 added chunkJournal, journalWriter, and journalChunkSource 2022-11-28 14:54:11 -08:00
Maximilian Hoffman fc46082dcf Blob chunker rewrite (#4825)
* Fix mising projection on indexed table

* add test

* rewrite

* cleanup

* [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh

* blob test

* Fix tests

* node arena

* delete stale

* [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh

* docs

* more cleanup

* add newline

* [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh

* aaron's rewrite

* benchmarks

* [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh

* concurrency safe blob builder

* fmt

* pointer to pool

* test nodeStore edits

Co-authored-by: max-hoffman <max-hoffman@users.noreply.github.com>
2022-11-21 15:46:17 -08:00
Maximilian Hoffman 2240cd2da7 delete old files (#4757) 2022-11-11 08:14:44 -08:00
Max Hoffman e7cbcb9ac9 Restore import CI tests 2022-11-10 15:26:35 -08:00
Max Hoffman 9cf3fa007f smaller import perf CI test 2022-11-10 14:39:40 -08:00
Max Hoffman a659cbbdaf import CI edits 2022-11-10 14:29:36 -08:00
Max Hoffman 083ea4abf4 shorted import ci for testing 2022-11-10 13:23:10 -08:00
Maximilian Hoffman 08167dfd5d Redo import perf (#4689)
* import perf harness prog

* more test isolation

* rework common dep

* fix server driver

* delete old files, fix readme

* more readme fixes

* batching edits

* edits

* skip import tests by def

* GA starter

* rename

* fix arg name

* change input name again

* remove espaced character from input desc

* fix env definition

* fix env definition

* fix workflow_dispatch name

* CI test files

* remove os spec

* runs on

* different set variable

* defaults

* defaults

* remove local GMS

* edits

* run bench from go/ directory

* dropped def equals

* go run, not go build

* fix output command name

* configure dolt

* fix query file path

* fix query file path

* switch query and inputs

* fix format <<EOF

* reformat yaml

* debug output

* more debug output

* fix echo -> cat

* fix to json flag

* fix yaml spacing

* yaml spacing

* yaml spacing

* revert html spacing

* json format

* env var expansion

* echo not cat

* another json string printing error

* no echo

* log template

* no template string

* wrong parameter, template should be templateName

* remove console.log

* pass file, not string, to ses

* rely on preexisting template? email action interface

* fix yaml

* fix html print

* fix html header

* change ci script

* fix sql-server connection pass

* mysql no password, setup default db

* put password back

* missed port for default database

* expanded CI tests

* shorter test file

* extend ci tests

* change default query

* try to push to dolthub

* modify push to dolthub

* duplicate test names

* typo

* dolt-action version

* invalid param for dolt_action

* specify feature branch

* specify main branch dolt-action

* -b flag first

* dont need -q flag for batch EOF

* combine results and dolthub push

* missing curly brace

* no auth

* new creds

* new cred fun

* use the cred key

* try again

* log table

* move push out of batch

* more logging

* new vs old branch

* fix branch rule

* more test

* all tests

* smaller tests

* smaller tests

* double env: key

* fix yaml error

* more yaml errors

* more yaml errors

* [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh

* linting fixes, remove other import nightly

* linting

* go vet

* licenses

* fix compile errorrs

* warn don't panic on init()

* [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh

* no external package

* [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh

* unused dep

* [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh

* Revert perf scripts

* refactor to repo dispatch

Co-authored-by: max-hoffman <max-hoffman@users.noreply.github.com>
2022-11-10 12:56:43 -08:00
coffeegoddd 2c20d61589 [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh 2022-10-10 23:42:41 +00:00
coffeegoddd ecb349a1e5 /go/performance/import_benchmarker: better err handling 2022-10-10 16:41:06 -07:00
Andy Arthur c6437df6e4 fix env bootstrapping for clone 2022-09-29 16:15:12 -07:00
Andy Arthur 1c51085324 update init.bats, sysbench runner 2022-09-29 16:09:20 -07:00
Andy Arthur ad472765d2 add NomsBinFormat config option for tpcc runner 2022-08-25 15:30:38 -07:00
Andy Arthur c6884d4c07 added index_join microbenchmark 2022-08-24 12:23:18 -07:00
Zach Musgrave 6164b27912 Merge main 2022-08-12 15:18:48 -07:00
Zach Musgrave bbd5818393 Renamed some consts 2022-08-11 16:25:12 -07:00
Dustin Brown 02f20f5204 Merge pull request #4048 from dolthub/vinai/import-benchmarker-notes
Clean up the import benchmarker notes
2022-08-11 13:58:09 -07:00
Vinai Rachakonda d1180b7143 Add some clean up to the import benchmarker notes 2022-08-09 15:02:30 -07:00
Andy Arthur 967cf6ae79 remove __DOLT_1__ in favor of __DOLT__ 2022-08-09 14:44:26 -07:00
Dustin Brown 5dc34293c2 Merge pull request #4016 from dolthub/db/bump-go
/{.github,go}: bump required go to 1.19
2022-08-05 12:06:09 -07:00
coffeegoddd c149eb10a3 /{.github, go}: add quotation mark, print test name before each test 2022-08-04 16:26:59 -07:00
coffeegoddd 68127a0dcb /{.github,go}: bump go to 1.19 2022-08-04 13:53:51 -07:00
Andy Arthur a714e369f3 added --row2 flag for local_sysbench.sh 2022-08-01 15:38:29 -07:00
Vinai Rachakonda aae47eda8b [no-release-notes] Switch to millisecond performance (#3965) 2022-07-29 12:28:13 -07:00
Taylor Bantle dccd8fff42 Merge remote-tracking branch 'origin/tbantle22-e71f2c26' into taylor/jwtauth 2022-07-22 13:25:20 -07:00
Vinai Rachakonda 2c9a75797b Round Import benchmark time results by one (#3892) 2022-07-21 19:03:02 -07:00
Taylor Bantle 7d8c914275 Add AllowCleartextPasswords to server config 2022-07-21 11:07:00 -07:00
James Cor f50cd576ab Merge pull request #3732 from dolthub/james/local-user
Rework File Handling for privileges
2022-07-15 12:40:43 -07:00
Andy Arthur c8e100a381 updating MySQL sysbench runner to run with sysvar innodb_flush_log_at_trx_commit=2 to match Dolt's durability level 2022-07-14 20:28:11 -07:00
Vinai Rachakonda e357c4198c [no-release-notes] Update configuration files for generating import benchmark (#3828) 2022-07-14 18:21:40 -07:00
James Cor 384b57ea8a merge with main 2022-07-14 13:06:09 -07:00
Vinai Rachakonda 3f985c76d1 Revamp the Import Benchmarker (#3744) 2022-07-13 18:27:14 -07:00
James Cor fc28171ddc best I got 2022-07-13 12:38:21 -07:00
James Cor 278b2b3ebb merge with main 2022-07-12 16:02:49 -07:00
James Cor 0c0216859f the best of both works...probably 2022-07-11 16:40:53 -07:00
Andy Arthur 4c32f515ed rip out DOLT_TRANSACTION_MERGE_STOMP 2022-07-11 13:34:36 -07:00
James Cor 90137d5a2e replacing DoltEnvAsMultiEnv with MultiEnvForDirectory 2022-07-11 10:47:29 -07:00
James Cor 769e9f929d removing LoadMultiEnvFromDir and adding extra param to DoltEnvAsMultiDir 2022-07-11 09:40:16 -07:00
Andy Arthur 5dac6fb128 clarify bench script names 2022-07-09 10:41:29 -07:00
Andy Arthur c00ce2123c updated sysbench, tpcc utilities 2022-07-09 10:39:31 -07:00
Andy Arthur fcef003df2 added tpcc_local script 2022-07-06 16:09:41 -07:00
Andy Arthur 1dc4d73778 Merge remote-tracking branch 'origin/main' into andy/filtered-reader 2022-07-06 12:36:15 -07:00
Andy Arthur 928ba2756d implementing projection pushdowns 2022-07-05 15:21:59 -07:00
Aaron Son 642f2e0ba7 go: More migration away from shim into NodeStore. 2022-07-05 14:16:36 -07:00
Andy Arthur 0e3eb85353 Merge remote-tracking branch 'origin/main' into andy/filtered-reader 2022-07-02 10:42:20 -07:00
Maximilian Hoffman d5ec4382a6 Only rebase transaction start for read replica (#3722)
* Only rebase transaction start for read replica

* [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh

* missed var names

* another var name

* [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh

* server lock file

* put serverLockFile in dsess

* better multiEnv locking

* more doc comments

* zach's comments

Co-authored-by: max-hoffman <max-hoffman@users.noreply.github.com>
2022-07-01 17:02:09 -07:00