Commit Graph

144 Commits

Author SHA1 Message Date
Zach Musgrave
e77ae77452 Changed types2 import alias to gmstypes everywhere 2023-01-24 11:53:44 -08:00
Maximilian Hoffman
d566687435 System Table to-commit/commit-hash lookups (#5137)
* System table commit indexes

* [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh

* tidy

* docstrings and bad hash tests

* exclude ld

* [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh

* bad import

* [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh

* skip LD system table indexing testt

* [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh

* skip LD dolt scripts

* shift validation burden to indexes

* [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh

* fix bats

* fix non-determinism

* fix copyright header

Co-authored-by: max-hoffman <max-hoffman@users.noreply.github.com>
2023-01-18 17:58:35 -08:00
Zach Musgrave
8474e39df6 Merge main 2023-01-17 14:04:53 -08:00
Maximilian Hoffman
1e356d3562 Edit systab tests (#5141) 2023-01-12 17:38:46 -08:00
Zach Musgrave
ad4bf92b95 Dolt changes for sql types package 2023-01-09 11:21:34 -08:00
Andy Arthur
3f62239e07 update performance/scripts/local_sysbench.sh 2022-12-21 21:39:14 -08:00
Maximilian Hoffman
6eea826814 Update systab_summary.sql 2022-12-16 15:01:40 -08:00
Maximilian Hoffman
c5602595c8 Update summary.sql 2022-12-16 15:00:34 -08:00
Maximilian Hoffman
05fd59db71 Update summary.sql 2022-12-16 14:36:50 -08:00
Maximilian Hoffman
0143ffe533 Sysbench summaries for testing (#5017)
* add summaries

* fix bugs
2022-12-16 13:51:08 -08:00
Maximilian Hoffman
8aa3c5a424 Update testdef.go 2022-12-15 20:53:18 -08:00
Maximilian Hoffman
24544035bc Systab edits (#4974)
* edit

* no median or variance

* revert readme edit

* Edits

* edits

* all read/write tests
2022-12-12 18:46:12 -08:00
Maximilian Hoffman
cde420a5cb [no-release-notes] systab bench edits (#4964)
* edit

* no median or variance

* revert readme edit
2022-12-09 14:15:05 -08:00
Max Hoffman
6748bdae99 restore all systab CI tests 2022-12-09 11:59:01 -08:00
Maximilian Hoffman
7b473fd892 new sysbench runner and CI for systab (#4942)
* prototype for new sysbench runner

* [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh

* CI jobs

* edits

* nightly and release workflows

* param tweaks

* testing edits

* fixes

* fix test

Co-authored-by: max-hoffman <max-hoffman@users.noreply.github.com>
2022-12-09 09:50:45 -08:00
Andy Arthur
edcc243c13 added chunkJournal, journalWriter, and journalChunkSource 2022-11-28 14:54:11 -08:00
Maximilian Hoffman
fc46082dcf Blob chunker rewrite (#4825)
* Fix mising projection on indexed table

* add test

* rewrite

* cleanup

* [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh

* blob test

* Fix tests

* node arena

* delete stale

* [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh

* docs

* more cleanup

* add newline

* [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh

* aaron's rewrite

* benchmarks

* [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh

* concurrency safe blob builder

* fmt

* pointer to pool

* test nodeStore edits

Co-authored-by: max-hoffman <max-hoffman@users.noreply.github.com>
2022-11-21 15:46:17 -08:00
Maximilian Hoffman
2240cd2da7 delete old files (#4757) 2022-11-11 08:14:44 -08:00
Max Hoffman
e7cbcb9ac9 Restore import CI tests 2022-11-10 15:26:35 -08:00
Max Hoffman
9cf3fa007f smaller import perf CI test 2022-11-10 14:39:40 -08:00
Max Hoffman
a659cbbdaf import CI edits 2022-11-10 14:29:36 -08:00
Max Hoffman
083ea4abf4 shorted import ci for testing 2022-11-10 13:23:10 -08:00
Maximilian Hoffman
08167dfd5d Redo import perf (#4689)
* import perf harness prog

* more test isolation

* rework common dep

* fix server driver

* delete old files, fix readme

* more readme fixes

* batching edits

* edits

* skip import tests by def

* GA starter

* rename

* fix arg name

* change input name again

* remove espaced character from input desc

* fix env definition

* fix env definition

* fix workflow_dispatch name

* CI test files

* remove os spec

* runs on

* different set variable

* defaults

* defaults

* remove local GMS

* edits

* run bench from go/ directory

* dropped def equals

* go run, not go build

* fix output command name

* configure dolt

* fix query file path

* fix query file path

* switch query and inputs

* fix format <<EOF

* reformat yaml

* debug output

* more debug output

* fix echo -> cat

* fix to json flag

* fix yaml spacing

* yaml spacing

* yaml spacing

* revert html spacing

* json format

* env var expansion

* echo not cat

* another json string printing error

* no echo

* log template

* no template string

* wrong parameter, template should be templateName

* remove console.log

* pass file, not string, to ses

* rely on preexisting template? email action interface

* fix yaml

* fix html print

* fix html header

* change ci script

* fix sql-server connection pass

* mysql no password, setup default db

* put password back

* missed port for default database

* expanded CI tests

* shorter test file

* extend ci tests

* change default query

* try to push to dolthub

* modify push to dolthub

* duplicate test names

* typo

* dolt-action version

* invalid param for dolt_action

* specify feature branch

* specify main branch dolt-action

* -b flag first

* dont need -q flag for batch EOF

* combine results and dolthub push

* missing curly brace

* no auth

* new creds

* new cred fun

* use the cred key

* try again

* log table

* move push out of batch

* more logging

* new vs old branch

* fix branch rule

* more test

* all tests

* smaller tests

* smaller tests

* double env: key

* fix yaml error

* more yaml errors

* more yaml errors

* [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh

* linting fixes, remove other import nightly

* linting

* go vet

* licenses

* fix compile errorrs

* warn don't panic on init()

* [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh

* no external package

* [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh

* unused dep

* [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh

* Revert perf scripts

* refactor to repo dispatch

Co-authored-by: max-hoffman <max-hoffman@users.noreply.github.com>
2022-11-10 12:56:43 -08:00
coffeegoddd
2c20d61589 [ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/update.sh 2022-10-10 23:42:41 +00:00
coffeegoddd
ecb349a1e5 /go/performance/import_benchmarker: better err handling 2022-10-10 16:41:06 -07:00
Andy Arthur
c6437df6e4 fix env bootstrapping for clone 2022-09-29 16:15:12 -07:00
Andy Arthur
1c51085324 update init.bats, sysbench runner 2022-09-29 16:09:20 -07:00
Andy Arthur
ad472765d2 add NomsBinFormat config option for tpcc runner 2022-08-25 15:30:38 -07:00
Andy Arthur
c6884d4c07 added index_join microbenchmark 2022-08-24 12:23:18 -07:00
Zach Musgrave
6164b27912 Merge main 2022-08-12 15:18:48 -07:00
Zach Musgrave
bbd5818393 Renamed some consts 2022-08-11 16:25:12 -07:00
Dustin Brown
02f20f5204 Merge pull request #4048 from dolthub/vinai/import-benchmarker-notes
Clean up the import benchmarker notes
2022-08-11 13:58:09 -07:00
Vinai Rachakonda
d1180b7143 Add some clean up to the import benchmarker notes 2022-08-09 15:02:30 -07:00
Andy Arthur
967cf6ae79 remove __DOLT_1__ in favor of __DOLT__ 2022-08-09 14:44:26 -07:00
Dustin Brown
5dc34293c2 Merge pull request #4016 from dolthub/db/bump-go
/{.github,go}: bump required go to 1.19
2022-08-05 12:06:09 -07:00
coffeegoddd
c149eb10a3 /{.github, go}: add quotation mark, print test name before each test 2022-08-04 16:26:59 -07:00
coffeegoddd
68127a0dcb /{.github,go}: bump go to 1.19 2022-08-04 13:53:51 -07:00
Andy Arthur
a714e369f3 added --row2 flag for local_sysbench.sh 2022-08-01 15:38:29 -07:00
Vinai Rachakonda
aae47eda8b [no-release-notes] Switch to millisecond performance (#3965) 2022-07-29 12:28:13 -07:00
Taylor Bantle
dccd8fff42 Merge remote-tracking branch 'origin/tbantle22-e71f2c26' into taylor/jwtauth 2022-07-22 13:25:20 -07:00
Vinai Rachakonda
2c9a75797b Round Import benchmark time results by one (#3892) 2022-07-21 19:03:02 -07:00
Taylor Bantle
7d8c914275 Add AllowCleartextPasswords to server config 2022-07-21 11:07:00 -07:00
James Cor
f50cd576ab Merge pull request #3732 from dolthub/james/local-user
Rework File Handling for privileges
2022-07-15 12:40:43 -07:00
Andy Arthur
c8e100a381 updating MySQL sysbench runner to run with sysvar innodb_flush_log_at_trx_commit=2 to match Dolt's durability level 2022-07-14 20:28:11 -07:00
Vinai Rachakonda
e357c4198c [no-release-notes] Update configuration files for generating import benchmark (#3828) 2022-07-14 18:21:40 -07:00
James Cor
384b57ea8a merge with main 2022-07-14 13:06:09 -07:00
Vinai Rachakonda
3f985c76d1 Revamp the Import Benchmarker (#3744) 2022-07-13 18:27:14 -07:00
James Cor
fc28171ddc best I got 2022-07-13 12:38:21 -07:00
James Cor
278b2b3ebb merge with main 2022-07-12 16:02:49 -07:00
James Cor
0c0216859f the best of both works...probably 2022-07-11 16:40:53 -07:00