Commit Graph

70 Commits

Author SHA1 Message Date
Andy Arthur
8da16c397d update benchmark scripts with new join benchmark 2022-08-29 10:52:53 -07:00
Andy Arthur
967cf6ae79 remove __DOLT_1__ in favor of __DOLT__ 2022-08-09 14:44:26 -07:00
coffeegoddd
c149eb10a3 /{.github, go}: add quotation mark, print test name before each test 2022-08-04 16:26:59 -07:00
Maximilian Hoffman
acb61d68e7 new blob write test for sysbench (#4013) 2022-08-04 09:36:03 -07:00
Maximilian Hoffman
45c9973219 blob sysbench (#3981)
* irrelevent cahnge

* new tests
2022-08-02 07:18:58 -07:00
coffeegoddd
1e7a6002aa /.github/scripts/{import-benchmarking,performance-benchmarking,sql-correctness}: add email alert to jobs 2022-07-26 14:33:58 -07:00
coffeegoddd
2eb83de16a /.github/{actions,workflows}: fix correctness for both formats 2022-07-21 15:42:44 -07:00
coffeegoddd
60f7f2a9dc /.github/{scripts,workflows}: run tpcc as separate job 2022-07-21 14:41:46 -07:00
coffeegoddd
3df6fd75ae /.github/scripts/performance-benchmarking/get-mysql-dolt-job-json.sh: make mysql script args match dolt script args 2022-07-21 09:45:10 -07:00
Andy Arthur
df5c03aec2 fix performance-benchmarking/run-benchmarks.sh 2022-07-18 11:55:57 -07:00
Andy Arthur
1a888b42c7 turn off INIT_BIG_REPO option for __DOLT_1__ 2022-07-18 11:02:07 -07:00
Andy Arthur
e107ff6f03 replace benchmarking usages of oltp_delete with oltp_delete_insert 2022-06-30 14:24:52 -07:00
Maximilian Hoffman
fdf378ace1 index join scan (#3651) 2022-06-21 13:12:22 -07:00
coffeegoddd
c728656bbd [no-release-notes] /.github/{scripts,workflows}: update existing benchmarking to use new format args 2022-06-03 14:15:12 -07:00
Andy Arthur
a857658987 fixup benchmark script 2022-06-03 13:15:04 -07:00
Andy Arthur
5fcfef0ed5 added tmp workflow for testing 2022-06-03 12:23:59 -07:00
Andy Arthur
e3ea885331 added time suffix to performance job name 2022-06-03 12:21:53 -07:00
Andy Arthur
e112761977 added nbf option 2022-06-02 16:52:22 -07:00
Andy Arthur
88440b090b refactor 'init-big-repo' flag to make setup work optional 2022-06-02 16:23:58 -07:00
Maximilian Hoffman
d994df5f5a Option for sysbench perf tests to clone big repo (#3326)
* Option for sysbench perf tests to clone big repo, rather than starting empty

* put remove dir back

* flag

* hanging comma

* sysbench canary update
2022-04-29 11:49:46 -07:00
Maximilian Hoffman
c64e913ce4 Max/fix nightly (#3316)
* Nightly benchmarks

* dispatch

* del comment brnach

* merge conflict

* mysql-dolt

* change if or to double brackets
2022-04-28 11:02:04 -07:00
Vinai Rachakonda
5e788b48c1 Change transactions per second to sql_transactions_per_second (#2994) 2022-03-15 17:38:54 -07:00
Vinai Rachakonda
e895d583a5 Update queries to include tps as well as more sophisticated percentil… (#2986) 2022-03-15 12:31:47 -07:00
Vinai Rachakonda
a28aa3c033 Modify Benchmark Configuration for End to End support of the TPCC benchmark (#2812) 2022-02-21 12:04:59 -08:00
Dustin Brown
208480acdc /.github/scripts/performance-benchmarking/get-{dolt,mysql}-dolt-job-json.sh: use dolthub lua script repo 2022-01-20 13:56:29 -08:00
Dustin Brown
c7c5cc4522 /.github/scripts/performance-benchmarking/get-mysql-dolt-job-json.sh: add group by scan to mysql v dolt benchmarks 2022-01-19 15:33:49 -08:00
Maximilian Hoffman
cb74ef57da sysbench changes (#2616)
* sysbench changes

* add sysbench read test
2022-01-14 13:47:22 -08:00
Dustin Brown
1e8bcd151a /.github/scripts/performance-benchmarking/get-mysql-dolt-job-json.sh: adjust benchmarking precision 2021-12-15 12:59:01 -08:00
Dustin Brown
acd5766bd6 /.github/scripts/{performance-benchmarking,sql-correctness}: bump the back off limit in case of transient fails 2021-09-20 13:34:30 -07:00
Dustin Brown
60c78fa429 /.github/{scripts,workflows}: set env vars for triggering benchmark-report workflow 2021-08-17 16:53:25 -07:00
Dustin Brown
5a4a7026b6 /.github/{scripts,workflows}: use the issue-number arg in comment benchmarking job 2021-08-17 16:40:11 -07:00
Dustin Brown
cdbad5a4c8 /.github/{scripts, workflows}: performance benchmark async reports 2021-08-17 15:13:13 -07:00
Dustin Brown
077d344883 /.github/scripts/performance-benchmarking/run-benchmarks.sh: delete job on success only 2021-02-16 13:25:41 -08:00
Dustin Brown
7067c36ab2 /.github/scripts/performance-benchmarking/run-benchmarks.sh: bump timeout 2021-02-16 10:05:48 -08:00
Dustin Brown
062a76a3f2 /.github/scripts/performance-benchmarking/get-mysql-dolt-job-json.sh: add read write means back 2021-02-15 15:26:10 -08:00
Dustin Brown
6a8371f640 /.github/scripts/performance-benchmarking: fix split benchmarking tables 2021-02-15 14:58:13 -08:00
Dustin Brown
bf7b583f76 /.github/scripts/performance-benchmarking: separate delete 2021-02-12 15:13:17 -08:00
Dustin Brown
f1e1492b38 /.github/scripts/performance-benchmarking: split results read/write 2021-02-12 13:45:49 -08:00
Dustin Brown
c98fc3cfd1 /.github/scripts/performance-benchmarking: update performance queries 2021-02-12 12:00:11 -08:00
Dustin Brown
df3347dfef /.github/scripts/performance-benchmarking/run-benchmarks.sh: lowercase actor 2021-02-05 13:41:37 -08:00
Dustin Brown
1d576a71b8 /.github/scripts/performance-benchmarking/run-benchmarks.sh: differentiate job names to allow for multiple PR benchmark runs by a single actor 2021-01-26 11:29:50 -08:00
Dustin Brown
c5e6ebcb45 /.github/scripts/performance-benchmarking/get-dolt-dolt-job-json.sh: fix is faster case to use decimal, not percent 2021-01-23 16:44:00 -08:00
Dustin Brown
764a813a1e /.github/scripts/performance-benchmarking/{get-dolt-dolt-job-json.sh,get-mysql-dolt-job-json.sh}: specify limits that ensure each pod receives its own node 2021-01-22 15:41:08 -08:00
Dustin Brown
0a2f4a2027 /.github/scripts/performance-benchmarking/get-mysql-dolt-job-json.sh: add mean multiplier query 2021-01-22 14:15:27 -08:00
Dustin Brown
80d95d1a89 /.github/scripts/performance-benchmarking/get-mysql-dolt-job-json.sh: fix query division, add server names and versions 2021-01-22 11:42:45 -08:00
Dustin Brown
986094498b Merge pull request #1236 from dolthub/db/update-benchmarking-query
Update performance benchmarking queries and timeout
2021-01-22 10:44:24 -08:00
Dustin Brown
6d7f04e58f /.github/scripts/performance-benchmarking: update queries to display stable latency median, increase timeout to 90mins 2021-01-21 18:35:10 -08:00
Dustin Brown
683dc68965 /.github/scripts/performance-benchmarks/get-{dolt,mysql}-dolt-job-json.sh: include custom lua scripts in benchmarks 2021-01-20 17:40:51 -08:00
Dustin Brown
47dbf66c96 /.github/{scripts,workflows}: cleanup scripts a bit 2021-01-20 09:51:36 -08:00
Dustin Brown
232f6ae683 /.github/scripts/performance-benchmarking/{get-job-json-updated.sh, run-benchmarks-updated.sh}: iterating on updates to scripts that allow for mysql v dolt benchmarks 2021-01-19 17:40:34 -08:00