Commit Graph

74 Commits

Author SHA1 Message Date
coffeegoddd
c728656bbd [no-release-notes] /.github/{scripts,workflows}: update existing benchmarking to use new format args 2022-06-03 14:15:12 -07:00
Andy Arthur
a857658987 fixup benchmark script 2022-06-03 13:15:04 -07:00
Andy Arthur
5fcfef0ed5 added tmp workflow for testing 2022-06-03 12:23:59 -07:00
Andy Arthur
e3ea885331 added time suffix to performance job name 2022-06-03 12:21:53 -07:00
Andy Arthur
e112761977 added nbf option 2022-06-02 16:52:22 -07:00
Andy Arthur
88440b090b refactor 'init-big-repo' flag to make setup work optional 2022-06-02 16:23:58 -07:00
Daylon Wilkins
20c6adf98c Shifted fuzzer to use new format 2022-05-27 08:35:51 -07:00
Maximilian Hoffman
d994df5f5a Option for sysbench perf tests to clone big repo (#3326)
* Option for sysbench perf tests to clone big repo, rather than starting empty

* put remove dir back

* flag

* hanging comma

* sysbench canary update
2022-04-29 11:49:46 -07:00
Maximilian Hoffman
c64e913ce4 Max/fix nightly (#3316)
* Nightly benchmarks

* dispatch

* del comment brnach

* merge conflict

* mysql-dolt

* change if or to double brackets
2022-04-28 11:02:04 -07:00
Vinai Rachakonda
5e788b48c1 Change transactions per second to sql_transactions_per_second (#2994) 2022-03-15 17:38:54 -07:00
Vinai Rachakonda
e895d583a5 Update queries to include tps as well as more sophisticated percentil… (#2986) 2022-03-15 12:31:47 -07:00
Vinai Rachakonda
a28aa3c033 Modify Benchmark Configuration for End to End support of the TPCC benchmark (#2812) 2022-02-21 12:04:59 -08:00
Dustin Brown
e9e58bbb1f /.github/scripts/sql-correctness/get-dolt-correctness-job-json.sh: add precision to correctness percentage 2022-02-05 06:54:04 -08:00
Dustin Brown
208480acdc /.github/scripts/performance-benchmarking/get-{dolt,mysql}-dolt-job-json.sh: use dolthub lua script repo 2022-01-20 13:56:29 -08:00
Dustin Brown
c7c5cc4522 /.github/scripts/performance-benchmarking/get-mysql-dolt-job-json.sh: add group by scan to mysql v dolt benchmarks 2022-01-19 15:33:49 -08:00
Maximilian Hoffman
cb74ef57da sysbench changes (#2616)
* sysbench changes

* add sysbench read test
2022-01-14 13:47:22 -08:00
Dustin Brown
1e8bcd151a /.github/scripts/performance-benchmarking/get-mysql-dolt-job-json.sh: adjust benchmarking precision 2021-12-15 12:59:01 -08:00
Dustin Brown
557e3a565f /.github/scripts/fuzzer/get-fuzzer-job-json.sh: add job label 2021-10-15 09:15:44 -07:00
Dustin Brown
acd5766bd6 /.github/scripts/{performance-benchmarking,sql-correctness}: bump the back off limit in case of transient fails 2021-09-20 13:34:30 -07:00
Daylon Wilkins
ab923b17fc Reduced fuzzer gate cycles 2021-08-24 15:01:19 -07:00
Dustin Brown
60c78fa429 /.github/{scripts,workflows}: set env vars for triggering benchmark-report workflow 2021-08-17 16:53:25 -07:00
Dustin Brown
5a4a7026b6 /.github/{scripts,workflows}: use the issue-number arg in comment benchmarking job 2021-08-17 16:40:11 -07:00
Dustin Brown
cdbad5a4c8 /.github/{scripts, workflows}: performance benchmark async reports 2021-08-17 15:13:13 -07:00
Dustin Brown
08f7ec91ee /.github/{scripts,workflows}: fix args for gating job 2021-08-16 18:54:17 -07:00
Dustin Brown
822a6b6333 /.github/{scripts,workflows}: test args are working 2021-08-16 17:43:42 -07:00
Dustin Brown
41a6f3046c /.github/scripts/fuzzer/get-fuzzer-job-json.sh: run fuzzer basic 2021-08-10 16:38:54 -07:00
Dustin Brown
4b818cb963 /.github/{workflows, scripts}: test github-actions can create job 2021-08-10 16:36:01 -07:00
Dustin Brown
bbda57ef1e /.github/scripts/sql-correctness/get-dolt-correctness-job-json.sh: update queries to include result counts and total test count 2021-03-04 13:16:54 -08:00
Dustin Brown
3e90c2de75 /.github/scripts/sql-correctness/get-dolt-correctness-job-json.sh: run all tests 2021-02-19 18:04:13 -08:00
Dustin Brown
e2a944a72f /.github/scripts/sql-correctness/run-correctness.sh: print out 2021-02-19 17:29:35 -08:00
Dustin Brown
34f12ac53a /.github/scripts/sql-correctness/run-correctness.sh: fail job if not created 2021-02-19 17:25:22 -08:00
Dustin Brown
939b7cbfd8 /.github/{scripts, workflows}: iterating on correctness/email workflows 2021-02-19 16:22:07 -08:00
Dustin Brown
0ab55b5227 /.github/scripts/sql-correctness/get-dolt-correctness-job-json.sh: ignore skipped results 2021-02-18 14:33:38 -08:00
Dustin Brown
3eda0223cd /.github/{scripts,workflows}: complete workflow on successful job creation 2021-02-17 12:24:46 -08:00
Dustin Brown
798ba606d8 /.github/scripts/sql-correctness/get-dolt-correctness-job-json.sh: return percentage of correctness 2021-02-17 12:21:53 -08:00
Dustin Brown
618d430b75 /.github/{actions,scripts,workflows}: initial correctness workflow 2021-02-16 17:40:22 -08:00
Dustin Brown
077d344883 /.github/scripts/performance-benchmarking/run-benchmarks.sh: delete job on success only 2021-02-16 13:25:41 -08:00
Dustin Brown
7067c36ab2 /.github/scripts/performance-benchmarking/run-benchmarks.sh: bump timeout 2021-02-16 10:05:48 -08:00
Dustin Brown
062a76a3f2 /.github/scripts/performance-benchmarking/get-mysql-dolt-job-json.sh: add read write means back 2021-02-15 15:26:10 -08:00
Dustin Brown
6a8371f640 /.github/scripts/performance-benchmarking: fix split benchmarking tables 2021-02-15 14:58:13 -08:00
Dustin Brown
bf7b583f76 /.github/scripts/performance-benchmarking: separate delete 2021-02-12 15:13:17 -08:00
Dustin Brown
f1e1492b38 /.github/scripts/performance-benchmarking: split results read/write 2021-02-12 13:45:49 -08:00
Dustin Brown
c98fc3cfd1 /.github/scripts/performance-benchmarking: update performance queries 2021-02-12 12:00:11 -08:00
Dustin Brown
df3347dfef /.github/scripts/performance-benchmarking/run-benchmarks.sh: lowercase actor 2021-02-05 13:41:37 -08:00
Dustin Brown
1d576a71b8 /.github/scripts/performance-benchmarking/run-benchmarks.sh: differentiate job names to allow for multiple PR benchmark runs by a single actor 2021-01-26 11:29:50 -08:00
Dustin Brown
c5e6ebcb45 /.github/scripts/performance-benchmarking/get-dolt-dolt-job-json.sh: fix is faster case to use decimal, not percent 2021-01-23 16:44:00 -08:00
Dustin Brown
764a813a1e /.github/scripts/performance-benchmarking/{get-dolt-dolt-job-json.sh,get-mysql-dolt-job-json.sh}: specify limits that ensure each pod receives its own node 2021-01-22 15:41:08 -08:00
Dustin Brown
0a2f4a2027 /.github/scripts/performance-benchmarking/get-mysql-dolt-job-json.sh: add mean multiplier query 2021-01-22 14:15:27 -08:00
Dustin Brown
80d95d1a89 /.github/scripts/performance-benchmarking/get-mysql-dolt-job-json.sh: fix query division, add server names and versions 2021-01-22 11:42:45 -08:00
Dustin Brown
986094498b Merge pull request #1236 from dolthub/db/update-benchmarking-query
Update performance benchmarking queries and timeout
2021-01-22 10:44:24 -08:00