5 Commits

Author	SHA1	Message	Date
matt	d677cb2b08	feat: gzip compression for large payloads, persistent OLAP writes (#2368) ... * debug: remove event pub * add additional spans to publish message * debug: don't publish payloads * fix: persistent messages on olap * add back other payloads * remove pub buffers temporarily * fix: correct queue * hacky partitioning * add back pub buffers to scheduler * don't send no worker events * add attributes for queue name and message id to publish * add back pub buffers to grpc api * remove pubs again, no worker writes though * task processing queue hashes * remove payloads again * gzip compression over 5kb * add back task controller payloads * add back no worker requeueing event, with expirable lru cache * add back pub buffers * remove hash partitioned queues * small fixes * ignore lru cache top fn * config vars for compression, disable by default --------- Co-authored-by: Alexander Belanger <alexander@hatchet.run>	2025-10-08 11:44:04 -04:00
Mohammed Nafees	c5915a3b14	Add rate limiter around scheduler concurrency (#2021) ... * add rate limiter around scheduler concurrency * have upper limit * loadtest should pass now	2025-07-18 08:24:57 -04:00
abelanger5	5c5c1aa5a1	feat: more features in the load testing harness (#1691) ... * fix: make stripped payload size configurable * feat: more load test features * Update cmd/hatchet-loadtest/do.go Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * fix: try to fix load tests * increase timeout, update goleak ignores * fix: data race in scheduler with snapshot input * fix: logger improvements * add one more goleak ignore --------- Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>	2025-05-07 21:39:30 -04:00
abelanger5	ffbeafc204	revert: add back testing harness (#1659) ... * re-add new testing harness * add healthcheck port and pick random grpc port to listen on * feat: parallel load tests and faster tests * make parallelism = 5 * fix: lint * add linter to pre * fix: add back rampup fixes * reduce matrix on PR, add matrix to pre-release step * make load tests less likely to block * make limit strategy group round robin * uncomment lines	2025-05-01 15:22:30 -04:00
abelanger5	2c1f1f4808	test: improve Go testing harness (#1631) ... * test: improves testing harness for engine * update CI test * fix: race condition in test * make tests more stable * cleanup pub and sub buffers * fix: goleak on rampup test * feat: matrix tests for engine	2025-04-29 10:55:16 -04:00