mirror/hatchet
1
0
Fork 0
mirror of https://github.com/hatchet-dev/hatchet.git synced 2026-05-01 23:20:09 -05:00
Code Issues Packages Projects Releases Wiki Activity
1,971 Commits 279 Branches 1,030 Tags
b58359d7b34b1b910020cb3be95f2aa4de23ee42
Commit Graph

1971 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Mohammed Nafees b58359d7b3 Do not run cleanup on v1_workflow_concurrency_slot (#2463) 
* do not run cleanup on v1_concurrency_slot

* fix health endpoints for engine
v0.73.50 		2025-10-30 15:34:50 +01:00
Mohammed Nafees 91cdb28ddf Logs for liveness and readiness endpoints + PG conn stats (#2460) 
* error logs for liveness and readiness endpoints with pg information

* use context timeout of 3 seconds

* context
v0.73.49 		2025-10-30 14:35:02 +01:00
abelanger5 745918ba2c fix: reduce status update limits from 10k -> 1k (#2462) 
* reduce status update limits from 10k -> 1k

* remove comment
 2025-10-30 14:34:03 +01:00
dependabot[bot] 9d4baa798e chore(deps): bump google/osv-scanner-action from 2.2.3 to 2.2.4 (#2458) 
Bumps [google/osv-scanner-action](https://github.com/google/osv-scanner-action) from 2.2.3 to 2.2.4.
- [Release notes](https://github.com/google/osv-scanner-action/releases)
- [Commits](https://github.com/google/osv-scanner-action/compare/v2.2.3...v2.2.4)

---
updated-dependencies:
- dependency-name: google/osv-scanner-action
  dependency-version: 2.2.4
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2025-10-30 04:12:56 +00:00
github-actions[bot] bd8408b3e8 chore: regenerate examples (#2456) 
Co-authored-by: GitHub Action <action@github.com>
v0.73.48 		2025-10-29 07:36:23 +01:00
Sid Premkumar 4f7a8da580 Add support for non-wal payload store logic to skip main db (#2445) 2025-10-29 07:24:11 +01:00
dependabot[bot] 4172886999 chore(deps): bump github.com/getsentry/sentry-go from 0.36.1 to 0.36.2 (#2455) 
Bumps [github.com/getsentry/sentry-go](https://github.com/getsentry/sentry-go) from 0.36.1 to 0.36.2.
- [Release notes](https://github.com/getsentry/sentry-go/releases)
- [Changelog](https://github.com/getsentry/sentry-go/blob/master/CHANGELOG.md)
- [Commits](https://github.com/getsentry/sentry-go/compare/v0.36.1...v0.36.2)

---
updated-dependencies:
- dependency-name: github.com/getsentry/sentry-go
  dependency-version: 0.36.2
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2025-10-29 04:12:08 +00:00
dependabot[bot] 2ef0d62ada chore(deps): bump google.golang.org/api from 0.253.0 to 0.254.0 (#2454) 
Bumps [google.golang.org/api](https://github.com/googleapis/google-api-go-client) from 0.253.0 to 0.254.0.
- [Release notes](https://github.com/googleapis/google-api-go-client/releases)
- [Changelog](https://github.com/googleapis/google-api-go-client/blob/main/CHANGES.md)
- [Commits](https://github.com/googleapis/google-api-go-client/compare/v0.253.0...v0.254.0)

---
updated-dependencies:
- dependency-name: google.golang.org/api
  dependency-version: 0.254.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2025-10-29 04:11:50 +00:00
Mohammed Nafees f1eccfddf4 [hotfix] Fix running task stats without concurrency keys (#2452) 
* fix task stats running

* formatting

* if block fix
v0.73.47 		2025-10-28 22:19:52 +01:00
Mohammed Nafees 56eb054a1e New tenant task stats endpoint (#2433) 
* tenant workflow stats endpoint

* not olap but task

* lint

* enable rate limiting on endpoint

* fix SQL query

* spelling

* lesser CTEs

* fix query

* rename to task

* update query

* fix nil pointer

* typed API object

* queues have counts
v0.73.46 		2025-10-28 16:52:19 +01:00
Mohammed Nafees 54701e87d0 Retry RMQ messages indefinitely with aggressive logging after 5 retries (#2448) 
* aggressively log errors when rmq retry more than 5 times

* revisit comments

* new vars and fix integration test

* fix test

* log only after 5 retries
 2025-10-28 16:51:39 +01:00
Mohammed Nafees 8412a985e3 increase timeout to 30 seconds (#2449) 2025-10-28 16:50:36 +01:00
Sid Premkumar 94a1fb4523 Update contributing.md file to reflect recent updates (#2444) 
* Update contributing.md file to reflect recent updates

* PR feedback
 2025-10-28 10:19:49 -04:00
Mohammed Nafees c3a1ac621d fix confusing error (#2447) 2025-10-27 15:58:53 -04:00
dependabot[bot] 4df9367e4a chore(deps): bump hatchet-sdk in /examples/python/quickstart (#2443) 
Bumps hatchet-sdk from 1.20.1 to 1.20.2.

---
updated-dependencies:
- dependency-name: hatchet-sdk
  dependency-version: 1.20.2
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2025-10-24 04:27:44 +00:00
abelanger5 e1fdeeaf1c fix: payload performance (#2441) 
* change some olap flush settings

* increase timeouts for payload wal

* fix: improve performance of payload wal metrics

* slight updates

* more small tweaks

* undo some olap changes, don't offload some payloads

* remove double reads

* try reducing wal poll limit

* analyze v1_dag

* move partition method
v0.73.45 		2025-10-23 17:45:49 -04:00
Mohammed Nafees bd95b78f38 run cleanup job every minute (#2440) 2025-10-23 14:45:10 -04:00
Mohammed Nafees 1560a41751 Apply namespace to event triggers in the TypeScript SDK (#2434) 
* TS SDK bugfix for event trigger NS prefix

* fix lint

* update pnpm
 2025-10-23 18:43:51 +02:00
Mohammed Nafees 409b611d89 upgrade grpcio libs for python sdk (#2436) 2025-10-23 17:48:12 +02:00
Mohammed Nafees cf5c5989ff add vars to tune concurrency poller (#2428) 2025-10-23 11:36:12 -04:00
dependabot[bot] b78c61e797 chore(deps): bump google.golang.org/api from 0.252.0 to 0.253.0 (#2442) 
Bumps [google.golang.org/api](https://github.com/googleapis/google-api-go-client) from 0.252.0 to 0.253.0.
- [Release notes](https://github.com/googleapis/google-api-go-client/releases)
- [Changelog](https://github.com/googleapis/google-api-go-client/blob/main/CHANGES.md)
- [Commits](https://github.com/googleapis/google-api-go-client/compare/v0.252.0...v0.253.0)

---
updated-dependencies:
- dependency-name: google.golang.org/api
  dependency-version: 0.253.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2025-10-23 04:12:45 +00:00
dependabot[bot] 01be3b19ec chore(deps): bump github.com/posthog/posthog-go from 1.6.11 to 1.6.12 (#2438) 
Bumps [github.com/posthog/posthog-go](https://github.com/posthog/posthog-go) from 1.6.11 to 1.6.12.
- [Release notes](https://github.com/posthog/posthog-go/releases)
- [Changelog](https://github.com/PostHog/posthog-go/blob/master/CHANGELOG.md)
- [Commits](https://github.com/posthog/posthog-go/compare/v1.6.11...v1.6.12)

---
updated-dependencies:
- dependency-name: github.com/posthog/posthog-go
  dependency-version: 1.6.12
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2025-10-22 04:15:43 +00:00
dependabot[bot] 1492f57ebd chore(deps): bump github.com/getsentry/sentry-go from 0.36.0 to 0.36.1 (#2439) 
Bumps [github.com/getsentry/sentry-go](https://github.com/getsentry/sentry-go) from 0.36.0 to 0.36.1.
- [Release notes](https://github.com/getsentry/sentry-go/releases)
- [Changelog](https://github.com/getsentry/sentry-go/blob/master/CHANGELOG.md)
- [Commits](https://github.com/getsentry/sentry-go/compare/v0.36.0...v0.36.1)

---
updated-dependencies:
- dependency-name: github.com/getsentry/sentry-go
  dependency-version: 0.36.1
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2025-10-22 04:15:30 +00:00
abelanger5 1f35782b59 fix: move err check to before len check (#2437) v0.73.44 2025-10-21 19:24:19 -04:00
matt c6e154fd03 Feat: OLAP Payloads (#2410) 
* feat: olap payloads table

* feat: olap queue messages for payload puts

* feat: wire up writes on task write

* driveby: add + ignore psql-connect

* fix: down migration

* fix: use external id for pk

* fix: insert query

* fix: more external ids

* fix: bit more cleanup

* feat: dags

* fix: the rest of the refs

* fix: placeholder uuid

* fix: write external ids

* feat: wire up messages over the queue

* fix: panic

* Revert "fix: panic"

This reverts commit c0adccf2ea.

* Revert "feat: wire up messages over the queue"

This reverts commit 36f425f3c1.

* fix: rm unused method

* fix: rm more

* fix: rm cruft

* feat: wire up failures

* feat: start wiring up completed events

* fix: more wiring

* fix: finish wiring up completed event payloads

* fix: lint

* feat: start wiring up external ids in the core

* feat: olap pub

* fix: add returning

* fix: wiring

* debug: log lines for pubs

* fix: external id writes

* Revert "debug: log lines for pubs"

This reverts commit fe430840bd.

* fix: rm sample

* debug: rm pub buffer param

* Revert "debug: rm pub buffer param"

This reverts commit b42a5cacbb.

* debug: stuck queries

* debug: more logs

* debug: yet more logs

* fix: rename BulkRetrieve -> Retrieve

* chore: lint

* fix: naming

* fix: conn leak in putpayloads

* fix: revert debug

* Revert "debug: more logs"

This reverts commit 95da7de64f.

* Revert "debug: stuck queries"

This reverts commit 8fda64adc4.

* feat: improve getters, olap getter

* fix: key type

* feat: first pass at pulling olap payloads from the payload store

* fix: start fixing bugs

* fix: start reworking `includePayloads` param

* fix: include payloads wiring

* feat: analyze for payloads

* fix: simplify writes more + write event payloads

* feat: read out event payloads

* feat: env vars for dual writes

* refactor: clean up task prop drilling a bit

* feat: add include payloads params to python for tests

* fix: tx commit

* fix: dual writes

* fix: not null constraint

* fix: one more

* debug: logging

* fix: more debugging, tweak function sig

* fix: function sig

* fix: refs

* debug: more logging

* debug: more logging

* debug: fix condition

* debug: overwrite properly

* fix: revert debug

* fix: rm more drilling

* fix: comments

* fix: partitioning jobs

* chore: ver

* fix: bug, docs

* hack: dummy id and inserted at for payload offloads

* fix: bug

* fix: no need to handle offloads for task event data

* hack: jitter + current ts

* fix: short circuit

* fix: offload payloads in a tx

* fix: uncomment sampling

* fix: don't offload if external store is disabled

* chore: gen sqlc

* fix: migration

* fix: start reworking types

* fix: couple more

* fix: rm unused code

* fix: drill includePayloads down again

* fix: silence annoying error in some cases

* fix: always store payloads

* debug: use workflow run id for input

* fix: improve logging

* debug: logging on retrieve

* debug: task input

* fix: use correct field

* debug: write even null payloads to limit errors

* debug: hide error lines

* fix: quieting more errors

* fix: duplicate example names, remove print lines

* debug: add logging for olap event writes

* hack: immediate event offloads and cutovers

* fix: rm log line

* fix: import

* fix: short circuit events

* fix: duped names
v0.73.43 		2025-10-20 09:09:49 -04:00
Mohammed Nafees 8f57989730 fix race condition in child spawn (#2429) v0.73.42 2025-10-17 16:56:41 +02:00
Mohammed Nafees 0ef001c5ce Fix for Hatchet Lite to still properly fallback to using the postgres message queue kind (#2392) 
* fix for lite postgres msg kind

* support legacy flags as well
v0.73.41 		2025-10-16 18:54:25 +02:00
Mohammed Nafees e2b1f1353e Fix OTel span attribute naming convention (#2409) 
* rename spans according to convention

* low cardinality
v0.73.40 		2025-10-16 18:43:40 +02:00
Mohammed Nafees d9268c7270 Cleanup job for old and invalid entries (#2378) 
* auto run table cleanup

* batched cleanup of tables

* address PR comments

* fix timeout

* update queries

* fix shouldContinue

* also call cleanup for v1_workflow_concurrency_slot

* fix comment

* comment fix
 2025-10-16 16:51:08 +02:00
matt fb6720a909 Hotfix: Swallow idempotency key error for scheduled runs (#2425) 
* fix: attempt to swallow idempotency error on dupe

* fix: format a little better

* fix: comment

* fix: return early

* fix: comment

* fix: magic string

* fix: log level

* fix: comment
 2025-10-16 09:32:41 -04:00
dependabot[bot] 55e8ffde0d chore(deps): bump hatchet-sdk in /examples/python/quickstart (#2424) 
Bumps hatchet-sdk from 1.20.0 to 1.20.1.

---
updated-dependencies:
- dependency-name: hatchet-sdk
  dependency-version: 1.20.1
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2025-10-16 04:30:30 +00:00
Mohammed Nafees 8565d364ec [hotfix] Avoid throwing error logs from ratelimit MW for invalid API routes (#2420) 
* do not throw error level logs for invalid API routes from ratelimit MW

* use zerolog
 2025-10-16 00:13:54 +02:00
abelanger5 4e729ad9d4 fix: self-hosting doc (#2423) 2025-10-15 17:52:28 -04:00
matt aa38c6d2df fix: payload fallback for child runs (#2421) v0.73.39 v0.73.40-alpha.0 2025-10-15 16:16:51 -04:00
abelanger5 b16be655be feat: stateful polling intervals (#2417) 
* initial pass on stateful intervals

* pr review comments + add evict expired idempotency keys

* fix: goroutine leak and name vars better

* fix some cleanup logic
v0.73.38 		2025-10-15 11:40:22 -04:00
matt 5b5adcb8ed Feat: Scheduled run detail view, bulk cancel / replay with pagination helper (#2416) 
* feat: endpoint for listing external ids

* feat: wire up external id list

* chore: regen api

* feat: py sdk wrapper

* fix: since type

* fix: log

* fix: improve defaults for statuses

* feat: docs

* feat: docs

* fix: rm extra file

* feat: add id column to scheduled runs

* feat: side panel for scheduled runs

* fix: side panel header pinned

* fix: border + padding

* chore: gen

* chore: lint

* chore: changelog, version

* fix: spacing of cols

* fix: empty webhook resource limit

* fix: tsc

* fix: sort organizations and tenants alphabetically
 2025-10-15 11:36:45 -04:00
dependabot[bot] 14894f892b chore(deps): bump github.com/getsentry/sentry-go from 0.35.3 to 0.36.0 (#2418) 
Bumps [github.com/getsentry/sentry-go](https://github.com/getsentry/sentry-go) from 0.35.3 to 0.36.0.
- [Release notes](https://github.com/getsentry/sentry-go/releases)
- [Changelog](https://github.com/getsentry/sentry-go/blob/master/CHANGELOG.md)
- [Commits](https://github.com/getsentry/sentry-go/compare/v0.35.3...v0.36.0)

---
updated-dependencies:
- dependency-name: github.com/getsentry/sentry-go
  dependency-version: 0.36.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2025-10-15 04:14:35 +00:00
dependabot[bot] d7c375f95b chore(deps): bump actions/setup-node from 5 to 6 (#2414) 
Bumps [actions/setup-node](https://github.com/actions/setup-node) from 5 to 6.
- [Release notes](https://github.com/actions/setup-node/releases)
- [Commits](https://github.com/actions/setup-node/compare/v5...v6)

---
updated-dependencies:
- dependency-name: actions/setup-node
  dependency-version: '6'
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2025-10-14 11:20:05 -04:00
Mohammed Nafees 8a7505589e RunId for Run() (#2413) v0.73.37 2025-10-13 18:23:52 +02:00
Mohammed Nafees ddfea53d88 Fix type for hatchet.WithRunMetadata (#2406) 
* fix type for hatchet.WithRunMetadata

* edit documentation
v0.73.36 		2025-10-13 14:26:18 +02:00
dependabot[bot] ff5d77a645 chore(deps): bump github.com/posthog/posthog-go from 1.6.10 to 1.6.11 (#2411) 
Bumps [github.com/posthog/posthog-go](https://github.com/posthog/posthog-go) from 1.6.10 to 1.6.11.
- [Release notes](https://github.com/posthog/posthog-go/releases)
- [Changelog](https://github.com/PostHog/posthog-go/blob/master/CHANGELOG.md)
- [Commits](https://github.com/posthog/posthog-go/compare/v1.6.10...v1.6.11)

---
updated-dependencies:
- dependency-name: github.com/posthog/posthog-go
  dependency-version: 1.6.11
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2025-10-13 04:11:58 +00:00
Mohammed Nafees a750ce950d Introduce vars to tune ANALYZE job gocron run intervals (#2407) 
* introduce cars to tune ANALYZE job gocron run intervals

* update config doc

* fix assignment
 2025-10-10 11:02:10 +02:00
Mohammed Nafees 176edcbd12 increase stale issue days to 90 (#2405) 2025-10-10 11:01:42 +02:00
dependabot[bot] 58d6467ada chore(deps): bump github.com/go-co-op/gocron/v2 from 2.16.6 to 2.17.0 (#2408) 
Bumps [github.com/go-co-op/gocron/v2](https://github.com/go-co-op/gocron) from 2.16.6 to 2.17.0.
- [Release notes](https://github.com/go-co-op/gocron/releases)
- [Commits](https://github.com/go-co-op/gocron/compare/v2.16.6...v2.17.0)

---
updated-dependencies:
- dependency-name: github.com/go-co-op/gocron/v2
  dependency-version: 2.17.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2025-10-10 04:14:22 +00:00
Mohammed Nafees 0695db820c Use UTC for all pgx connections and check for database TZ (#2398) 
* set utc for all pgx sessions

* helper func

* also accept IANA Etc/UTC
 2025-10-09 10:54:27 +02:00
dependabot[bot] 0e92818616 chore(deps): bump golang.org/x/crypto from 0.42.0 to 0.43.0 (#2402) 
Bumps [golang.org/x/crypto](https://github.com/golang/crypto) from 0.42.0 to 0.43.0.
- [Commits](https://github.com/golang/crypto/compare/v0.42.0...v0.43.0)

---
updated-dependencies:
- dependency-name: golang.org/x/crypto
  dependency-version: 0.43.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2025-10-09 04:14:54 +00:00
dependabot[bot] c1d873d1c1 chore(deps): bump golang.org/x/time from 0.13.0 to 0.14.0 (#2400) 
Bumps [golang.org/x/time](https://github.com/golang/time) from 0.13.0 to 0.14.0.
- [Commits](https://github.com/golang/time/compare/v0.13.0...v0.14.0)

---
updated-dependencies:
- dependency-name: golang.org/x/time
  dependency-version: 0.14.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2025-10-09 04:13:58 +00:00
dependabot[bot] e443c3bbe0 chore(deps): bump golang.org/x/oauth2 from 0.31.0 to 0.32.0 (#2401) 
Bumps [golang.org/x/oauth2](https://github.com/golang/oauth2) from 0.31.0 to 0.32.0.
- [Commits](https://github.com/golang/oauth2/compare/v0.31.0...v0.32.0)

---
updated-dependencies:
- dependency-name: golang.org/x/oauth2
  dependency-version: 0.32.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2025-10-09 04:13:53 +00:00
abelanger5 d08bf6aac5 fix: optimize concurrency slot trigger method (#2391) 
* fix: optimize concurrency slot trigger method

* fix: migration ordering

---------

Co-authored-by: mrkaye97 <mrkaye97@gmail.com>
v0.73.35 		2025-10-08 11:50:54 -04:00
matt d677cb2b08 feat: gzip compression for large payloads, persistent OLAP writes (#2368) 
* debug: remove event pub

* add additional spans to publish message

* debug: don't publish payloads

* fix: persistent messages on olap

* add back other payloads

* remove pub buffers temporarily

* fix: correct queue

* hacky partitioning

* add back pub buffers to scheduler

* don't send no worker events

* add attributes for queue name and message id to publish

* add back pub buffers to grpc api

* remove pubs again, no worker writes though

* task processing queue hashes

* remove payloads again

* gzip compression over 5kb

* add back task controller payloads

* add back no worker requeueing event, with expirable lru cache

* add back pub buffers

* remove hash partitioned queues

* small fixes

* ignore lru cache top fn

* config vars for compression, disable by default

---------

Co-authored-by: Alexander Belanger <alexander@hatchet.run>
 2025-10-08 11:44:04 -04:00