abelanger5
e1fdeeaf1c
fix: payload performance ( #2441 )
...
* change some olap flush settings
* increase timeouts for payload wal
* fix: improve performance of payload wal metrics
* slight updates
* more small tweaks
* undo some olap changes, don't offload some payloads
* remove double reads
* try reducing wal poll limit
* analyze v1_dag
* move partition method
2025-10-23 17:45:49 -04:00
Mohammed Nafees
bd95b78f38
run cleanup job every minute ( #2440 )
2025-10-23 14:45:10 -04:00
Mohammed Nafees
1560a41751
Apply namespace to event triggers in the TypeScript SDK ( #2434 )
...
* TS SDK bugfix for event trigger NS prefix
* fix lint
* update pnpm
2025-10-23 18:43:51 +02:00
Mohammed Nafees
409b611d89
upgrade grpcio libs for python sdk ( #2436 )
2025-10-23 17:48:12 +02:00
Mohammed Nafees
cf5c5989ff
add vars to tune concurrency poller ( #2428 )
2025-10-23 11:36:12 -04:00
dependabot[bot]
b78c61e797
chore(deps): bump google.golang.org/api from 0.252.0 to 0.253.0 ( #2442 )
...
Bumps [google.golang.org/api](https://github.com/googleapis/google-api-go-client ) from 0.252.0 to 0.253.0.
- [Release notes](https://github.com/googleapis/google-api-go-client/releases )
- [Changelog](https://github.com/googleapis/google-api-go-client/blob/main/CHANGES.md )
- [Commits](https://github.com/googleapis/google-api-go-client/compare/v0.252.0...v0.253.0 )
---
updated-dependencies:
- dependency-name: google.golang.org/api
dependency-version: 0.253.0
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-10-23 04:12:45 +00:00
dependabot[bot]
01be3b19ec
chore(deps): bump github.com/posthog/posthog-go from 1.6.11 to 1.6.12 ( #2438 )
...
Bumps [github.com/posthog/posthog-go](https://github.com/posthog/posthog-go ) from 1.6.11 to 1.6.12.
- [Release notes](https://github.com/posthog/posthog-go/releases )
- [Changelog](https://github.com/PostHog/posthog-go/blob/master/CHANGELOG.md )
- [Commits](https://github.com/posthog/posthog-go/compare/v1.6.11...v1.6.12 )
---
updated-dependencies:
- dependency-name: github.com/posthog/posthog-go
dependency-version: 1.6.12
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-10-22 04:15:43 +00:00
dependabot[bot]
1492f57ebd
chore(deps): bump github.com/getsentry/sentry-go from 0.36.0 to 0.36.1 ( #2439 )
...
Bumps [github.com/getsentry/sentry-go](https://github.com/getsentry/sentry-go ) from 0.36.0 to 0.36.1.
- [Release notes](https://github.com/getsentry/sentry-go/releases )
- [Changelog](https://github.com/getsentry/sentry-go/blob/master/CHANGELOG.md )
- [Commits](https://github.com/getsentry/sentry-go/compare/v0.36.0...v0.36.1 )
---
updated-dependencies:
- dependency-name: github.com/getsentry/sentry-go
dependency-version: 0.36.1
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-10-22 04:15:30 +00:00
abelanger5
1f35782b59
fix: move err check to before len check ( #2437 )
2025-10-21 19:24:19 -04:00
matt
c6e154fd03
Feat: OLAP Payloads ( #2410 )
...
* feat: olap payloads table
* feat: olap queue messages for payload puts
* feat: wire up writes on task write
* driveby: add + ignore psql-connect
* fix: down migration
* fix: use external id for pk
* fix: insert query
* fix: more external ids
* fix: bit more cleanup
* feat: dags
* fix: the rest of the refs
* fix: placeholder uuid
* fix: write external ids
* feat: wire up messages over the queue
* fix: panic
* Revert "fix: panic"
This reverts commit c0adccf2ea36f425f3c1fe430840bdb42a5cacbb95da7de64f8fda64adc4
2025-10-20 09:09:49 -04:00
Mohammed Nafees
8f57989730
fix race condition in child spawn ( #2429 )
2025-10-17 16:56:41 +02:00
Mohammed Nafees
0ef001c5ce
Fix for Hatchet Lite to still properly fallback to using the postgres message queue kind ( #2392 )
...
* fix for lite postgres msg kind
* support legacy flags as well
2025-10-16 18:54:25 +02:00
Mohammed Nafees
e2b1f1353e
Fix OTel span attribute naming convention ( #2409 )
...
* rename spans according to convention
* low cardinality
2025-10-16 18:43:40 +02:00
Mohammed Nafees
d9268c7270
Cleanup job for old and invalid entries ( #2378 )
...
* auto run table cleanup
* batched cleanup of tables
* address PR comments
* fix timeout
* update queries
* fix shouldContinue
* also call cleanup for v1_workflow_concurrency_slot
* fix comment
* comment fix
2025-10-16 16:51:08 +02:00
matt
fb6720a909
Hotfix: Swallow idempotency key error for scheduled runs ( #2425 )
...
* fix: attempt to swallow idempotency error on dupe
* fix: format a little better
* fix: comment
* fix: return early
* fix: comment
* fix: magic string
* fix: log level
* fix: comment
2025-10-16 09:32:41 -04:00
dependabot[bot]
55e8ffde0d
chore(deps): bump hatchet-sdk in /examples/python/quickstart ( #2424 )
...
Bumps hatchet-sdk from 1.20.0 to 1.20.1.
---
updated-dependencies:
- dependency-name: hatchet-sdk
dependency-version: 1.20.1
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-10-16 04:30:30 +00:00
Mohammed Nafees
8565d364ec
[hotfix] Avoid throwing error logs from ratelimit MW for invalid API routes ( #2420 )
...
* do not throw error level logs for invalid API routes from ratelimit MW
* use zerolog
2025-10-16 00:13:54 +02:00
abelanger5
4e729ad9d4
fix: self-hosting doc ( #2423 )
2025-10-15 17:52:28 -04:00
matt
aa38c6d2df
fix: payload fallback for child runs ( #2421 )
2025-10-15 16:16:51 -04:00
abelanger5
b16be655be
feat: stateful polling intervals ( #2417 )
...
* initial pass on stateful intervals
* pr review comments + add evict expired idempotency keys
* fix: goroutine leak and name vars better
* fix some cleanup logic
2025-10-15 11:40:22 -04:00
matt
5b5adcb8ed
Feat: Scheduled run detail view, bulk cancel / replay with pagination helper ( #2416 )
...
* feat: endpoint for listing external ids
* feat: wire up external id list
* chore: regen api
* feat: py sdk wrapper
* fix: since type
* fix: log
* fix: improve defaults for statuses
* feat: docs
* feat: docs
* fix: rm extra file
* feat: add id column to scheduled runs
* feat: side panel for scheduled runs
* fix: side panel header pinned
* fix: border + padding
* chore: gen
* chore: lint
* chore: changelog, version
* fix: spacing of cols
* fix: empty webhook resource limit
* fix: tsc
* fix: sort organizations and tenants alphabetically
2025-10-15 11:36:45 -04:00
dependabot[bot]
14894f892b
chore(deps): bump github.com/getsentry/sentry-go from 0.35.3 to 0.36.0 ( #2418 )
...
Bumps [github.com/getsentry/sentry-go](https://github.com/getsentry/sentry-go ) from 0.35.3 to 0.36.0.
- [Release notes](https://github.com/getsentry/sentry-go/releases )
- [Changelog](https://github.com/getsentry/sentry-go/blob/master/CHANGELOG.md )
- [Commits](https://github.com/getsentry/sentry-go/compare/v0.35.3...v0.36.0 )
---
updated-dependencies:
- dependency-name: github.com/getsentry/sentry-go
dependency-version: 0.36.0
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-10-15 04:14:35 +00:00
dependabot[bot]
d7c375f95b
chore(deps): bump actions/setup-node from 5 to 6 ( #2414 )
...
Bumps [actions/setup-node](https://github.com/actions/setup-node ) from 5 to 6.
- [Release notes](https://github.com/actions/setup-node/releases )
- [Commits](https://github.com/actions/setup-node/compare/v5...v6 )
---
updated-dependencies:
- dependency-name: actions/setup-node
dependency-version: '6'
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-10-14 11:20:05 -04:00
Mohammed Nafees
8a7505589e
RunId for Run() ( #2413 )
2025-10-13 18:23:52 +02:00
Mohammed Nafees
ddfea53d88
Fix type for hatchet.WithRunMetadata ( #2406 )
...
* fix type for hatchet.WithRunMetadata
* edit documentation
2025-10-13 14:26:18 +02:00
dependabot[bot]
ff5d77a645
chore(deps): bump github.com/posthog/posthog-go from 1.6.10 to 1.6.11 ( #2411 )
...
Bumps [github.com/posthog/posthog-go](https://github.com/posthog/posthog-go ) from 1.6.10 to 1.6.11.
- [Release notes](https://github.com/posthog/posthog-go/releases )
- [Changelog](https://github.com/PostHog/posthog-go/blob/master/CHANGELOG.md )
- [Commits](https://github.com/posthog/posthog-go/compare/v1.6.10...v1.6.11 )
---
updated-dependencies:
- dependency-name: github.com/posthog/posthog-go
dependency-version: 1.6.11
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-10-13 04:11:58 +00:00
Mohammed Nafees
a750ce950d
Introduce vars to tune ANALYZE job gocron run intervals ( #2407 )
...
* introduce cars to tune ANALYZE job gocron run intervals
* update config doc
* fix assignment
2025-10-10 11:02:10 +02:00
Mohammed Nafees
176edcbd12
increase stale issue days to 90 ( #2405 )
2025-10-10 11:01:42 +02:00
dependabot[bot]
58d6467ada
chore(deps): bump github.com/go-co-op/gocron/v2 from 2.16.6 to 2.17.0 ( #2408 )
...
Bumps [github.com/go-co-op/gocron/v2](https://github.com/go-co-op/gocron ) from 2.16.6 to 2.17.0.
- [Release notes](https://github.com/go-co-op/gocron/releases )
- [Commits](https://github.com/go-co-op/gocron/compare/v2.16.6...v2.17.0 )
---
updated-dependencies:
- dependency-name: github.com/go-co-op/gocron/v2
dependency-version: 2.17.0
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-10-10 04:14:22 +00:00
Mohammed Nafees
0695db820c
Use UTC for all pgx connections and check for database TZ ( #2398 )
...
* set utc for all pgx sessions
* helper func
* also accept IANA Etc/UTC
2025-10-09 10:54:27 +02:00
dependabot[bot]
0e92818616
chore(deps): bump golang.org/x/crypto from 0.42.0 to 0.43.0 ( #2402 )
...
Bumps [golang.org/x/crypto](https://github.com/golang/crypto ) from 0.42.0 to 0.43.0.
- [Commits](https://github.com/golang/crypto/compare/v0.42.0...v0.43.0 )
---
updated-dependencies:
- dependency-name: golang.org/x/crypto
dependency-version: 0.43.0
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-10-09 04:14:54 +00:00
dependabot[bot]
c1d873d1c1
chore(deps): bump golang.org/x/time from 0.13.0 to 0.14.0 ( #2400 )
...
Bumps [golang.org/x/time](https://github.com/golang/time ) from 0.13.0 to 0.14.0.
- [Commits](https://github.com/golang/time/compare/v0.13.0...v0.14.0 )
---
updated-dependencies:
- dependency-name: golang.org/x/time
dependency-version: 0.14.0
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-10-09 04:13:58 +00:00
dependabot[bot]
e443c3bbe0
chore(deps): bump golang.org/x/oauth2 from 0.31.0 to 0.32.0 ( #2401 )
...
Bumps [golang.org/x/oauth2](https://github.com/golang/oauth2 ) from 0.31.0 to 0.32.0.
- [Commits](https://github.com/golang/oauth2/compare/v0.31.0...v0.32.0 )
---
updated-dependencies:
- dependency-name: golang.org/x/oauth2
dependency-version: 0.32.0
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-10-09 04:13:53 +00:00
abelanger5
d08bf6aac5
fix: optimize concurrency slot trigger method ( #2391 )
...
* fix: optimize concurrency slot trigger method
* fix: migration ordering
---------
Co-authored-by: mrkaye97 <mrkaye97@gmail.com >
2025-10-08 11:50:54 -04:00
matt
d677cb2b08
feat: gzip compression for large payloads, persistent OLAP writes ( #2368 )
...
* debug: remove event pub
* add additional spans to publish message
* debug: don't publish payloads
* fix: persistent messages on olap
* add back other payloads
* remove pub buffers temporarily
* fix: correct queue
* hacky partitioning
* add back pub buffers to scheduler
* don't send no worker events
* add attributes for queue name and message id to publish
* add back pub buffers to grpc api
* remove pubs again, no worker writes though
* task processing queue hashes
* remove payloads again
* gzip compression over 5kb
* add back task controller payloads
* add back no worker requeueing event, with expirable lru cache
* add back pub buffers
* remove hash partitioned queues
* small fixes
* ignore lru cache top fn
* config vars for compression, disable by default
---------
Co-authored-by: Alexander Belanger <alexander@hatchet.run >
2025-10-08 11:44:04 -04:00
matt
c48a3211b5
Feat: Immediate Payload Offloads ( #2375 )
...
* feat: modify operations
* feat: attempt 1 at doing the cutover + the offload in the same query
* fix: operation write
* debug: add some print lines
* fix: check constraint
* fix: select records to offload properly
* fix: fn
* feat: add second table to hold queued cutovers
* fix: start reworking queries
* fix: select
* fix: missing cols
* fix: for update
* fix: query name for finalize
* feat: cut over query finalizer
* feat: query for writes into cutover queue
* feat: add query for cut over polling
* feat: add cutover job
* fix: rm operations
* feat: write cutover queue items at the same time as setting payload keys
* fix: simplify into single query
* fix: revert debug
* chore: lint
* fix: don't remove operation column yet
* feat: refactor into struct of opts and make job intervals configurable
* fix: add analyze for payload table
* fix: schema copy paste
* fix: drop fk
* feat: add an index to help with poll performance for a short while
* fix: simplify poll ordering
* fix: simplify more
* fix: ctx
Co-authored-by: Mohammed Nafees <hello@mnafees.me >
* Feat: Task Event and DAG Payloads (#2370 )
* feat: initial work on task event payloads
* fix: iterator
* feat: wire up task events
* fix: backwards compat
* fix: migrations
* fix: duplication
* fix: col
* fix: add timestamptz col
* fix: overwrite
* fix: rm debugging
* fix: revert debugging
* fix: rm unused cols
* fix: spelling
* fix: use `current_timestamp` as default
* feat: dual writes for payloads
* fix: improve debug lines
* debug: add log
* debug: always write
* fix: make annoying log debug level
* fix: rm debug lines
* fix: add comment
* feat: dag payloads
* fix: index
* fix: migration ver
* fix: error msg
Co-authored-by: abelanger5 <belanger@sas.upenn.edu >
* fix: create, then set default
* fix: inserted at copy paste
* fix: n+1 query
* fix: another n+1 query
* fix: rm unused singleton retrieve
---------
Co-authored-by: abelanger5 <belanger@sas.upenn.edu >
---------
Co-authored-by: Mohammed Nafees <hello@mnafees.me >
Co-authored-by: abelanger5 <belanger@sas.upenn.edu >
2025-10-08 11:22:34 -04:00
matt
8fd90a29a6
Feat: Pausable Crons ( #2395 )
...
* feat: update query, patch route
* feat: api for update
* fix: simplify ui a bit
* feat: wire up fe
* feat: improve copy, spinners
* fix: invert naming to avoid horrible double negative
* fix: improve handling of optional types
* fix: last bits of naming
* feat: persist enabled flag across workflow versions properly
* fix: update spinner
2025-10-08 11:12:14 -04:00
Mohammed Nafees
ccf92482d8
properly case on output byte length ( #2394 )
2025-10-08 12:06:30 +02:00
dependabot[bot]
f998393ec3
chore(deps): bump google.golang.org/api from 0.251.0 to 0.252.0 ( #2397 )
...
Bumps [google.golang.org/api](https://github.com/googleapis/google-api-go-client ) from 0.251.0 to 0.252.0.
- [Release notes](https://github.com/googleapis/google-api-go-client/releases )
- [Changelog](https://github.com/googleapis/google-api-go-client/blob/main/CHANGES.md )
- [Commits](https://github.com/googleapis/google-api-go-client/compare/v0.251.0...v0.252.0 )
---
updated-dependencies:
- dependency-name: google.golang.org/api
dependency-version: 0.252.0
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-10-08 04:12:31 +00:00
matt
20b465c068
[Docs]: Improve triggering from external services section, fix dependabot vuln ( #2393 )
...
* fix: override prismjs version
* fix: confusing inter-service triggering page
* fix: grammar
2025-10-07 11:58:44 -04:00
dependabot[bot]
4e430eb863
chore(deps): bump google.golang.org/grpc from 1.75.1 to 1.76.0 ( #2389 )
...
Bumps [google.golang.org/grpc](https://github.com/grpc/grpc-go ) from 1.75.1 to 1.76.0.
- [Release notes](https://github.com/grpc/grpc-go/releases )
- [Commits](https://github.com/grpc/grpc-go/compare/v1.75.1...v1.76.0 )
---
updated-dependencies:
- dependency-name: google.golang.org/grpc
dependency-version: 1.76.0
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-10-07 04:11:40 +00:00
dependabot[bot]
e7fc6b001c
chore(deps): bump hatchet-sdk in /examples/python/quickstart ( #2388 )
...
Bumps hatchet-sdk from 1.19.0 to 1.20.0.
---
updated-dependencies:
- dependency-name: hatchet-sdk
dependency-version: 1.20.0
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-10-06 04:32:20 +00:00
dependabot[bot]
c0d981c52b
chore(deps): bump github.com/go-playground/validator/v10 ( #2387 )
...
Bumps [github.com/go-playground/validator/v10](https://github.com/go-playground/validator ) from 10.27.0 to 10.28.0.
- [Release notes](https://github.com/go-playground/validator/releases )
- [Commits](https://github.com/go-playground/validator/compare/v10.27.0...v10.28.0 )
---
updated-dependencies:
- dependency-name: github.com/go-playground/validator/v10
dependency-version: 10.28.0
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-10-06 04:12:29 +00:00
dependabot[bot]
afb592db3f
chore(deps): bump github.com/pressly/goose/v3 from 3.25.0 to 3.26.0 ( #2386 )
...
Bumps [github.com/pressly/goose/v3](https://github.com/pressly/goose ) from 3.25.0 to 3.26.0.
- [Release notes](https://github.com/pressly/goose/releases )
- [Changelog](https://github.com/pressly/goose/blob/main/CHANGELOG.md )
- [Commits](https://github.com/pressly/goose/compare/v3.25.0...v3.26.0 )
---
updated-dependencies:
- dependency-name: github.com/pressly/goose/v3
dependency-version: 3.26.0
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-10-06 04:12:19 +00:00
matt
dfc5074057
Fix: Payload fallbacks, WAL conflict handling, WAL eviction ( #2372 )
...
* fix: improve error handling
* fix: add default operation
* fix: dont write operation
* fix: refactor offload to always evict
* fix: err check
* fix: err
2025-10-03 14:50:46 -04:00
matt
2a08cbf77b
[Python]: Remove refs to *_group_key_* ( #2379 )
...
* chore: remove all group key refs
* fix: rm engine version refs
* chore: version + changelog
2025-10-03 12:52:05 -04:00
Mohammed Nafees
ed40a82dbb
Include tenant_id in OTel spans wherever possible ( #2382 )
2025-10-03 18:16:16 +02:00
matt
bb1de91254
fix: run analyze every 3 hours ( #2380 )
2025-10-03 09:49:35 -04:00
dependabot[bot]
7f0d43eecc
chore(deps): bump google.golang.org/protobuf from 1.36.9 to 1.36.10 ( #2381 )
...
Bumps google.golang.org/protobuf from 1.36.9 to 1.36.10.
---
updated-dependencies:
- dependency-name: google.golang.org/protobuf
dependency-version: 1.36.10
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-10-03 04:14:20 +00:00
Mohammed Nafees
cb91f7033d
Serve management API swagger docs ( #2333 )
...
* serve management API swagger docs
* fix lint
2025-10-02 14:42:26 +02:00
