mirror/hatchet
1
0
Fork 0
mirror of https://github.com/hatchet-dev/hatchet.git synced 2026-03-20 19:50:47 -05:00
Code Issues Packages Projects Releases Wiki Activity
2,470 Commits 254 Branches 944 Tags
c54671d81e18744d0820d21367d94de71a1c5cac
Commit Graph

494 Commits

Author SHA1 Message Date
matt
6c29e48204 Feat: Dynamic worker label assign (#3137) 
* feat: initial wiring work on desired labels

* feat: initial wiring

* chore: gen python

* fix: use the whole desired label thing instead

* fix: more wiring, improve types

* fix: sql type

* fix: len check

* chore: gen python

* fix: initial plural label work

* fix: store the labels properly on the task

* fix: skip cache on override

* fix: bug

* fix: scoping bug whoops

* chore: lint

* fix: send labels back over the api correctly

* feat: python test

* fix: lint

* fix: comment

* fix: override

* fix: namespaces, ugh

* fix: no need for error here

* chore: version

* feat: ruby, go, ts

* feat: versions

* fix: appease the rubocop

* chore: lint

* chore: bundle install

* fix: tests

* chore: lint

* chore: lint more

* fix: ts test

* fix: rb

* chore: gen

* chore: reset gemfile

* chore: reset changelog

* fix: pgroup

* fix: tests, part i

* Revert "chore: reset changelog"

This reverts commit b63bf7d3e5.

* Revert "chore: reset gemfile"

This reverts commit bb848bb6f0.

* fix: go -> golang mapping hack

* fix: go enums

* fix: appease the cop

* fix: namespace

* chore: gen
 2026-03-04 11:03:58 -05:00
Gabe Ruttner
c8f762c12e chore: simplify ruby e2e ci scripts (#3152) 
* chore: simplify start script

* chore: log

* fix: log paths

* fix: race?

* fix: deadlock?

---------

Co-authored-by: mrkaye97 <mrkaye97@gmail.com>
 2026-03-03 15:16:11 -08:00
abelanger5
e9eb65d9a8 feat: user callback additional methods (#3057) 
* add more opts to create user callback

* add session callbacks

* add more options to authenticate

* add full route info to routes map

* small refactor to reduce deps on session helpers
 2026-03-02 16:25:41 -05:00
matt
deee6e213c fix: external ids (#3111) 2026-02-26 12:57:33 -05:00
Mohammed Nafees
444a335c18 Fix cross-strategy slot contamination in chained concurrency gates (#3089) 
* filter properly based on strategy ids

* remove remnants

* add concurency integration test

* more tests
 2026-02-24 12:54:04 +01:00
Mohammed Nafees
44069cef89 make sure to use 60 seconds timeout for PutWorkflowVersion (#3085) 2026-02-23 16:20:31 +01:00
matt
df9e86081a Fix: Move event log to a tab on the task run detail (#3067) 
* fix: separate tab for activity on run detail

* fix: output payload bug

* fix: couple more uuid bugs

* fix: set var

* fix: add event type check
 2026-02-22 19:02:22 -08:00
Gabe Ruttner
2fdc47a6af feat: multiple slot types (#2927) 
* feat: adds support for multiple slot types, primarily motivated by durable slots

---------

Co-authored-by: mrkaye97 <mrkaye97@gmail.com>
 2026-02-17 05:43:47 -08:00
Gabe Ruttner
7875d78057 Feat: Official Ruby SDK (#3004) 
* feat: initial ruby sdk

* fix: run listener

* fix: scope

* feat: rest feature clients

* fix: bugs

* fix: concurrent register

* fix: tests and ergonomics

* docs: all of them

* chore: lint

* feat: add RBS

* feat: add GitHub Actions workflow for Ruby SDK with linting, testing, and publishing steps

* chore: lint

* refactor: simplify load path setup for Hatchet REST client and remove symlink creation

* fix: cert path

* fix: test

* fix: blocking

* fix: ensure Hatchet client is only initialized once across examples

* fix: tests

* remove: unused example

* fix: bubble up errors

* test: skip flaky for now

* remove: lifespans

* fix: durable context bugs

* fix: bulk replay

* fix: tests

* cleanup: generate tooling

* fix: integration test

* chore: lint

* release: 0.1.0

* chore: remove python comments

* refactor: remove OpenTelemetry configuration and related unused options

* fix: default no healthcheck

* chore: lockfile

* feat: register as ruby

* chore: lint

* chore: update py/ts apis to include ruby

* chore: docs pass

* chore: lint

* chore: generate

* chore: cleanup

* chore: generate examples

* tests: add e2e tests

* tests: cache examples dependencies

* fix: namespace

* fix: namespace

* fix: namespaces

* chore:lint

* fix: improve cancellation workflow polling logic and add error handling

* revert: py/ts versions
 2026-02-15 14:32:15 -08:00
Mohammed Nafees
ff15f00c94 [hotfix] Corrected custom value meter for resource limit (#3021) 
* fix cvm deducation

* switch clause

* add FIXME
 2026-02-13 21:20:33 +01:00
Mohammed Nafees
40a1044b44 New UpdateLimits method for TenantResourceLimit table (#2895) 
* new UpdateLimits method to tenant limits

* WIP: clean resource limits repo

* fmt changes and cvm needs to remain

* remove unnecessary metering logic

* updated openapi

* last fixes

* PR comments

* fixes

* default limits

* fix generate test

* fix lint
 2026-02-13 18:01:46 +01:00
abelanger5
851fbaf214 feat: reduced cold starts for new workers and queues (#2969) 
* feat: reduced cold starts for new workers and queues

* address changes from pr review

* fix: data race

* set logs to debug on the harness

* debug for queue level as well

* debug lines for queuer

* fix: add queue notifier to v0 workflow registration

* revert: lease manager interval

* revert log level changes

* add more debug, revert reverts

* more debug

* add debug to lease manager

* do it, try it

* fix: call upsertQueue as part of workflow version put

* change log level to error again

* pr review changes
 2026-02-11 13:12:10 -08:00
Mohammed Nafees
4fd7b94751 Add support for Svix webhooks (#2996) 
* support Svix webhooks

* add migration

* use http status codes

* comment fix

* custom svix verification logic

* copilot comments

* copilot comments
 2026-02-11 16:41:36 +01:00
Mohammed Nafees
5db655e9aa Do not replay invalid tasks (#2976) 
* filter valid tasks when replaying

* renamings

* query optim

* slice len

* fix method signature

* PR comments

* rename var

* PR comments
 2026-02-10 13:08:38 -05:00
matt
961682d704 Hotfix: More panics (#2945) 
* fix: check if dispatcher id is nil

* explicit nil check

* proposal: extra return out of `GetDispatcherIdsForWorkers`
 2026-02-04 19:08:17 -05:00
matt
811e0b7965 fix: make uuid optional for desired worker (#2946) 2026-02-04 17:12:07 -05:00
matt
a782d9fd01 Hotfix: UUID Panics (#2944) 
* fix: panic

* fix: more panic risks

* fix: two more possible panics
 2026-02-04 15:11:08 -05:00
Jishnu
ed43cae0a2 feat: Extend webhook support for scope_expression and payload (#2874) 
* add: scope_expression and payload columns for v1_webhook

* refactor: insert or update sql cmds for v1_webhook

* feat: update api clients, openapi schema for new webhook body

* refactor: receiver and transformer for v1 webhook

* add: python sdk changes

* feat: ts sdk changes

* feat: add FE for webhook new params

* fix: scope expression empty payload

* add: support for scope and payload for go client

* fix: lint

* fix: error message UI on webhook

* fix: lint

* fix: migraiton conflict, build failure

* fix: error handling

* update docs, add tests

* fix: lint, test file name
 2026-02-04 12:44:52 -05:00
abelanger5
051a930019 fix: explicit use of tx in olap readPayloads (#2925) 2026-02-03 16:19:36 -05:00
matt
058968c06b Refactor: Attempt II at removing pgtype.UUID everywhere + convert string UUIDs into uuid.UUID (#2894) 
* fix: add type override in sqlc.yaml

* chore: gen sqlc

* chore: big find and replace

* chore: more

* fix: clean up bunch of outdated `.Valid` refs

* refactor: remove `sqlchelpers.uuidFromStr()` in favor of `uuid.MustParse()`

* refactor: remove uuidToStr

* fix: lint

* fix: use pointers for null uuids

* chore: clean up more null pointers

* chore: clean up a bunch more

* fix: couple more

* fix: some types on the api

* fix: incorrectly non-null param

* fix: more nullable params

* fix: more refs

* refactor: start replacing tenant id strings with uuids

* refactor: more tenant id uuid casting

* refactor: fix a bunch more

* refactor: more

* refactor: more

* refactor: is that all of them?!

* fix: panic

* fix: rm scans

* fix: unwind some broken things

* chore: tests

* fix: rebase issues

* fix: more tests

* fix: nil checks

* Refactor: Make all UUIDs into `uuid.UUID` (#2897)

* refactor: remove a bunch more string uuids

* refactor: pointers and lists

* refactor: fix all the refs

* refactor: fix a few more

* fix: config loader

* fix: revert some changes

* fix: tests

* fix: test

* chore: proto

* fix: durable listener

* fix: some more string types

* fix: python health worker sleep

* fix: remove a bunch of `MustParse`s from the various gRPC servers

* fix: rm more uuid.MustParse calls

* fix: rm mustparse from api

* fix: test

* fix: merge issues

* fix: handle a bunch more uses of `MustParse` everywhere

* fix: nil id for worker label

* fix: more casting in the oss

* fix: more id parsing

* fix: stringify jwt opt

* fix: couple more bugs in untyped calls

* fix: more types

* fix: broken test

* refactor: implement `GetKeyUuid`

* chore: regen sqlc

* chore: replace pgtype.UUID again

* fix: bunch more type errors

* fix: panic
 2026-02-03 11:02:59 -05:00
abelanger5
d56dee4266 feat: durable user event log (#2861) 
* placeholder

* feat: db tables for user events (#2862)

* feat: db tables for user events

* move event payloads to payloads table, fix env var loading

* fix: address pr review comments

* missed save

* feat: optimistic scheduling (#2867)

* feat: db tables for user events

* move event payloads to payloads table, fix env var loading

* refactor: small changes to prepare optimistic txs

* feat: optimistic scheduling

* address pr review comments

* rm comments

* fix: rampup test race condition

* fix: goleak

* feat: grpc-side triggers

* fix: config and sem logic

* fix: respect optimistic scheduling env var

* add optimistic to testing matrix, remove pg-only mode

* fix cleanup of pubbuffers

* merge migrations

* last testing fixes
 2026-02-02 18:04:02 -05:00
Gabe Ruttner
4e59f301ec fix: dag update distinct locks (#2903) 
* lock only distinct

* try to fix dag statuses as well

---------

Co-authored-by: Alexander Belanger <alexander@hatchet.run>
 2026-02-02 05:53:19 -08:00
Gabe Ruttner
8186db18a4 fix: only fetch finalized workflow runs (#2896) 
* only fetch finalized

* further optimization

* configurable buffer
 2026-01-31 16:32:47 -05:00
abelanger5
04953129a4 fix: compute payload size correctly for pg_notify (#2873) 2026-01-31 16:31:49 -05:00
Gabe Ruttner
e1fd78138b fix: orphaned inactive queues (#2893) 
* fix

* fixme

* upsert at end

* unique and all strategies

* feedback

* string
 2026-01-30 14:05:05 -08:00
matt
ffe9f5ce74 Log Search Frontend, Part II (#2886) 
* fix: don't toggle selection if a user is dragging

* fix: command selection state

* fix: close search bar on enter

* fix: improve search bar styling a bit, make it more consistent with designs

* chore: tsc

* Feat: Logs Frontend, Part III (#2888)

* fix: propagate retry count through properly

* feat: attempt switcher

* fix: attempt numbers

* feat: add attempt param to log query

* feat: wiring

* feat: attempt filter

* chore: changelog

* fix: use the button component

* fix: only close on enter when in FTS mode

* fix: pass retry count and log level in Go

* fix: feedback

* chore: lint

* fix: rm cruft comment
 2026-01-30 13:17:21 -05:00
matt
a3fe89ef03 Feat: Workflow input JSON schema in trigger preview (#2851) 
* feat: add input json schema to workflow version

* feat: add json schema to putworkflow proto

* feat: wire up writes of the json schema

* chore: gen python

* feat: send json schema from the python code

* feat: wiring

* feat: pass json schema into code editor

* feat: pass prop

* fix: clean up validation stuff

* feat: allow zod `input` as optional ts field

* fix: try except logic hack

* fix: rename input -> inputValidator for consistency

* chore: gen api

* fix: improve hack slightly

* chore: changelogs, versions

* feat: zod example

* chore: rework api a bit

* fix: tsc, allow schema to update

* fix: improve loading state

* fix: api cleanup, sqlc cleanup

* fix: initial mount

* chore: lint

* chore: lint

* chore: tsc

* fix: lint

* fix: unwind unneeded change

* [Python] Feat: Default additional metadata (#2876)

* Add doc about autoscaling workers (#2864)

* add doc for autoscaling workers

* oldest also in running stats

* chore(deps): bump google.golang.org/api from 0.262.0 to 0.263.0 (#2869)

Bumps [google.golang.org/api](https://github.com/googleapis/google-api-go-client) from 0.262.0 to 0.263.0.
- [Release notes](https://github.com/googleapis/google-api-go-client/releases)
- [Changelog](https://github.com/googleapis/google-api-go-client/blob/main/CHANGES.md)
- [Commits](https://github.com/googleapis/google-api-go-client/compare/v0.262.0...v0.263.0)

---
updated-dependencies:
- dependency-name: google.golang.org/api
  dependency-version: 0.263.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* chore(deps): bump github.com/getsentry/sentry-go from 0.41.0 to 0.42.0 (#2870)

Bumps [github.com/getsentry/sentry-go](https://github.com/getsentry/sentry-go) from 0.41.0 to 0.42.0.
- [Release notes](https://github.com/getsentry/sentry-go/releases)
- [Changelog](https://github.com/getsentry/sentry-go/blob/master/CHANGELOG.md)
- [Commits](https://github.com/getsentry/sentry-go/compare/v0.41.0...v0.42.0)

---
updated-dependencies:
- dependency-name: github.com/getsentry/sentry-go
  dependency-version: 0.42.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* chore(deps): bump hatchet-sdk in /examples/python/quickstart (#2871)

Bumps hatchet-sdk from 1.22.10 to 1.22.11.

---
updated-dependencies:
- dependency-name: hatchet-sdk
  dependency-version: 1.22.11
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* feat: default additional meta

* feat: wiring

* chore: changelog, version

* fix: copy

* feat: add default meta to stubs

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: Mohammed Nafees <hello@mnafees.me>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* chore: migration ver

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: Mohammed Nafees <hello@mnafees.me>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2026-01-29 11:38:25 -05:00
Gabe Ruttner
a8afa07dcf fix: validate json at edges and dont retry on invalid (#2882) 
* drop and validate at edges

* rm submod

* use enum

* lint
 2026-01-29 08:04:55 -08:00
Gabe Ruttner
da6dcf049a fix: typo (#2875) 2026-01-29 05:20:50 -08:00
matt
3c416ee949 Feat: OTel Collector (#2863) 
* feat: initial otel collector work

* chore: vendor otel protos

* feat: add rate limiter for otelcol

* fix: clean up naming

* feat: shell implementation

* feat: add buf + generate protos

* fix: naming

* fix: naming

* chore: simplify a bit

* fix: rename logger

* fix: naming cleanup

* fix: rm unused var

* fix: rm unused struct

* chore: rm vendored stuff, don't need it apparently
 2026-01-28 14:10:15 -05:00
matt
1a5ea825bc Fix: Make metrics in graph align with badge metrics (#2858) 
* Revert "Revert "fix: make point metrics line up with badges (#2739)" (#2857)"

This reverts commit bc37fc7750.

* fix: naming
 2026-01-27 10:36:19 -05:00
matt
bc37fc7750 Revert "fix: make point metrics line up with badges (#2739)" (#2857) 
This reverts commit 26689a1b0f.
 2026-01-26 15:53:09 -05:00
Mohammed Nafees
b48f4bc307 fix with coalesce (#2856) 2026-01-26 21:40:54 +01:00
matt
26689a1b0f fix: make point metrics line up with badges (#2739) 2026-01-26 14:54:20 -05:00
matt
dcf1d377ca Feat: Add order by direction param to v1LogLineList (#2849) 
* feat: add order by direction param

* fix: order ascending on existing fe

* chore: gen openapi
 2026-01-26 14:01:03 -05:00
Mohammed Nafees
0a2b8944b3 more tenant related repo methods (#2854) 2026-01-26 19:54:01 +01:00
Gabe Ruttner
ffd0941dc3 fix: list concurrency strategies queries (#2838) 
* fixes

* lint
 2026-01-21 13:56:01 -08:00
matt
b093cc4878 Feat: Add search and levels to logs API (#2835) 
* feat: add log levels and search query to log query

* feat: pass levels, search through

* feat: add log level to query

* feat: wire up levels and search query
 2026-01-21 14:27:47 -05:00
Gabe Ruttner
81eb3f43b9 fix: flaky integration test (#2834) 
* disable cache

* simpler fix
 2026-01-21 09:10:35 -08:00
abelanger5
a6e88074de refactor: have log line lookups use external id (#2822) 
* fix: modify log line query to use external id

* pass in task external id
 2026-01-20 11:17:06 -05:00
Mohammed Nafees
6eba6fa91f Billing changes (#2643) 
* make changes for billing

* progress around redesign

* meter callback

* modify limits

* upcoming subscription

* fix lint

* fix payment methods

* fix build

* PR comments

* address PR comments

* update cloud contracts

* fix migration name

* fix json serialization error

* loader and fixed for managed compute

* PR comments

* upgrade Go version

* fix migration name

* fix CI

* fix lint CI

* golangci-lint fix

* dedicated subscription
 2026-01-19 12:15:11 +01:00
Mohammed Nafees
a0233964db New onboarding flow (#2757) 
Updates the onboarding flow to make it CLI-based.
 2026-01-16 10:09:44 -05:00
matt
3981626804 Fix: Concurrency display on workflow page (#2780) 
* chore: add task concurrency

* feat: wire up new concurrency field

* feat: clean up table

* feat: some page cleanup

* chore: cleanup

* chore: revert python changes

* feat: code highlighter

* chore: lint
 2026-01-12 15:44:44 -05:00
matt
ebe2f9acfd Feat: Add additional meta to the run detail getter (#2770) 
* feat: add additional meta to proto

* feat: propagate metadata

* feat: expand test

* fix: wiring

* chore: version

* chore: lint
 2026-01-12 13:46:16 -05:00
matt
6fcd064414 fix: statement timeout (#2774) 2026-01-11 11:43:40 -05:00
Michał Kostrzewa
a19a5b8ed5 fix: actually reconnect to postgres if conn fails. (#2772) 
Co-authored-by: abelanger5 <belanger@sas.upenn.edu>
 2026-01-10 17:28:37 -05:00
matt
09dd9dfbf7 fix: worker id (#2773) 2026-01-10 16:59:44 -05:00
matt
73229b0e21 Feat: Run detail getter on the engine (#2725) 
* feat: initial rpc

* chore: gen python

* feat: add more fields

* chore: gen again

* fix: finish cleaning up python

* feat: start wiring up api

* fix: panic

* feat: start implementing getters

* fix: improve api

* feat: expand return type a bit

* feat: more wiring

* feat: more wiring

* fix: finish wiring up input reads

* fix: admin client cleanup

* fix: ordering

* fix: add all_finished param

* feat: wire up all finished

* fix: propagate allfinished

* fix: propagate external ids

* chore: gen protos again

* fix: one more thing

* chore: rename

* chore: rename

* chore: fix typing

* fix: cleanup

* feat: add queued default

* fix: wiring

* feat: running check

* fix: query

* chore: rm print

* fix: edge case handling

* feat: python test

* feat: add `done` field

* feat: pass `done` through

* fix: test done flag

* fix: cleanup

* fix: handle cancelled

* refactor: clean up implementations of status handling

* fix: feedback

* fix: done logic

* fix: export run status

* fix: couple small bugs

* fix: handle done

* fix: properly extract input

* fix: bug with sequential dags

* refactor: improve performance of lookup query slightly

* refactor: add helpers on V1StepRunData for getting input + parsing bytes

* refactor: create listutils internal package

* refactor: status derivation

* fix: rm unused method

* fix: sqlcv1 import

* fix: error log

* fix: 404 on not found

* feat: changelog, async method
 2026-01-08 12:44:01 -05:00
abelanger5
32188b5a85 fix: better error on deprecated endpoints (#2763) 2026-01-08 11:32:14 -05:00
matt
479aaa9d2f fix: un-hard-code location (#2760) 2026-01-07 18:01:40 -05:00