Commit Graph

1931 Commits

Author SHA1 Message Date
dependabot[bot] ff5d77a645 chore(deps): bump github.com/posthog/posthog-go from 1.6.10 to 1.6.11 (#2411)
Bumps [github.com/posthog/posthog-go](https://github.com/posthog/posthog-go) from 1.6.10 to 1.6.11.
- [Release notes](https://github.com/posthog/posthog-go/releases)
- [Changelog](https://github.com/PostHog/posthog-go/blob/master/CHANGELOG.md)
- [Commits](https://github.com/posthog/posthog-go/compare/v1.6.10...v1.6.11)

---
updated-dependencies:
- dependency-name: github.com/posthog/posthog-go
  dependency-version: 1.6.11
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-10-13 04:11:58 +00:00
Mohammed Nafees a750ce950d Introduce vars to tune ANALYZE job gocron run intervals (#2407)
* introduce cars to tune ANALYZE job gocron run intervals

* update config doc

* fix assignment
2025-10-10 11:02:10 +02:00
Mohammed Nafees 176edcbd12 increase stale issue days to 90 (#2405) 2025-10-10 11:01:42 +02:00
dependabot[bot] 58d6467ada chore(deps): bump github.com/go-co-op/gocron/v2 from 2.16.6 to 2.17.0 (#2408)
Bumps [github.com/go-co-op/gocron/v2](https://github.com/go-co-op/gocron) from 2.16.6 to 2.17.0.
- [Release notes](https://github.com/go-co-op/gocron/releases)
- [Commits](https://github.com/go-co-op/gocron/compare/v2.16.6...v2.17.0)

---
updated-dependencies:
- dependency-name: github.com/go-co-op/gocron/v2
  dependency-version: 2.17.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-10-10 04:14:22 +00:00
Mohammed Nafees 0695db820c Use UTC for all pgx connections and check for database TZ (#2398)
* set utc for all pgx sessions

* helper func

* also accept IANA Etc/UTC
2025-10-09 10:54:27 +02:00
dependabot[bot] 0e92818616 chore(deps): bump golang.org/x/crypto from 0.42.0 to 0.43.0 (#2402)
Bumps [golang.org/x/crypto](https://github.com/golang/crypto) from 0.42.0 to 0.43.0.
- [Commits](https://github.com/golang/crypto/compare/v0.42.0...v0.43.0)

---
updated-dependencies:
- dependency-name: golang.org/x/crypto
  dependency-version: 0.43.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-10-09 04:14:54 +00:00
dependabot[bot] c1d873d1c1 chore(deps): bump golang.org/x/time from 0.13.0 to 0.14.0 (#2400)
Bumps [golang.org/x/time](https://github.com/golang/time) from 0.13.0 to 0.14.0.
- [Commits](https://github.com/golang/time/compare/v0.13.0...v0.14.0)

---
updated-dependencies:
- dependency-name: golang.org/x/time
  dependency-version: 0.14.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-10-09 04:13:58 +00:00
dependabot[bot] e443c3bbe0 chore(deps): bump golang.org/x/oauth2 from 0.31.0 to 0.32.0 (#2401)
Bumps [golang.org/x/oauth2](https://github.com/golang/oauth2) from 0.31.0 to 0.32.0.
- [Commits](https://github.com/golang/oauth2/compare/v0.31.0...v0.32.0)

---
updated-dependencies:
- dependency-name: golang.org/x/oauth2
  dependency-version: 0.32.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-10-09 04:13:53 +00:00
abelanger5 d08bf6aac5 fix: optimize concurrency slot trigger method (#2391)
* fix: optimize concurrency slot trigger method

* fix: migration ordering

---------

Co-authored-by: mrkaye97 <mrkaye97@gmail.com>
v0.73.35
2025-10-08 11:50:54 -04:00
matt d677cb2b08 feat: gzip compression for large payloads, persistent OLAP writes (#2368)
* debug: remove event pub

* add additional spans to publish message

* debug: don't publish payloads

* fix: persistent messages on olap

* add back other payloads

* remove pub buffers temporarily

* fix: correct queue

* hacky partitioning

* add back pub buffers to scheduler

* don't send no worker events

* add attributes for queue name and message id to publish

* add back pub buffers to grpc api

* remove pubs again, no worker writes though

* task processing queue hashes

* remove payloads again

* gzip compression over 5kb

* add back task controller payloads

* add back no worker requeueing event, with expirable lru cache

* add back pub buffers

* remove hash partitioned queues

* small fixes

* ignore lru cache top fn

* config vars for compression, disable by default

---------

Co-authored-by: Alexander Belanger <alexander@hatchet.run>
2025-10-08 11:44:04 -04:00
matt c48a3211b5 Feat: Immediate Payload Offloads (#2375)
* feat: modify operations

* feat: attempt 1 at doing the cutover + the offload in the same query

* fix: operation write

* debug: add some print lines

* fix: check constraint

* fix: select records to offload properly

* fix: fn

* feat: add second table to hold queued cutovers

* fix: start reworking queries

* fix: select

* fix: missing cols

* fix: for update

* fix: query name for finalize

* feat: cut over query finalizer

* feat: query for writes into cutover queue

* feat: add query for cut over polling

* feat: add cutover job

* fix: rm operations

* feat: write cutover queue items at the same time as setting payload keys

* fix: simplify into single query

* fix: revert debug

* chore: lint

* fix: don't remove operation column yet

* feat: refactor into struct of opts and make job intervals configurable

* fix: add analyze for payload table

* fix: schema copy paste

* fix: drop fk

* feat: add an index to help with poll performance for a short while

* fix: simplify poll ordering

* fix: simplify more

* fix: ctx

Co-authored-by: Mohammed Nafees <hello@mnafees.me>

* Feat: Task Event and DAG Payloads (#2370)

* feat: initial work on task event payloads

* fix: iterator

* feat: wire up task events

* fix: backwards compat

* fix: migrations

* fix: duplication

* fix: col

* fix: add timestamptz col

* fix: overwrite

* fix: rm debugging

* fix: revert debugging

* fix: rm unused cols

* fix: spelling

* fix: use `current_timestamp` as default

* feat: dual writes for payloads

* fix: improve debug lines

* debug: add log

* debug: always write

* fix: make annoying log debug level

* fix: rm debug lines

* fix: add comment

* feat: dag payloads

* fix: index

* fix: migration ver

* fix: error msg

Co-authored-by: abelanger5 <belanger@sas.upenn.edu>

* fix: create, then set default

* fix: inserted at copy paste

* fix: n+1 query

* fix: another n+1 query

* fix: rm unused singleton retrieve

---------

Co-authored-by: abelanger5 <belanger@sas.upenn.edu>

---------

Co-authored-by: Mohammed Nafees <hello@mnafees.me>
Co-authored-by: abelanger5 <belanger@sas.upenn.edu>
2025-10-08 11:22:34 -04:00
matt 8fd90a29a6 Feat: Pausable Crons (#2395)
* feat: update query, patch route

* feat: api for update

* fix: simplify ui a bit

* feat: wire up fe

* feat: improve copy, spinners

* fix: invert naming to avoid horrible double negative

* fix: improve handling of optional types

* fix: last bits of naming

* feat: persist enabled flag across workflow versions properly

* fix: update spinner
2025-10-08 11:12:14 -04:00
Mohammed Nafees ccf92482d8 properly case on output byte length (#2394) 2025-10-08 12:06:30 +02:00
dependabot[bot] f998393ec3 chore(deps): bump google.golang.org/api from 0.251.0 to 0.252.0 (#2397)
Bumps [google.golang.org/api](https://github.com/googleapis/google-api-go-client) from 0.251.0 to 0.252.0.
- [Release notes](https://github.com/googleapis/google-api-go-client/releases)
- [Changelog](https://github.com/googleapis/google-api-go-client/blob/main/CHANGES.md)
- [Commits](https://github.com/googleapis/google-api-go-client/compare/v0.251.0...v0.252.0)

---
updated-dependencies:
- dependency-name: google.golang.org/api
  dependency-version: 0.252.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-10-08 04:12:31 +00:00
matt 20b465c068 [Docs]: Improve triggering from external services section, fix dependabot vuln (#2393)
* fix: override prismjs version

* fix: confusing inter-service triggering page

* fix: grammar
2025-10-07 11:58:44 -04:00
dependabot[bot] 4e430eb863 chore(deps): bump google.golang.org/grpc from 1.75.1 to 1.76.0 (#2389)
Bumps [google.golang.org/grpc](https://github.com/grpc/grpc-go) from 1.75.1 to 1.76.0.
- [Release notes](https://github.com/grpc/grpc-go/releases)
- [Commits](https://github.com/grpc/grpc-go/compare/v1.75.1...v1.76.0)

---
updated-dependencies:
- dependency-name: google.golang.org/grpc
  dependency-version: 1.76.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-10-07 04:11:40 +00:00
dependabot[bot] e7fc6b001c chore(deps): bump hatchet-sdk in /examples/python/quickstart (#2388)
Bumps hatchet-sdk from 1.19.0 to 1.20.0.

---
updated-dependencies:
- dependency-name: hatchet-sdk
  dependency-version: 1.20.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-10-06 04:32:20 +00:00
dependabot[bot] c0d981c52b chore(deps): bump github.com/go-playground/validator/v10 (#2387)
Bumps [github.com/go-playground/validator/v10](https://github.com/go-playground/validator) from 10.27.0 to 10.28.0.
- [Release notes](https://github.com/go-playground/validator/releases)
- [Commits](https://github.com/go-playground/validator/compare/v10.27.0...v10.28.0)

---
updated-dependencies:
- dependency-name: github.com/go-playground/validator/v10
  dependency-version: 10.28.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-10-06 04:12:29 +00:00
dependabot[bot] afb592db3f chore(deps): bump github.com/pressly/goose/v3 from 3.25.0 to 3.26.0 (#2386)
Bumps [github.com/pressly/goose/v3](https://github.com/pressly/goose) from 3.25.0 to 3.26.0.
- [Release notes](https://github.com/pressly/goose/releases)
- [Changelog](https://github.com/pressly/goose/blob/main/CHANGELOG.md)
- [Commits](https://github.com/pressly/goose/compare/v3.25.0...v3.26.0)

---
updated-dependencies:
- dependency-name: github.com/pressly/goose/v3
  dependency-version: 3.26.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-10-06 04:12:19 +00:00
matt dfc5074057 Fix: Payload fallbacks, WAL conflict handling, WAL eviction (#2372)
* fix: improve error handling

* fix: add default operation

* fix: dont write operation

* fix: refactor offload to always evict

* fix: err check

* fix: err
v0.73.34
2025-10-03 14:50:46 -04:00
matt 2a08cbf77b [Python]: Remove refs to *_group_key_* (#2379)
* chore: remove all group key refs

* fix: rm engine version refs

* chore: version + changelog
2025-10-03 12:52:05 -04:00
Mohammed Nafees ed40a82dbb Include tenant_id in OTel spans wherever possible (#2382) 2025-10-03 18:16:16 +02:00
matt bb1de91254 fix: run analyze every 3 hours (#2380) 2025-10-03 09:49:35 -04:00
dependabot[bot] 7f0d43eecc chore(deps): bump google.golang.org/protobuf from 1.36.9 to 1.36.10 (#2381)
Bumps google.golang.org/protobuf from 1.36.9 to 1.36.10.

---
updated-dependencies:
- dependency-name: google.golang.org/protobuf
  dependency-version: 1.36.10
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-10-03 04:14:20 +00:00
Mohammed Nafees cb91f7033d Serve management API swagger docs (#2333)
* serve management API swagger docs

* fix lint
2025-10-02 14:42:26 +02:00
icbd c8bd3cf93c Add ApplyNamespace for BulkRunWorkflow (#2374) v0.73.33 2025-10-02 13:33:46 +02:00
dependabot[bot] 128e80c07f chore(deps): bump google/osv-scanner-action from 2.2.2 to 2.2.3 (#2377)
Bumps [google/osv-scanner-action](https://github.com/google/osv-scanner-action) from 2.2.2 to 2.2.3.
- [Release notes](https://github.com/google/osv-scanner-action/releases)
- [Commits](https://github.com/google/osv-scanner-action/compare/v2.2.2...v2.2.3)

---
updated-dependencies:
- dependency-name: google/osv-scanner-action
  dependency-version: 2.2.3
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-10-02 04:30:47 +00:00
dependabot[bot] e91b68b1b3 chore(deps): bump google.golang.org/api from 0.250.0 to 0.251.0 (#2371)
Bumps [google.golang.org/api](https://github.com/googleapis/google-api-go-client) from 0.250.0 to 0.251.0.
- [Release notes](https://github.com/googleapis/google-api-go-client/releases)
- [Changelog](https://github.com/googleapis/google-api-go-client/blob/main/CHANGES.md)
- [Commits](https://github.com/googleapis/google-api-go-client/compare/v0.250.0...v0.251.0)

---
updated-dependencies:
- dependency-name: google.golang.org/api
  dependency-version: 0.251.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-10-01 04:16:59 +00:00
matt 202d6b0184 Candidate Fix: WAL Write Dupes (#2369)
* fix: wal dupes

* fix: make unique key align with payload pk
v0.73.32
2025-09-30 17:11:35 -04:00
matt 5e3f9615e0 [FE]: Event payload max height, popover positioning (#2367)
* fix: add max height to event payload

* fix: popover positioning

* chore: lint
2025-09-30 15:10:38 -04:00
matt 4730273bce Fix: Relax check constraint to allow null payloads (#2366)
* fix: relax check constraint

* fix: tweak logs

* fix: constraint in schema
v0.73.31
2025-09-30 12:24:38 -04:00
matt ab9a1772b8 [TS]: Fix durable task on failure registration, fix dependabot alert (#2361)
* chore: update pino to fix fast-redact dependabot issue

* fix: register on failure task on durable worker too

* chore: bump version
2025-09-30 11:50:59 -04:00
abelanger5 2edeeb10ea feat: max channels for rabbitmq (#2365)
* feat: max conns for rabbitmq

* rename conns -> chans
v0.73.30
2025-09-30 08:49:45 -04:00
Mohammed Nafees 806931f8c6 ignore tenants with deletedAt non null (#2364) 2025-09-30 08:01:23 -04:00
Mohammed Nafees 648244fc9c use member populator for tenant member API ops (#2363) v0.73.29 2025-09-29 21:54:42 +02:00
matt a5d6603792 fix: disable inner scroll (#2362) 2025-09-29 15:36:45 -04:00
github-actions[bot] 42958ee54d chore: regenerate examples (#2360)
Co-authored-by: GitHub Action <action@github.com>
2025-09-29 20:43:39 +02:00
Mohammed Nafees a3e3cf6372 [Go SDK] Fix type of WithWorkflows (#2359)
* fix type for WithWorkflows

* add comment
2025-09-30 00:03:18 +05:30
abelanger5 733feedbff fix: use separate connections for pub and sub (#2358)
* use separate connections for pub and sub

* Update internal/msgqueue/v1/rabbitmq/rabbitmq.go

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

---------

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
v0.73.28
2025-09-29 14:29:45 -04:00
matt a0afe49c85 [FE]: Worker detail fixes (#2353)
* fix: empty states, padding, spacing between words

* fix: rm ring on button focus

* fix: template literal

* fix: padding on workflow page

* Revert "fix: padding on workflow page"

This reverts commit 71a880010c.
2025-09-29 13:08:44 -04:00
abelanger5 43eb47b881 fix(go-sdk): async start step run action event (#2351)
* fix(go-sdk): async start step run action event

* use inner ctx
v0.73.26
2025-09-26 14:03:37 -04:00
matt c1e5fa828b FE Polish, VI: Make badges dynamically sized, use slate instead of fuchsia for queued, display ms on dates (#2352)
* fix: rm w-full from badges

* fix: use slate instead of fuchsia for queued

* fix: use `date-funs` to parse + display dates

* fix: worker styling

* debug: redocly

* debug: redocly

* debug: redocly

* debug: redocly

* debug: redocly

* debug: redocly

* feat: direct workflow id getter

* fix: dedupe

* fix: return workflow type

* chore: lint

* chore: lint

* fix: overflow

* fix: include tenant in query for safety
v0.73.25
2025-09-26 13:59:06 -04:00
matt 35b97be825 [Python]: Pytest improvements (#2348)
* feat: try running in parallel in CI

* fix: simplify

* feat: add task

* fix: increase retry delay
2025-09-26 11:47:34 -04:00
dependabot[bot] c0fa7b3297 chore(deps): bump google.golang.org/api from 0.249.0 to 0.250.0 (#2350)
Bumps [google.golang.org/api](https://github.com/googleapis/google-api-go-client) from 0.249.0 to 0.250.0.
- [Release notes](https://github.com/googleapis/google-api-go-client/releases)
- [Changelog](https://github.com/googleapis/google-api-go-client/blob/main/CHANGES.md)
- [Commits](https://github.com/googleapis/google-api-go-client/compare/v0.249.0...v0.250.0)

---
updated-dependencies:
- dependency-name: google.golang.org/api
  dependency-version: 0.250.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-09-26 04:14:06 +00:00
matt 44ea929cbf fix: scope override (#2349) v0.73.24 2025-09-25 23:07:44 -04:00
matt 126ff3771b Fix: Rename metrics queries, always refetch queue metrics, change default refetch interval, configurable WAL poll limit (#2346)
* fix: improve query naming + change refetch interval for queue metrics

* fix: only enable queue metrics query when it's open

* feat: change default

* fix: change storage key to clear cache

* fix: queue metrics loading state

* feat: introduce poll limit with default of 1000

* feat: set WAL poll limit

* debug: log line to test

* fix: export helper

* fix: rm debug
v0.73.23
2025-09-25 20:44:39 -04:00
matt 025f42af74 Debug: Error log if we send >10mb message over the internal queue (#2345)
* fix: send error log if we try to send message > 10mb

* feat: add some span attributes

* fix: span attribute names

* fix: cleanup

* fix: add message id
v0.73.22
2025-09-25 18:15:35 -04:00
abelanger5 3fe1cdde37 fix: improve DAG status updates (#2343)
* fix: improve DAG status updates

* fix: error msg
v0.73.21
2025-09-25 12:22:35 -04:00
matt 0ee4445bc2 fix: show legacy data (#2344) 2025-09-25 12:19:49 -04:00
matt d6afe55338 FE Polish V: Searchable workflows, additional metadata tab (#2342)
* feat: search for workflows

* fix: allow fts for workflow name

* feat: add back metadata tab to details

* feat: dynamic copy

* chore: lint
2025-09-25 10:58:48 -04:00