Commit Graph

2106 Commits

Author SHA1 Message Date
matt
b131ec94cd Refactor: Write to S3 outside of goroutine (#2646)
* feat: refactor olap job

* fix: core

* fix: bug
v0.73.94
2025-12-11 18:37:50 -05:00
matt
ba4b097bbc Fix: OLAP Immediate Offloads (#2644)
* fix: only offload immediately if flag is set

* fix: offload directly
v0.73.93
2025-12-11 10:13:36 -05:00
matt
3a94d06bc6 Feat: Add oldest queued + running jobs to task stats (#2638)
* feat: add oldest item in task stat

* feat: extend query

* feat: api wiring

* fix: where we compute this

* chore: gen sdk

* chore: changelog, version
v0.73.92
2025-12-11 09:54:12 -05:00
dependabot[bot]
67b5be741d chore(deps): bump k8s.io/client-go from 0.34.2 to 0.34.3 (#2641)
Bumps [k8s.io/client-go](https://github.com/kubernetes/client-go) from 0.34.2 to 0.34.3.
- [Changelog](https://github.com/kubernetes/client-go/blob/master/CHANGELOG.md)
- [Commits](https://github.com/kubernetes/client-go/compare/v0.34.2...v0.34.3)

---
updated-dependencies:
- dependency-name: k8s.io/client-go
  dependency-version: 0.34.3
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-12-11 04:13:18 +00:00
dependabot[bot]
bbc5a945cb chore(deps): bump github.com/exaring/otelpgx from 0.9.3 to 0.9.4 (#2642)
Bumps [github.com/exaring/otelpgx](https://github.com/exaring/otelpgx) from 0.9.3 to 0.9.4.
- [Release notes](https://github.com/exaring/otelpgx/releases)
- [Commits](https://github.com/exaring/otelpgx/compare/v0.9.3...v0.9.4)

---
updated-dependencies:
- dependency-name: github.com/exaring/otelpgx
  dependency-version: 0.9.4
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-12-11 04:12:43 +00:00
dependabot[bot]
d2a1ce065a chore(deps): bump k8s.io/api from 0.34.2 to 0.34.3 (#2639)
Bumps [k8s.io/api](https://github.com/kubernetes/api) from 0.34.2 to 0.34.3.
- [Commits](https://github.com/kubernetes/api/compare/v0.34.2...v0.34.3)

---
updated-dependencies:
- dependency-name: k8s.io/api
  dependency-version: 0.34.3
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-12-11 04:12:17 +00:00
matt
0a947924fa Feat: Parallelize replication from PG -> External (#2637)
* feat: chunking query

* feat: first pass at range chunking

* fix: bug bashing

* fix: function geq

* fix: use maps.Copy

* fix: olap func

* feat: olap side

* refactor: external id

* fix: order by

* feat: wire up env vars

* fix: pass var through

* fix: naming

* fix: append to returnErr properly

* fix: use eg.Go
v0.73.91
2025-12-10 17:11:03 -05:00
matt
fe1bf7d356 Fix: Global Lease for OLAP (#2635)
* feat: global lease

* fix: null handling

* fix: core db

* feat: add some more spans
v0.73.90
2025-12-10 13:01:58 -05:00
dependabot[bot]
ad17546d04 chore(deps): bump golang.org/x/crypto from 0.45.0 to 0.46.0 (#2633)
Bumps [golang.org/x/crypto](https://github.com/golang/crypto) from 0.45.0 to 0.46.0.
- [Commits](https://github.com/golang/crypto/compare/v0.45.0...v0.46.0)

---
updated-dependencies:
- dependency-name: golang.org/x/crypto
  dependency-version: 0.46.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-12-10 04:10:44 +00:00
dependabot[bot]
7ceb919141 chore(deps): bump golang.org/x/text from 0.31.0 to 0.32.0 (#2632)
Bumps [golang.org/x/text](https://github.com/golang/text) from 0.31.0 to 0.32.0.
- [Release notes](https://github.com/golang/text/releases)
- [Commits](https://github.com/golang/text/compare/v0.31.0...v0.32.0)

---
updated-dependencies:
- dependency-name: golang.org/x/text
  dependency-version: 0.32.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-12-10 04:10:31 +00:00
matt
eac6904fb6 fix: query logic bug (#2631) v0.73.89 2025-12-09 21:08:11 -05:00
matt
3ff672ebe4 Fix: Don't reset offset if a new process acquires lease (#2628)
* fix: don't reset offset if a new process acquires the lease

* fix: copy paste

* feat: migration, fix queries

* fix: more queries

* fix: down migration

* fix: comment

* feat: finish wiring up everything else

* fix: placeholder initial type

* fix: zero values everywhere

* fix: param ordering

* fix: handle no rows

* fix: zero values

* fix: limit

* fix: simplify

* fix: better defaults
v0.73.88
2025-12-09 19:01:51 -05:00
Sid Premkumar
65bd347e94 Add support for slack slash commands in webhook (#2630) 2025-12-09 18:39:31 -05:00
dependabot[bot]
432ecf2e45 chore(deps): bump google/osv-scanner-action/.github/workflows/osv-scanner-reusable.yml (#2546)
Bumps [google/osv-scanner-action/.github/workflows/osv-scanner-reusable.yml](https://github.com/google/osv-scanner-action) from 2.2.4 to 2.3.0.
- [Release notes](https://github.com/google/osv-scanner-action/releases)
- [Commits](https://github.com/google/osv-scanner-action/compare/v2.2.4...v2.3.0)

---
updated-dependencies:
- dependency-name: google/osv-scanner-action/.github/workflows/osv-scanner-reusable.yml
  dependency-version: 2.3.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: matt <mrkaye97@gmail.com>
2025-12-09 19:29:03 +00:00
dependabot[bot]
22eb964d5b chore(deps): bump actions/checkout from 5 to 6 (#2551)
Bumps [actions/checkout](https://github.com/actions/checkout) from 5 to 6.
- [Release notes](https://github.com/actions/checkout/releases)
- [Changelog](https://github.com/actions/checkout/blob/main/CHANGELOG.md)
- [Commits](https://github.com/actions/checkout/compare/v5...v6)

---
updated-dependencies:
- dependency-name: actions/checkout
  dependency-version: '6'
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-12-09 14:24:16 -05:00
matt
9e14814acb Feat: OLAP Payload Cutover Job (#2618)
* feat: migration

* feat: queries

* feat: overwrite queries

* fix: bug

* feat: first pass

* fix: more olap job wiring

* fix: signature

* fix: refs to a bunch of funcs

* feat: job

* fix: table names

* fix: span name

* chore: lint

* fix: redundant error check

* fix: naming

* fix: handle nil external id

* fix: order payload partitions descending

* fix: param for limiting which partitions get processed

* fix: olap
v0.73.87
2025-12-09 12:33:07 -05:00
dependabot[bot]
5d4d43e7e6 chore(deps): bump hatchet-sdk in /examples/python/quickstart (#2626)
Bumps hatchet-sdk from 1.21.4 to 1.21.5.

---
updated-dependencies:
- dependency-name: hatchet-sdk
  dependency-version: 1.21.5
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-12-09 04:19:01 +00:00
dependabot[bot]
4a6ff0151f chore(deps): bump go.opentelemetry.io/otel/exporters/otlp/otlptrace/otlptracegrpc (#2623)
Bumps [go.opentelemetry.io/otel/exporters/otlp/otlptrace/otlptracegrpc](https://github.com/open-telemetry/opentelemetry-go) from 1.38.0 to 1.39.0.
- [Release notes](https://github.com/open-telemetry/opentelemetry-go/releases)
- [Changelog](https://github.com/open-telemetry/opentelemetry-go/blob/main/CHANGELOG.md)
- [Commits](https://github.com/open-telemetry/opentelemetry-go/compare/v1.38.0...v1.39.0)

---
updated-dependencies:
- dependency-name: go.opentelemetry.io/otel/exporters/otlp/otlptrace/otlptracegrpc
  dependency-version: 1.39.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-12-09 04:13:56 +00:00
dependabot[bot]
b955a41ab2 chore(deps): bump go.opentelemetry.io/contrib/instrumentation/google.golang.org/grpc/otelgrpc (#2620)
Bumps [go.opentelemetry.io/contrib/instrumentation/google.golang.org/grpc/otelgrpc](https://github.com/open-telemetry/opentelemetry-go-contrib) from 0.63.0 to 0.64.0.
- [Release notes](https://github.com/open-telemetry/opentelemetry-go-contrib/releases)
- [Changelog](https://github.com/open-telemetry/opentelemetry-go-contrib/blob/main/CHANGELOG.md)
- [Commits](https://github.com/open-telemetry/opentelemetry-go-contrib/compare/zpages/v0.63.0...zpages/v0.64.0)

---
updated-dependencies:
- dependency-name: go.opentelemetry.io/contrib/instrumentation/google.golang.org/grpc/otelgrpc
  dependency-version: 0.64.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-12-09 04:12:31 +00:00
dependabot[bot]
b8a35d2615 chore(deps): bump golang.org/x/sync from 0.18.0 to 0.19.0 (#2621)
Bumps [golang.org/x/sync](https://github.com/golang/sync) from 0.18.0 to 0.19.0.
- [Commits](https://github.com/golang/sync/compare/v0.18.0...v0.19.0)

---
updated-dependencies:
- dependency-name: golang.org/x/sync
  dependency-version: 0.19.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-12-09 04:11:21 +00:00
dependabot[bot]
5d2242af9c chore(deps): bump golang.org/x/oauth2 from 0.33.0 to 0.34.0 (#2624)
Bumps [golang.org/x/oauth2](https://github.com/golang/oauth2) from 0.33.0 to 0.34.0.
- [Commits](https://github.com/golang/oauth2/compare/v0.33.0...v0.34.0)

---
updated-dependencies:
- dependency-name: golang.org/x/oauth2
  dependency-version: 0.34.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-12-09 04:10:41 +00:00
dependabot[bot]
6acf952eb6 chore(deps): bump go.opentelemetry.io/contrib/instrumentation/github.com/labstack/echo/otelecho (#2619)
Bumps [go.opentelemetry.io/contrib/instrumentation/github.com/labstack/echo/otelecho](https://github.com/open-telemetry/opentelemetry-go-contrib) from 0.63.0 to 0.64.0.
- [Release notes](https://github.com/open-telemetry/opentelemetry-go-contrib/releases)
- [Changelog](https://github.com/open-telemetry/opentelemetry-go-contrib/blob/main/CHANGELOG.md)
- [Commits](https://github.com/open-telemetry/opentelemetry-go-contrib/compare/zpages/v0.63.0...zpages/v0.64.0)

---
updated-dependencies:
- dependency-name: go.opentelemetry.io/contrib/instrumentation/github.com/labstack/echo/otelecho
  dependency-version: 0.64.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-12-09 04:10:19 +00:00
matt
35d1cff963 refactor: simplify external store signature (#2616) v0.73.86 2025-12-08 14:53:52 -05:00
Sid Premkumar
958448a5a3 Fix slack challenge + interactive webhook (#2612)
* Fix slack challage

* ensure we continue if its not a challange

* fix

* update doc string

* PR feedback + lint

* more debug logs

* more logging

* more logging

* clean

* revert challange stuff + update error message

* Update log + error message

* More warn + unsanitized returns
v0.73.85
2025-12-08 11:37:00 -05:00
Sid Premkumar
7651cdd58e Update Expression Page + Slack Webhook Onboarding (#2614)
* better slack webhook onboarding

* lint

* lint again

* lint again

* lint again?

* chore: lint

* fix

* Pr feedback

* lint

* lint

---------

Co-authored-by: mrkaye97 <mrkaye97@gmail.com>
2025-12-08 11:11:16 -05:00
matt
bede3efe0d Feat: Process all old partitions in a loop (#2613)
* feat: process old partitions in a loop

* fix: param

* fix: query return

* feat: add spans

* fix: naming
v0.73.84
2025-12-08 11:00:24 -05:00
matt
cebf3a6fa7 [Python] Fix: Raise on un-serializable task output (#2562)
* fix: raise on illegal output

* chore: version, changelog
2025-12-08 09:49:20 -05:00
Mohammed Nafees
5f7b149b5b Add guide for downgrading versions (#2588)
* add downgrading guide and migrate cmd

* cleanup
v0.73.83
2025-12-08 12:18:01 +01:00
github-actions[bot]
44b3619bd8 chore: regenerate examples (#2615)
Co-authored-by: GitHub Action <action@github.com>
2025-12-07 16:39:40 -05:00
Jishnu
7ab13d3b46 feat: add logs client for go sdk, logs client go example (#2550)
* feat: add logs client for go sdk, logs client go example

* add: comment-based markup for go sdk log example

---------

Co-authored-by: matt <mrkaye97@gmail.com>
2025-12-07 16:38:01 -05:00
matt
34090a71f2 fix: add validation (#2610) v0.73.82 2025-12-05 14:30:05 -05:00
Andrei Gaspar
64488d2318 fix: Skip relative URLs when checking cross domain links (#2608) 2025-12-05 14:16:56 -05:00
matt
7e48ac7d02 Fix: Leasing for payload job (#2609)
* refactor: acquire a lease instead of an advisory lock

* refactor: partition dates

* fix: single query to acquire / extend

* fix: explicit alias

* fix: unwind

* fix: hwere clause

* fix: handle no rows

* fix: lease bug

* fix: rm debug

* fix: comment for clarity

* fix: syntax that doesn't actually matter

* fix: error
v0.73.81
2025-12-05 13:55:59 -05:00
matt
18940869ae Feat: Job for payload cutovers to external (#2586)
* feat: initial payload cutover job

* refactor: fix a couple things

* feat: start wiring up writes

* feat: only run job if external store is enabled

* fix: add some notes, add loop

* feat: function for reading out payloads

* fix: date handling, logging

* feat: remove wal and immediate offloads

* feat: advisory lock

* feat: partition swap logic

* fix: rm debug

* fix: add todo

* fix: sql cleanup

* fix: sql cleanup, ii

* chore: nuke a bunch of WAL stuff

* chore: more wal

* feat: trigger for crud opts

* feat: drop trigger + function in swapover

* feat: move autovac to later

* feat: use unlogged table initially

* feat: update migration

* fix: drop trigger

* fix: use insert + on conflict

* fix: types

* refactor: clean up a bit

* fix: panic

* fix: detach partition before dropping

* feat: configurable batch size

* feat: offset tracking in the db

* feat: explicitly lock

* fix: down migration

* fix: bug

* fix: offset handling

* fix: try explicit ordering of the insert

* fix: lock location

* fix: do less stuff after locking

* fix: ordering

* fix: dont drop and recreate if temp table exists

* fix: explicitly track completed status

* fix: table name

* fix: dont use unlogged table

* fix: rm todos

* chore: lint

* feat: configurable delay

* fix: use date as pk instead of varchar

* fix: daily job

* fix: hack check constraint to speed up partition attach

* fix: syntax

* fix: syntax

* fix: drop constraint after attaching

* fix: syntax

* fix: drop triggers properly

* fix: factor out insert logic

* refactor: factor out loop logic

* refactor: factor out job preparation work

* fix: ordering

* fix: run the job more often

* fix: use `WithSingletonMode`

* fix: singleton mode sig

* fix: env var cleanup

* fix: overwrite sig

* fix: re-enable immediate offloads with a flag

* fix: order, offload at logic

* feat: add count query to compare

* fix: row-level triggers, partition time bug

* fix: rm todo

* fix: for true

* fix: handle lock not acquired

* fix: handle error

* fix: comment
v0.73.80
2025-12-05 10:54:26 -05:00
Sid Premkumar
8be9d21ec2 Fix double toast on sidebar (#2607) 2025-12-05 10:13:27 -05:00
dependabot[bot]
ca2c8e151e chore(deps): bump hatchet-sdk in /examples/python/quickstart (#2603)
Bumps hatchet-sdk from 1.21.3 to 1.21.4.

---
updated-dependencies:
- dependency-name: hatchet-sdk
  dependency-version: 1.21.4
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-12-05 04:17:31 +00:00
matt
6efdba02e8 [Python]: Hotfix: Pydantic serialization error from failing to encode bytes (#2602)
* hotfix: handle pydantic serialization errors

* chore: changelog

* fix(python-sdk): Fix RateLimit validation incorrectly rejects valid CEL expression strings (#2536)

* fix(python-sdk): Fix RateLimit validation incorrectly rejects valid CEL expression strings

* fix(python-sdk): Update RateLimit validation to use union type for limit instead of tuple syntax

* chore(python-sdk): update changelog and bump the patch version to 1.21.4

---------

Co-authored-by: mrkaye97 <mrkaye97@gmail.com>

---------

Co-authored-by: miyelani-inc <139712015+miyelani-inc@users.noreply.github.com>
v0.73.79
2025-12-04 14:22:49 -05:00
abelanger5
9dabe7d902 feat: dlq for dispatcher queues (#2600)
* feat: dlq for dispatcher queues

* reduce dispatcher message ttl to 20 seconds

* rename dispatcher queue for clarity

* add error logs when dead lettering

* address comment
2025-12-04 14:19:01 -05:00
Mohammed Nafees
cf18b31218 Initialize concurrency keys slice for replayed tasks (#2549)
* make sure concurrency keys for replayed tasks are initialized as expected

* no need for useless allocs

* revert change for insertTasks

* panic catch

* uncomment fix
2025-12-04 22:29:30 +05:30
dependabot[bot]
9bbd743614 chore(deps): bump github.com/spf13/cobra from 1.10.1 to 1.10.2 (#2599)
Bumps [github.com/spf13/cobra](https://github.com/spf13/cobra) from 1.10.1 to 1.10.2.
- [Release notes](https://github.com/spf13/cobra/releases)
- [Commits](https://github.com/spf13/cobra/compare/v1.10.1...v1.10.2)

---
updated-dependencies:
- dependency-name: github.com/spf13/cobra
  dependency-version: 1.10.2
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-12-04 04:09:40 +00:00
abelanger5
d071a1c36b fix: prevent large worker gRPC stream backlogs (#2597)
* fix: prevent large worker backlogs

* add config value

* add doc for troubleshooting
v0.73.78
2025-12-03 17:15:43 -05:00
Andrei Gaspar
2dfdd9dd0c fix: Don't trigger posthog Pageview on query param changes (#2598) 2025-12-03 13:00:48 -05:00
dependabot[bot]
d46c5cd96b chore(deps): bump google.golang.org/api from 0.256.0 to 0.257.0 (#2596)
Bumps [google.golang.org/api](https://github.com/googleapis/google-api-go-client) from 0.256.0 to 0.257.0.
- [Release notes](https://github.com/googleapis/google-api-go-client/releases)
- [Changelog](https://github.com/googleapis/google-api-go-client/blob/main/CHANGES.md)
- [Commits](https://github.com/googleapis/google-api-go-client/compare/v0.256.0...v0.257.0)

---
updated-dependencies:
- dependency-name: google.golang.org/api
  dependency-version: 0.257.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-12-03 04:10:05 +00:00
abelanger5
63b0d7c411 update local rabbitmq to 4.x (#2593) v0.73.77 2025-12-02 13:05:46 -05:00
abelanger5
3cbda9120a fix: load shed on slow worker backlogs (#2595) 2025-12-02 13:05:33 -05:00
Andrei Gaspar
36afeece02 Cross-Domain Tracking and Analytics Refactoring (#2587)
* feat: Implement cross-domain tracking (docs -> app)

* fix: Eslint config path issue

* feat: Implement posthog provider

* Revert "fix: Eslint config path issue"

This reverts commit 2baf56819a.

* feat: Implement wildcard support in analytics cross domain targets
2025-12-02 11:52:15 -05:00
abelanger5
3f5c243325 fix: move check for large payloads to after json.Marshal (#2594) v0.73.76 2025-12-02 11:45:37 -05:00
abelanger5
d906a441d4 fix: ensure that slow worker doesn't interrupt dispatcher, guard large RabbitMQ pubs (#2591)
* ensure that slow worker doesn't interrupt dispatcher

* fix: large payload pub issues

* add comments

* fix: review comments
v0.73.75
2025-12-02 09:54:54 -05:00
Gabe Ruttner
1e2a587b21 fix: GetLatestWorkflowVersionForWorkflows (#2590)
* fix query

* gen
2025-12-02 05:14:08 -08:00
Andrei Gaspar
00fda4c377 Setup PostHog and Integrate with Cookie Banner Component (#2557)
* feat: Setup posthog and integrate with cookie banner component

* refactor: Improved error handling
2025-11-28 15:22:35 -05:00