Commit Graph

770 Commits

Author SHA1 Message Date
Sean Reilly 5811929928 feat: bulk inserts of events (#887)
* progress commit of bulk inserts

* in_flight: Add changes to metering finish the bulk insert

* remove an attempt to overide enforce limits

* merge in PR fixes

* update docs to add in an additional section in the User guide to describe pushing single events and pushing multiple events

* run lint fix

---------

Co-authored-by: Sean Reilly <sean@hatchet.run>
v0.46.0
2024-09-23 09:19:39 -07:00
abelanger5 4936b3dce0 fix: use worker id properly on timeout (#901) 2024-09-23 08:30:31 -07:00
abelanger5 baf13bd577 fix: duration int -> bigint (#902) 2024-09-23 08:30:16 -07:00
abelanger5 ad12f658da fix: have refresh timeout use timeout queue item (#898) 2024-09-23 05:41:06 -07:00
dependabot[bot] 27831008af chore(deps): bump github.com/getsentry/sentry-go from 0.28.1 to 0.29.0 (#872)
Bumps [github.com/getsentry/sentry-go](https://github.com/getsentry/sentry-go) from 0.28.1 to 0.29.0.
- [Release notes](https://github.com/getsentry/sentry-go/releases)
- [Changelog](https://github.com/getsentry/sentry-go/blob/master/CHANGELOG.md)
- [Commits](https://github.com/getsentry/sentry-go/compare/v0.28.1...v0.29.0)

---
updated-dependencies:
- dependency-name: github.com/getsentry/sentry-go
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-09-23 05:36:11 +00:00
dependabot[bot] d34d6bc526 chore(deps): bump google.golang.org/grpc from 1.66.2 to 1.67.0 (#900)
Bumps [google.golang.org/grpc](https://github.com/grpc/grpc-go) from 1.66.2 to 1.67.0.
- [Release notes](https://github.com/grpc/grpc-go/releases)
- [Commits](https://github.com/grpc/grpc-go/compare/v1.66.2...v1.67.0)

---
updated-dependencies:
- dependency-name: google.golang.org/grpc
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-09-23 05:13:16 +00:00
dependabot[bot] 3c5a6248ef chore(deps): bump github.com/go-co-op/gocron/v2 from 2.12.0 to 2.12.1 (#899)
Bumps [github.com/go-co-op/gocron/v2](https://github.com/go-co-op/gocron) from 2.12.0 to 2.12.1.
- [Release notes](https://github.com/go-co-op/gocron/releases)
- [Commits](https://github.com/go-co-op/gocron/compare/v2.12.0...v2.12.1)

---
updated-dependencies:
- dependency-name: github.com/go-co-op/gocron/v2
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-09-23 05:12:56 +00:00
abelanger5 6e1b6c91d2 fix: color of logs view (#896)
* fix: color of logs view

* remove concurrency from cancel test
2024-09-21 12:27:44 -07:00
dependabot[bot] 358b957303 chore(deps): bump google.golang.org/api from 0.197.0 to 0.198.0 (#895)
Bumps [google.golang.org/api](https://github.com/googleapis/google-api-go-client) from 0.197.0 to 0.198.0.
- [Release notes](https://github.com/googleapis/google-api-go-client/releases)
- [Changelog](https://github.com/googleapis/google-api-go-client/blob/main/CHANGES.md)
- [Commits](https://github.com/googleapis/google-api-go-client/compare/v0.197.0...v0.198.0)

---
updated-dependencies:
- dependency-name: google.golang.org/api
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-09-20 05:25:21 +00:00
Gabe Ruttner 0173625c3e docs: cel-concurrency (#892)
* docs: cel-concurrency

* fix: default expression
2024-09-19 21:57:10 -04:00
abelanger5 0204929b02 fix: concurrency key performance (#894) v0.45.3 2024-09-19 21:28:08 -04:00
abelanger5 7e2923d402 fix: nil concurrency limit strategy (#893)
* fix: queue properly on internal retry

* fix: panic on nil limit strategy
v0.45.2
2024-09-19 16:52:13 -04:00
abelanger5 d61f37de14 fix: queue properly on internal retry (#891) 2024-09-19 20:11:47 +00:00
Sean Reilly 15c50f46b5 Partial PR - need to generate SDK - Add endpoint to get the total free worker slots for a worker and the … (#857)
* Add endpoint to get the total free worker slots for a worker and the max runs

* update to use WorkerSempahoreCount instead of checking stepRunId

* modify the query for the new table and change the interface

* bump golangci-lint make changes to name of returned data

* revert the simple example

---------

Co-authored-by: Sean Reilly <sean@hatchet.run>
2024-09-19 10:11:16 -07:00
abelanger5 e72faf75fd fix: better error string for CEL (#890) v0.45.1 2024-09-19 12:04:37 -04:00
abelanger5 d23e5d9963 feat: expression-based concurrency keys (#889)
* feat: expression-based concurrency keys

* fix: build

* fix: typos

* fix: gen

* fix: migration

* fix: remove print statements

* fix: reassignment bugs, retries on closed transport, pr review
v0.45.0
2024-09-19 10:32:22 -04:00
Steinway Wu 44d03af852 fix: propagating additional metadata for child workflows (#882)
* fix: propagating additional metadata for child workflows

* add unit test
2024-09-19 13:28:46 +00:00
Sean Reilly 421fd08f78 bump protobuf to latest stable (#886)
* bump protobuf to latest stable

* regenerate the proto

---------

Co-authored-by: Sean Reilly <sean@hatchet.run>
2024-09-17 18:09:03 -07:00
dependabot[bot] 5ca2adaf46 chore(deps): bump github.com/go-co-op/gocron/v2 from 2.11.0 to 2.12.0 (#885)
Bumps [github.com/go-co-op/gocron/v2](https://github.com/go-co-op/gocron) from 2.11.0 to 2.12.0.
- [Release notes](https://github.com/go-co-op/gocron/releases)
- [Commits](https://github.com/go-co-op/gocron/compare/v2.11.0...v2.12.0)

---
updated-dependencies:
- dependency-name: github.com/go-co-op/gocron/v2
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-09-17 05:04:37 +00:00
abelanger5 55eb63d9a4 fix: replay without group keys and status updates (#883) v0.44.8 2024-09-16 16:59:34 -04:00
Gabe Ruttner 2379e3638a fix: reset on replay (#875) 2024-09-16 17:01:51 +00:00
Gabe Ruttner af9ed49f1e fix: events list view (#878)
* fix: filter by event id

* fix: run count

* feat: filter by id api

* feat: filter by Event Id

* chore: default page is runs

* feat: cancel event runs

---------

Co-authored-by: Alexander Belanger <alexander@hatchet.run>
2024-09-16 16:46:31 +00:00
Gabe Ruttner c64c62f66a feat: improved workflow run details page (#821)
* wip: rip prisma

* wip

* wip

* fix: lint

* wip

* wip

* gen

* wip

* wip

* fix trigger

* hide overview

* revert db changes

* feat: wrap up frontend changes and perf

* chore: generate

* chore: frontend build

* fix: workflow transformer

* fix: avoid race conditions on simultaneous parent completions

* fix: 2025 started

* feat: toast for replay/cancel

* fix: toast

---------

Co-authored-by: Alexander Belanger <alexander@hatchet.run>
2024-09-16 15:39:49 +00:00
dependabot[bot] eadd485247 chore(deps): bump github.com/steebchen/prisma-client-go (#880)
Bumps [github.com/steebchen/prisma-client-go](https://github.com/steebchen/prisma-client-go) from 0.40.1 to 0.41.0.
- [Release notes](https://github.com/steebchen/prisma-client-go/releases)
- [Commits](https://github.com/steebchen/prisma-client-go/compare/v0.40.1...v0.41.0)

---
updated-dependencies:
- dependency-name: github.com/steebchen/prisma-client-go
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-09-16 15:01:39 +00:00
dependabot[bot] bd36b39f7b chore(deps): bump github.com/posthog/posthog-go from 1.2.21 to 1.2.22 (#881)
Bumps [github.com/posthog/posthog-go](https://github.com/posthog/posthog-go) from 1.2.21 to 1.2.22.
- [Release notes](https://github.com/posthog/posthog-go/releases)
- [Changelog](https://github.com/PostHog/posthog-go/blob/master/CHANGELOG.md)
- [Commits](https://github.com/posthog/posthog-go/compare/v1.2.21...v1.2.22)

---
updated-dependencies:
- dependency-name: github.com/posthog/posthog-go
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-09-16 05:27:47 +00:00
dependabot[bot] 492ce78660 chore(deps): bump google.golang.org/api from 0.196.0 to 0.197.0 (#873)
Bumps [google.golang.org/api](https://github.com/googleapis/google-api-go-client) from 0.196.0 to 0.197.0.
- [Release notes](https://github.com/googleapis/google-api-go-client/releases)
- [Changelog](https://github.com/googleapis/google-api-go-client/blob/main/CHANGES.md)
- [Commits](https://github.com/googleapis/google-api-go-client/compare/v0.196.0...v0.197.0)

---
updated-dependencies:
- dependency-name: google.golang.org/api
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-09-13 08:00:17 +00:00
dependabot[bot] 1ad7994820 chore(deps): bump k8s.io/client-go from 0.31.0 to 0.31.1 (#877)
Bumps [k8s.io/client-go](https://github.com/kubernetes/client-go) from 0.31.0 to 0.31.1.
- [Changelog](https://github.com/kubernetes/client-go/blob/master/CHANGELOG.md)
- [Commits](https://github.com/kubernetes/client-go/compare/v0.31.0...v0.31.1)

---
updated-dependencies:
- dependency-name: k8s.io/client-go
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-09-13 07:37:24 +00:00
abelanger5 893637cb0f fix: improve LinkStepRunParents to prevent usage of temp files (#874) 2024-09-12 17:19:58 -04:00
abelanger5 c2ff97416c fix: don't send on failure job cancellations to parent (#869) v0.44.7 2024-09-12 08:54:11 -04:00
dependabot[bot] 8ece992f72 chore(deps): bump go.opentelemetry.io/otel/exporters/otlp/otlptrace/otlptracegrpc (#870)
Bumps [go.opentelemetry.io/otel/exporters/otlp/otlptrace/otlptracegrpc](https://github.com/open-telemetry/opentelemetry-go) from 1.29.0 to 1.30.0.
- [Release notes](https://github.com/open-telemetry/opentelemetry-go/releases)
- [Changelog](https://github.com/open-telemetry/opentelemetry-go/blob/main/CHANGELOG.md)
- [Commits](https://github.com/open-telemetry/opentelemetry-go/compare/v1.29.0...v1.30.0)

---
updated-dependencies:
- dependency-name: go.opentelemetry.io/otel/exporters/otlp/otlptrace/otlptracegrpc
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-09-12 05:30:05 +00:00
dependabot[bot] a5c08f0f78 chore(deps): bump google.golang.org/grpc from 1.66.1 to 1.66.2 (#871)
Bumps [google.golang.org/grpc](https://github.com/grpc/grpc-go) from 1.66.1 to 1.66.2.
- [Release notes](https://github.com/grpc/grpc-go/releases)
- [Commits](https://github.com/grpc/grpc-go/compare/v1.66.1...v1.66.2)

---
updated-dependencies:
- dependency-name: google.golang.org/grpc
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-09-12 05:29:57 +00:00
abelanger5 bed2cb559a fix: add back sem slots, without row contention (#868)
* fix: add back sem slots, without row contention

* fix: serialize queue step runs to prevent dirty reads

* remove serializable for now

* statement timeouts on create workflow run

* statement timeout for reassign

* proper migration + cleanup

* remove old tables and code

* fix: worker slot state

* remove last unused table from workers
2024-09-11 20:47:49 +00:00
dependabot[bot] 297c7fc905 chore(deps): bump github.com/jackc/pgx/v5 from 5.6.0 to 5.7.1 (#867)
Bumps [github.com/jackc/pgx/v5](https://github.com/jackc/pgx) from 5.6.0 to 5.7.1.
- [Changelog](https://github.com/jackc/pgx/blob/master/CHANGELOG.md)
- [Commits](https://github.com/jackc/pgx/compare/v5.6.0...v5.7.1)

---
updated-dependencies:
- dependency-name: github.com/jackc/pgx/v5
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-09-11 05:12:39 +00:00
dependabot[bot] 58737d5958 chore(deps): bump github.com/jackc/puddle/v2 from 2.2.1 to 2.2.2 (#865)
Bumps [github.com/jackc/puddle/v2](https://github.com/jackc/puddle) from 2.2.1 to 2.2.2.
- [Changelog](https://github.com/jackc/puddle/blob/master/CHANGELOG.md)
- [Commits](https://github.com/jackc/puddle/compare/v2.2.1...v2.2.2)

---
updated-dependencies:
- dependency-name: github.com/jackc/puddle/v2
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-09-11 04:50:04 +00:00
dependabot[bot] 76ab8115be chore(deps): bump go.opentelemetry.io/otel/exporters/otlp/otlptrace (#864)
Bumps [go.opentelemetry.io/otel/exporters/otlp/otlptrace](https://github.com/open-telemetry/opentelemetry-go) from 1.29.0 to 1.30.0.
- [Release notes](https://github.com/open-telemetry/opentelemetry-go/releases)
- [Changelog](https://github.com/open-telemetry/opentelemetry-go/blob/main/CHANGELOG.md)
- [Commits](https://github.com/open-telemetry/opentelemetry-go/compare/v1.29.0...v1.30.0)

---
updated-dependencies:
- dependency-name: go.opentelemetry.io/otel/exporters/otlp/otlptrace
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-09-11 04:49:52 +00:00
abelanger5 f4c5cd973e feat: more efficient step run timeouts (#863) v0.44.5 2024-09-10 18:23:11 -04:00
abelanger5 b635c875f6 fix: race conditions on release slot (#858)
* fix: race conditions on release slot

* better engine logs for ci

* fix: improve cancellation

* better debug logs and increase timeout
2024-09-10 14:22:32 -04:00
Gabe Ruttner 460438ab22 fix: tag (#862) 2024-09-10 09:31:39 -07:00
abelanger5 dda47fb24f fix: dispatcher and teardown errors (#856) 2024-09-10 12:08:08 -04:00
abelanger5 9efcebe6af fix: better logic for multiple restricted domains (#860) 2024-09-10 12:07:55 -04:00
abelanger5 77ab9460d3 fix: unset statement timeouts for session, print more debug info (#861) 2024-09-10 12:07:47 -04:00
dependabot[bot] 91e68f978c chore(deps): bump google.golang.org/grpc from 1.66.0 to 1.66.1 (#859)
Bumps [google.golang.org/grpc](https://github.com/grpc/grpc-go) from 1.66.0 to 1.66.1.
- [Release notes](https://github.com/grpc/grpc-go/releases)
- [Commits](https://github.com/grpc/grpc-go/compare/v1.66.0...v1.66.1)

---
updated-dependencies:
- dependency-name: google.golang.org/grpc
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-09-10 05:09:13 +00:00
abelanger5 a1324d43db fix: improve status updates and event writes (#855)
* fix: improve status updates and event writes

* chore: better debug line
v0.44.4
2024-09-09 18:09:44 +00:00
abelanger5 e59ce100e3 fix: cleanup worker assign events + limit semaphore query (#854) v0.44.3 2024-09-09 11:11:44 -04:00
dependabot[bot] 8f511c806f chore(deps): bump github.com/go-playground/validator/v10 (#853)
Bumps [github.com/go-playground/validator/v10](https://github.com/go-playground/validator) from 10.22.0 to 10.22.1.
- [Release notes](https://github.com/go-playground/validator/releases)
- [Commits](https://github.com/go-playground/validator/compare/v10.22.0...v10.22.1)

---
updated-dependencies:
- dependency-name: github.com/go-playground/validator/v10
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-09-09 04:48:06 +00:00
abelanger5 23daa89ba0 fix: list initial step runs query + better serialized queue operations (#851)
* fix: list initial step runs

* fix: better tenant operation logic
v0.44.2
2024-09-08 19:29:11 -04:00
abelanger5 478c897035 fix: proper migration to counts, startable step runs query (#850) v0.44.1 2024-09-08 12:48:51 -04:00
abelanger5 70855ecc6b refactor: bulk step run updates (#847)
* wip: v4 of queue

* fix: correct query for updating counts

* tmp: save migration files

* feat: wrap up initial queue

* fix compilation

* fix: reassigns

* temp: refactor on step runs

* feat: bulk step run updates and processing

* fix: cancellation

* address review comments
v0.44.0
2024-09-06 17:11:19 -04:00
abelanger5 bb459d1f7f fix: rendering additional metadata (#846) 2024-09-06 17:11:10 -04:00
abelanger5 891514b461 feat: queue v4 (#842)
* wip: v4 of queue

* fix: correct query for updating counts

* tmp: save migration files

* feat: wrap up initial queue

* fix compilation

* fix: reassigns
2024-09-06 16:12:22 -04:00