Commit Graph

796 Commits

Author SHA1 Message Date
Gabe Ruttner
5fcf5eff6a fix: separate context (#929)
* fix: separate context

* chore: comments

* chore: generate

* chore: gen

* chore: update protoc 28.2
2024-10-02 10:53:51 -04:00
dependabot[bot]
15ff36bd3a chore(deps): bump google.golang.org/grpc from 1.67.0 to 1.67.1 (#928)
Bumps [google.golang.org/grpc](https://github.com/grpc/grpc-go) from 1.67.0 to 1.67.1.
- [Release notes](https://github.com/grpc/grpc-go/releases)
- [Commits](https://github.com/grpc/grpc-go/compare/v1.67.0...v1.67.1)

---
updated-dependencies:
- dependency-name: google.golang.org/grpc
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-10-02 04:50:09 +00:00
abelanger5
c3fa2c57f3 fix: don't need acks on queue checks (#926) 2024-10-02 00:52:02 +00:00
abelanger5
c29984305e fix: faster processing of timeout queue items (#924) v0.48.2 2024-10-01 13:50:38 +00:00
abelanger5
8d49a247c3 fix: loading states for workflow runs table (#923) 2024-10-01 09:19:43 -04:00
abelanger5
117533c1b5 fix: remove more fks (#922)
* fix: remove more fks

* chore: generate
v0.48.1
2024-09-30 16:53:38 -04:00
Gabe Ruttner
37c9f8f16e docs: dynamic rate limits (#921)
* docs: dynamic rate limits

* chore: lint
2024-09-30 20:26:58 +00:00
Gabe Ruttner
7d7e43d4e1 feat: pauseable workflows (#879)
* feat: pause workflow state

* feat: dont run paused workflows

* feat: skipped paused

* implement unpaused behavior for workflow runs

* fix: frontend

* fix: more frontend

* fix: imports

---------

Co-authored-by: Alexander Belanger <alexander@hatchet.run>
v0.48.0
2024-09-29 10:58:10 -04:00
abelanger5
dd385c5b66 fix: remove metrics views from non-top level workflow runs views (#919) 2024-09-29 09:40:33 -04:00
abelanger5
bfb11cac51 fix: always use retention on queues, optional data/worker (#916) v0.47.1 2024-09-27 14:23:14 -04:00
Gabe Ruttner
3ff00a1866 feat: improved dag validation (#915) 2024-09-27 14:23:06 -04:00
Gabe Ruttner
a119e9f363 Fix workflow run list UI (#917)
* fix: option label instead of value

* feat: add additional metadata to trigger
2024-09-27 14:22:25 -04:00
abelanger5
6172956bbd refactor: remove foreign keys from unchanged/non-cascading parent tables (#918)
* refactor: remove fks from unchanged/non-cascading parent tables

* fix: cleanup cache for engine repository

* fix: remove streamevent
2024-09-27 14:21:45 -04:00
abelanger5
925b2654c8 feat: workflow run metrics view (#912)
* feat: add callbacks for workflow run completed

* add tenant id to resolve row

* add finishedBefore, finishedAfter to workflow runs query

* add more callbacks

* feat: tenant ids and loggers in callback

* feat: workflow run metrics frontend

* fix: frontend build
v0.47.0
2024-09-27 07:38:15 -04:00
abelanger5
c24d65b76e add timeout and context to queue metrics (#914) 2024-09-27 07:10:25 -04:00
Alexander Belanger
446c8ee8d5 Merge branch 'main' of github.com:hatchet-dev/hatchet 2024-09-26 22:28:32 -04:00
Alexander Belanger
f0ed89d739 docs: add external database for k8s docs 2024-09-26 22:28:28 -04:00
abelanger5
a1a10b4073 feat: dynamic rate limits (#904)
* wip: step run expressions on rate limits

* feat: dynamic rate limits

* chore: v0.47.0

* chore: address changes from PR review

* fix: improved error handling

* address pr review

* better error messages for step run cels, remove debug logs

* fix: hash

---------

Co-authored-by: gabriel ruttner <gabriel.ruttner@gmail.com>
2024-09-26 22:00:34 +00:00
abelanger5
5f5e1e8a88 refactor: use shared tenant listener for messages (#911)
* refactor: use shared tenant listener per tenant exchange

* fix: remove subscription properly
v0.46.3
2024-09-26 14:54:11 -04:00
dependabot[bot]
bdcd9c20ba chore(deps): bump github.com/steebchen/prisma-client-go (#909)
Bumps [github.com/steebchen/prisma-client-go](https://github.com/steebchen/prisma-client-go) from 0.41.0 to 0.42.0.
- [Release notes](https://github.com/steebchen/prisma-client-go/releases)
- [Commits](https://github.com/steebchen/prisma-client-go/compare/v0.41.0...v0.42.0)

---
updated-dependencies:
- dependency-name: github.com/steebchen/prisma-client-go
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-09-26 04:44:54 +00:00
dependabot[bot]
e8d0859ddd chore(deps): bump google.golang.org/api from 0.198.0 to 0.199.0 (#908)
Bumps [google.golang.org/api](https://github.com/googleapis/google-api-go-client) from 0.198.0 to 0.199.0.
- [Release notes](https://github.com/googleapis/google-api-go-client/releases)
- [Changelog](https://github.com/googleapis/google-api-go-client/blob/main/CHANGES.md)
- [Commits](https://github.com/googleapis/google-api-go-client/compare/v0.198.0...v0.199.0)

---
updated-dependencies:
- dependency-name: google.golang.org/api
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-09-26 04:44:38 +00:00
Gabe Ruttner
2f3ea90941 fix: replay input (#906) 2024-09-25 16:26:39 +00:00
Alexander Belanger
85f6d07ddf patch: handle nil result.Output v0.46.2 2024-09-24 19:34:20 -04:00
abelanger5
840e590312 fix: frontend improvements (#905)
* fix: set time range properly on reload

* fix: small button to show queue counts for now
v0.46.1
2024-09-24 19:08:41 -04:00
Gabe Ruttner
f98d3277b7 fix: trunc large payloads (#903)
* fix: trunc large payloads

* lets send the stepRuns and steps with output back on the WorkflowRunGet

* fix: times

* fix: rm unsafe

* rename to GetStepRunsForJobRunsWithOutput so we know we might potentially be getting a very large result set

---------

Co-authored-by: Sean Reilly <sean@hatchet.run>
2024-09-24 22:52:00 +00:00
abelanger5
9d69e4d192 fix: use read-only message queue (#897)
* fix: use read-only message queue

* set very high qos for read-heavy queue
2024-09-24 18:30:43 -04:00
Sean Reilly
5811929928 feat: bulk inserts of events (#887)
* progress commit of bulk inserts

* in_flight: Add changes to metering finish the bulk insert

* remove an attempt to overide enforce limits

* merge in PR fixes

* update docs to add in an additional section in the User guide to describe pushing single events and pushing multiple events

* run lint fix

---------

Co-authored-by: Sean Reilly <sean@hatchet.run>
v0.46.0
2024-09-23 09:19:39 -07:00
abelanger5
4936b3dce0 fix: use worker id properly on timeout (#901) 2024-09-23 08:30:31 -07:00
abelanger5
baf13bd577 fix: duration int -> bigint (#902) 2024-09-23 08:30:16 -07:00
abelanger5
ad12f658da fix: have refresh timeout use timeout queue item (#898) 2024-09-23 05:41:06 -07:00
dependabot[bot]
27831008af chore(deps): bump github.com/getsentry/sentry-go from 0.28.1 to 0.29.0 (#872)
Bumps [github.com/getsentry/sentry-go](https://github.com/getsentry/sentry-go) from 0.28.1 to 0.29.0.
- [Release notes](https://github.com/getsentry/sentry-go/releases)
- [Changelog](https://github.com/getsentry/sentry-go/blob/master/CHANGELOG.md)
- [Commits](https://github.com/getsentry/sentry-go/compare/v0.28.1...v0.29.0)

---
updated-dependencies:
- dependency-name: github.com/getsentry/sentry-go
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-09-23 05:36:11 +00:00
dependabot[bot]
d34d6bc526 chore(deps): bump google.golang.org/grpc from 1.66.2 to 1.67.0 (#900)
Bumps [google.golang.org/grpc](https://github.com/grpc/grpc-go) from 1.66.2 to 1.67.0.
- [Release notes](https://github.com/grpc/grpc-go/releases)
- [Commits](https://github.com/grpc/grpc-go/compare/v1.66.2...v1.67.0)

---
updated-dependencies:
- dependency-name: google.golang.org/grpc
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-09-23 05:13:16 +00:00
dependabot[bot]
3c5a6248ef chore(deps): bump github.com/go-co-op/gocron/v2 from 2.12.0 to 2.12.1 (#899)
Bumps [github.com/go-co-op/gocron/v2](https://github.com/go-co-op/gocron) from 2.12.0 to 2.12.1.
- [Release notes](https://github.com/go-co-op/gocron/releases)
- [Commits](https://github.com/go-co-op/gocron/compare/v2.12.0...v2.12.1)

---
updated-dependencies:
- dependency-name: github.com/go-co-op/gocron/v2
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-09-23 05:12:56 +00:00
abelanger5
6e1b6c91d2 fix: color of logs view (#896)
* fix: color of logs view

* remove concurrency from cancel test
2024-09-21 12:27:44 -07:00
dependabot[bot]
358b957303 chore(deps): bump google.golang.org/api from 0.197.0 to 0.198.0 (#895)
Bumps [google.golang.org/api](https://github.com/googleapis/google-api-go-client) from 0.197.0 to 0.198.0.
- [Release notes](https://github.com/googleapis/google-api-go-client/releases)
- [Changelog](https://github.com/googleapis/google-api-go-client/blob/main/CHANGES.md)
- [Commits](https://github.com/googleapis/google-api-go-client/compare/v0.197.0...v0.198.0)

---
updated-dependencies:
- dependency-name: google.golang.org/api
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-09-20 05:25:21 +00:00
Gabe Ruttner
0173625c3e docs: cel-concurrency (#892)
* docs: cel-concurrency

* fix: default expression
2024-09-19 21:57:10 -04:00
abelanger5
0204929b02 fix: concurrency key performance (#894) v0.45.3 2024-09-19 21:28:08 -04:00
abelanger5
7e2923d402 fix: nil concurrency limit strategy (#893)
* fix: queue properly on internal retry

* fix: panic on nil limit strategy
v0.45.2
2024-09-19 16:52:13 -04:00
abelanger5
d61f37de14 fix: queue properly on internal retry (#891) 2024-09-19 20:11:47 +00:00
Sean Reilly
15c50f46b5 Partial PR - need to generate SDK - Add endpoint to get the total free worker slots for a worker and the … (#857)
* Add endpoint to get the total free worker slots for a worker and the max runs

* update to use WorkerSempahoreCount instead of checking stepRunId

* modify the query for the new table and change the interface

* bump golangci-lint make changes to name of returned data

* revert the simple example

---------

Co-authored-by: Sean Reilly <sean@hatchet.run>
2024-09-19 10:11:16 -07:00
abelanger5
e72faf75fd fix: better error string for CEL (#890) v0.45.1 2024-09-19 12:04:37 -04:00
abelanger5
d23e5d9963 feat: expression-based concurrency keys (#889)
* feat: expression-based concurrency keys

* fix: build

* fix: typos

* fix: gen

* fix: migration

* fix: remove print statements

* fix: reassignment bugs, retries on closed transport, pr review
v0.45.0
2024-09-19 10:32:22 -04:00
Steinway Wu
44d03af852 fix: propagating additional metadata for child workflows (#882)
* fix: propagating additional metadata for child workflows

* add unit test
2024-09-19 13:28:46 +00:00
Sean Reilly
421fd08f78 bump protobuf to latest stable (#886)
* bump protobuf to latest stable

* regenerate the proto

---------

Co-authored-by: Sean Reilly <sean@hatchet.run>
2024-09-17 18:09:03 -07:00
dependabot[bot]
5ca2adaf46 chore(deps): bump github.com/go-co-op/gocron/v2 from 2.11.0 to 2.12.0 (#885)
Bumps [github.com/go-co-op/gocron/v2](https://github.com/go-co-op/gocron) from 2.11.0 to 2.12.0.
- [Release notes](https://github.com/go-co-op/gocron/releases)
- [Commits](https://github.com/go-co-op/gocron/compare/v2.11.0...v2.12.0)

---
updated-dependencies:
- dependency-name: github.com/go-co-op/gocron/v2
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-09-17 05:04:37 +00:00
abelanger5
55eb63d9a4 fix: replay without group keys and status updates (#883) v0.44.8 2024-09-16 16:59:34 -04:00
Gabe Ruttner
2379e3638a fix: reset on replay (#875) 2024-09-16 17:01:51 +00:00
Gabe Ruttner
af9ed49f1e fix: events list view (#878)
* fix: filter by event id

* fix: run count

* feat: filter by id api

* feat: filter by Event Id

* chore: default page is runs

* feat: cancel event runs

---------

Co-authored-by: Alexander Belanger <alexander@hatchet.run>
2024-09-16 16:46:31 +00:00
Gabe Ruttner
c64c62f66a feat: improved workflow run details page (#821)
* wip: rip prisma

* wip

* wip

* fix: lint

* wip

* wip

* gen

* wip

* wip

* fix trigger

* hide overview

* revert db changes

* feat: wrap up frontend changes and perf

* chore: generate

* chore: frontend build

* fix: workflow transformer

* fix: avoid race conditions on simultaneous parent completions

* fix: 2025 started

* feat: toast for replay/cancel

* fix: toast

---------

Co-authored-by: Alexander Belanger <alexander@hatchet.run>
2024-09-16 15:39:49 +00:00
dependabot[bot]
eadd485247 chore(deps): bump github.com/steebchen/prisma-client-go (#880)
Bumps [github.com/steebchen/prisma-client-go](https://github.com/steebchen/prisma-client-go) from 0.40.1 to 0.41.0.
- [Release notes](https://github.com/steebchen/prisma-client-go/releases)
- [Commits](https://github.com/steebchen/prisma-client-go/compare/v0.40.1...v0.41.0)

---
updated-dependencies:
- dependency-name: github.com/steebchen/prisma-client-go
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-09-16 15:01:39 +00:00