Commit Graph

24 Commits

Author SHA1 Message Date
abelanger5
cdf203dc3e feat: new listen strategy with worker-side heartbeats (#308) 2024-03-31 22:45:10 -04:00
Gabe Ruttner
d426c9316d feat(py-sdk): spawn and join (#299)
* chore: expose full client to context

* chore: update protos

* feat: add parent options to trigger

* feat: example fanout worker

* fix: typehint

* feat: add spawn workflow to context

* wip: polling and streaming

* fix: correct request

* chore: rm logging

* feat: working polling

* feat: functional polling

* chore: separate connection

* feat: functional streaming and listening

* fix: get result payload

* fix: increased initial poll interval

* release (py): 0.19.0

---------

Co-authored-by: gabriel ruttner <gabe@hatchet.run>
2024-03-29 14:07:39 -07:00
Gabe Ruttner
1dccc387b0 feat(py): schedule_workflows (#287)
* feat: schedule workflows

* docs: delay events

* fix: linting

* release: py 0.18.0
2024-03-22 20:46:20 -04:00
abelanger5
d9360520de chore: add better telemetry to database (#268)
* chore: add better telemetry to database

* fix: span end on query
2024-03-15 15:08:40 -04:00
abelanger5
d7e6e4d8c6 fix: worker locking on requeues (#265)
* fix: worker locking on requeues

* chore: add alerter to dispatcher
2024-03-13 21:50:02 -04:00
abelanger5
c66f97c856 fix: deadlocks on workers and tickers (#241)
* chore: add sentry support to engine

* fix: deadlocks on workers and tickers

* refactor: reduce prisma calls in engine

* trigger

* fix: remove some tenant lookups

* feat: dlx and renamed taskqueue -> msgqueue

* refactor: get group key run logic

* fix: retry counts on messages and concurrency edge cases

* fix: rabbitmq integration tests

* feat: add consumer timeouts

---------

Co-authored-by: Luca Steeb <contact@luca-steeb.com>
2024-03-12 00:45:18 -04:00
Gabe Ruttner
b9f3ff1609 feat(py-sdk): async steps (#246)
* feat: async wrapper

* feat: async examples

* release: bump version 0.15.1
2024-03-06 15:24:44 -08:00
abelanger5
d376b953aa feat: python rest api (#223)
* feat: Adds a generated REST API client and exposes workflow methods for programmatic usage
2024-03-02 20:33:20 -05:00
abelanger5
f256b258d8 feat: logging from step run executions (#217)
* fix: job cancellations with shared ctx

* fix: found the bug

* fix: all job runs were getting cancelled

* feat: support logging from executions

* fix: place logging in background

* add back split screen
2024-03-01 17:55:31 -05:00
abelanger5
46967db3ad feat: configurable scheduling timeouts (#204)
* feat: configurable scheduling timeouts

* fix: remove validator for now
2024-02-28 01:02:13 -05:00
abelanger5
6ea38a99f2 feat: support maxRuns parameter on workers (#195)
* feat: round robin queueing

* feat: configurable max runs per worker

* fix: address PR review

* docs for max runs and group round robin
2024-02-26 00:48:46 -05:00
abelanger5
2d625fec81 feat: round robin queueing (#194) 2024-02-26 00:16:40 -05:00
Gabe Ruttner
5bd42b16ec chore: cleanup example (#184) 2024-02-22 15:15:07 -05:00
abelanger5
2f14e74b5c chore: rename overrides to playground (#179) 2024-02-19 20:29:27 -05:00
abelanger5
6b747711fb fix: engine bugs and python sdk (#178)
* fix: engine bugs and python sdk

* chore: fix linting
2024-02-19 18:57:05 -05:00
g
4d44c7eaff chore: build errors and linting 2024-02-15 17:45:50 -07:00
abelanger5
3743746657 feat: github app integration (#163)
* feat: github app integration

* chore: proto

* fix: migrate instead of push

* fix: db migrate -> migrate

* fix: migrate again

* remove skip-generate

* add back generate

* setup pnpm
2024-02-13 21:34:16 -05:00
Gabe Ruttner
45813fdb1b feat: dashboard playground ui (#162)
* hotfix: add repository for npm publish

* release(py-sdk): bump version

* chore: ignore venv

* feat(dashboard): collapsible sidebar

* fix: hangup workflow listener when workflow run finishes (#161)

* wip: class based listener pattern

* fix: workflow run listener hangups

* fix: hang up workflow listener on finished

* fix: case for current workflow run

* address review comments

* bump version

---------

Co-authored-by: g <gabriel.ruttner@gmail.com>

* wip: focus state and flat playground

* fix: focus state

* feat: unify state

* wip: playground state

* cleanup: rm logging

* fix: default output

* cleanup: rm deadcode

* feat: can replay individual steps

* feat: icon tabs

* feat: sticky output

* cleanup: linting

---------

Co-authored-by: abelanger5 <belanger@sas.upenn.edu>
2024-02-13 10:24:46 -07:00
Alexander Belanger
011125abfd feat(wip): add overrides data and input schema to database 2024-02-09 10:03:20 -05:00
Gabe Ruttner
5f06e8cfce feat (py-sdk): python streaming generator (#154)
* hotfix: add repository for npm publish

* release(py-sdk): bump version

* feat: expose generator

* release: bump version
2024-02-05 18:16:23 -05:00
Gabe Ruttner
5ccc5614a9 feat(py-sdk): event streaming and manual triggering (#152)
* hotfix: add repository for npm publish

* chore: generate protos

* feat: trigger workflow

* fix: remove tenant id from schedule workflow

* fix: logging

* feat: run returns workflow_run_id

* feat: listen for run events

* feat: listener calls handler

* chore: address review comment
2024-02-05 12:32:04 -05:00
abelanger5
d63b66a837 feat: concurrency groups (#135)
* first pass at moving controllers around

* feat: concurrency limits for strategy CANCEL_IN_PROGRESS

* fix: linting

* chore: bump python sdk version
2024-01-30 00:00:28 -05:00
abelanger5
40760e0951 chore(python-sdk): improved thread cancellation handling, docs, and custom sleep method (#134)
* feat: timeout on python steps

* chore(python-sdk): improved thread handling and docs

* docs: default timeout
2024-01-27 22:14:48 -05:00
Gabe Ruttner
6401b56611 chore: rename sdk for consistency (#131) 2024-01-26 19:46:17 -07:00