Commit Graph

31 Commits

Author SHA1 Message Date
Gabe Ruttner
b9f3ff1609 feat(py-sdk): async steps (#246)
* feat: async wrapper

* feat: async examples

* release: bump version 0.15.1
2024-03-06 15:24:44 -08:00
abelanger5
85d89886d3 feat: display concurrency settings on the UI (#236)
* feat: display concurrency settings on the UI

* feat: show triggering settings as well
2024-03-04 22:15:56 -05:00
abelanger5
d3534edc4c fix: parse schema in API, not engine (#233)
* no schema parsing in core engine

* fix: parse schema in api, not engine

* fix: parsing of input schema should not use json keys as field names
2024-03-04 18:39:54 -05:00
abelanger5
c4fc355805 feat: events list filtering by status (#232) 2024-03-04 17:10:44 -05:00
abelanger5
043f23e2a3 feat: support ingestion from SNS (#231) 2024-03-04 16:52:45 -05:00
abelanger5
d376b953aa feat: python rest api (#223)
* feat: Adds a generated REST API client and exposes workflow methods for programmatic usage
2024-03-02 20:33:20 -05:00
abelanger5
f256b258d8 feat: logging from step run executions (#217)
* fix: job cancellations with shared ctx

* fix: found the bug

* fix: all job runs were getting cancelled

* feat: support logging from executions

* fix: place logging in background

* add back split screen
2024-03-01 17:55:31 -05:00
abelanger5
46967db3ad feat: configurable scheduling timeouts (#204)
* feat: configurable scheduling timeouts

* fix: remove validator for now
2024-02-28 01:02:13 -05:00
abelanger5
6ea38a99f2 feat: support maxRuns parameter on workers (#195)
* feat: round robin queueing

* feat: configurable max runs per worker

* fix: address PR review

* docs for max runs and group round robin
2024-02-26 00:48:46 -05:00
abelanger5
2d625fec81 feat: round robin queueing (#194) 2024-02-26 00:16:40 -05:00
Gabe Ruttner
5bd42b16ec chore: cleanup example (#184) 2024-02-22 15:15:07 -05:00
abelanger5
149fa7b15e docs: improvements, launch post (#183)
* docs: improvements, launch post

* fix: python sdk exception

* Update README.md

* add videos, remove gifs

* docs logo link should be homepage

* Update README.md

* copy edits and feedback
2024-02-22 14:56:51 -05:00
Gabe Ruttner
a7cff7f218 fix: worker listener retires (#181)
* hotfix: add repository for npm publish

* release(py-sdk): bump version

* chore: ignore venv

* fix: add timeout to retry

* chore: rm change

* fix: remove duplicate logic and favor retries in dispatcher

* release: bump version

* fix: retry on general failures

* chore: rm unused code

* fix: retries reset if greater than interval
2024-02-21 18:54:42 -08:00
abelanger5
e44c3a1290 fix: link github issues and support insecure py opt (#180) 2024-02-20 13:14:30 -05:00
abelanger5
2f14e74b5c chore: rename overrides to playground (#179) 2024-02-19 20:29:27 -05:00
abelanger5
6b747711fb fix: engine bugs and python sdk (#178)
* fix: engine bugs and python sdk

* chore: fix linting
2024-02-19 18:57:05 -05:00
abelanger5
df3f540748 feat: add retries to the engine and SDKs (#171)
This PR adds support for retrying failed step runs against the engine and SDKs. This was tested up to 30 retries per step run, with both failure and success at the 30th step run. Each SDK now has a `retries` configurable param for steps when declaring a workflow.
2024-02-16 13:00:22 -05:00
g
4d44c7eaff chore: build errors and linting 2024-02-15 17:45:50 -07:00
abelanger5
3743746657 feat: github app integration (#163)
* feat: github app integration

* chore: proto

* fix: migrate instead of push

* fix: db migrate -> migrate

* fix: migrate again

* remove skip-generate

* add back generate

* setup pnpm
2024-02-13 21:34:16 -05:00
Gabe Ruttner
45813fdb1b feat: dashboard playground ui (#162)
* hotfix: add repository for npm publish

* release(py-sdk): bump version

* chore: ignore venv

* feat(dashboard): collapsible sidebar

* fix: hangup workflow listener when workflow run finishes (#161)

* wip: class based listener pattern

* fix: workflow run listener hangups

* fix: hang up workflow listener on finished

* fix: case for current workflow run

* address review comments

* bump version

---------

Co-authored-by: g <gabriel.ruttner@gmail.com>

* wip: focus state and flat playground

* fix: focus state

* feat: unify state

* wip: playground state

* cleanup: rm logging

* fix: default output

* cleanup: rm deadcode

* feat: can replay individual steps

* feat: icon tabs

* feat: sticky output

* cleanup: linting

---------

Co-authored-by: abelanger5 <belanger@sas.upenn.edu>
2024-02-13 10:24:46 -07:00
Alexander Belanger
011125abfd feat(wip): add overrides data and input schema to database 2024-02-09 10:03:20 -05:00
Gabe Ruttner
511b91a4ec fix: async generator (#155)
* hotfix: add repository for npm publish

* release(py-sdk): bump version

* fix: async generator

* release: bump version

* fix: remove unused logging
2024-02-06 07:17:56 -05:00
Gabe Ruttner
5f06e8cfce feat (py-sdk): python streaming generator (#154)
* hotfix: add repository for npm publish

* release(py-sdk): bump version

* feat: expose generator

* release: bump version
2024-02-05 18:16:23 -05:00
Gabe Ruttner
9f17b61621 release(py-sdk): bump version 2024-02-05 12:40:40 -05:00
Gabe Ruttner
5ccc5614a9 feat(py-sdk): event streaming and manual triggering (#152)
* hotfix: add repository for npm publish

* chore: generate protos

* feat: trigger workflow

* fix: remove tenant id from schedule workflow

* fix: logging

* feat: run returns workflow_run_id

* feat: listen for run events

* feat: listener calls handler

* chore: address review comment
2024-02-05 12:32:04 -05:00
abelanger5
73adb7791e feat: custom claims for setting grpc/server addr in token (#150) 2024-02-05 00:18:19 -05:00
abelanger5
aed11c3958 feat: workflow visualization and qol improvements (#140)
* feat: workflow visualization and qol improvements

* fix: npm build
2024-02-02 01:35:05 -05:00
abelanger5
52ba01bf06 chore: qol improvements (#137) 2024-01-30 00:08:52 -05:00
abelanger5
d63b66a837 feat: concurrency groups (#135)
* first pass at moving controllers around

* feat: concurrency limits for strategy CANCEL_IN_PROGRESS

* fix: linting

* chore: bump python sdk version
2024-01-30 00:00:28 -05:00
abelanger5
40760e0951 chore(python-sdk): improved thread cancellation handling, docs, and custom sleep method (#134)
* feat: timeout on python steps

* chore(python-sdk): improved thread handling and docs

* docs: default timeout
2024-01-27 22:14:48 -05:00
Gabe Ruttner
6401b56611 chore: rename sdk for consistency (#131) 2024-01-26 19:46:17 -07:00