Commit Graph

57 Commits

Author SHA1 Message Date
Gabe Ruttner
2cd61a6dc0 docs: global rate limits (#330)
* chore: regen protos

* feat: admin put rate limit

* fix: client type

* feat: rate limit example

* feat: workflow config

* feat: step config

* release: py 0.21.0

* feat: rate limit draft

* add behavior description

* chore: cleanup examples

* feat: finalized revision

* chore: linting

---------

Co-authored-by: gabriel ruttner <gabe@hatchet.run>
2024-04-02 17:48:02 +00:00
abelanger5
d01736c15a feat(py-sdk): add support for put_workflow extending from base workflow (#329)
* feat(py-sdk): add put_workflow method and extend from base class

* feat: add cron_input to create workflow API
2024-04-02 13:29:16 -04:00
Gabe Ruttner
d731a13afd docs: streaming (#323)
* fix: linting

* docs: rename page

* docs: streaming ts/py

* fix: linting

---------

Co-authored-by: gabriel ruttner <gabe@hatchet.run>
2024-04-01 14:52:52 -07:00
Luca Steeb
cb15fff91f chore(docs): fix formatting in child-workflows.mdx (#307) 2024-03-30 17:17:41 -04:00
gabriel ruttner
bfa867408f fix: await gather 2024-03-29 14:27:48 -07:00
abelanger5
c1b1edcfad Update child-workflows.mdx 2024-03-29 17:14:53 -04:00
Alexander Belanger
be3388f7f0 fix: linting errors on docs 2024-03-29 14:07:39 -07:00
abelanger5
d917ebdda0 docs: child workflows (#302)
* docs: spawn and join

* lint: prettier

* docs: insert video for launch post

* chore: address feedback

* docs: clean up go example

* Update child-workflows.mdx
2024-03-29 14:07:39 -07:00
Gabe Ruttner
1dccc387b0 feat(py): schedule_workflows (#287)
* feat: schedule workflows

* docs: delay events

* fix: linting

* release: py 0.18.0
2024-03-22 20:46:20 -04:00
Luca Steeb
82cb1c0936 chore(docs): add and run prettier (#284) 2024-03-22 23:04:19 +07:00
g
617a306b13 docs: fix worker start 2024-03-20 18:04:56 -07:00
abelanger5
65224753c1 fix(go-sdk): support tls strategy of none, with docs (#269)
* fix(go-sdk): support tls strategy of none, with docs

* chore: errorf -> sprintf in examples

* Apply suggestions from code review

Co-authored-by: Luca Steeb <contact@luca-steeb.com>

* fix: remove time from example

---------

Co-authored-by: Luca Steeb <contact@luca-steeb.com>
2024-03-18 14:02:53 -04:00
Luca Steeb
f1d193a32d fix(docs): adapt home sdk redirect (#262) 2024-03-13 22:22:40 +07:00
g
6cc8bd1e3a fix: deadlink 2024-03-08 17:16:25 -08:00
g
ae00b16cc3 fix: doc dead-link 2024-03-08 09:56:39 -08:00
Gabe Ruttner
f608b0b287 docs: multiple environments (#248)
* page: environments

* chore: page titles
2024-03-07 13:45:06 -08:00
g
e8ef805612 hot-fix: rm dead tutorials 2024-03-06 09:40:25 -08:00
Gabe Ruttner
22cdea8170 feat: doc improvements (#222)
* feat: split sdk and user guides

* fix: feedback

* feat: new doc structure

* fix: hidden pages

* feat: overview pages

* feat: working with hatchet

* docs: cancel-in-progress

* docs: round-robin

* docs: cancellation in node

* docs: update durable execution

* docs: streaming

* docs: errors-logging

* docs: add todo for screenshot

* docs: concurrency overview

* docs: clarify maxRuns per worker

* docs: maxRun clarifications

* docs: retries

* docs: timeouts

* docs: triggering

* docs: menus

* docs: fast api tutorial

* docs: basic todos

* docs: little fixes

* docs: fixes

* chore: add posthog

* fix: rm page change tracking for now...
2024-03-06 09:36:22 -08:00
abelanger5
d376b953aa feat: python rest api (#223)
* feat: Adds a generated REST API client and exposes workflow methods for programmatic usage
2024-03-02 20:33:20 -05:00
abelanger5
f256b258d8 feat: logging from step run executions (#217)
* fix: job cancellations with shared ctx

* fix: found the bug

* fix: all job runs were getting cancelled

* feat: support logging from executions

* fix: place logging in background

* add back split screen
2024-03-01 17:55:31 -05:00
abelanger5
68093b3e55 docs: playground on TS sdk (#213) 2024-02-29 01:01:01 -05:00
abelanger5
5ef8a57f20 docs: update index and add self-hosted index (#205)
* docs: update index and add self-hosted index

* Update index.mdx
2024-02-28 01:04:05 -05:00
g
a4fd3f910c fix: missing comma, workflowInput func 2024-02-26 16:11:42 -08:00
abelanger5
6ea38a99f2 feat: support maxRuns parameter on workers (#195)
* feat: round robin queueing

* feat: configurable max runs per worker

* fix: address PR review

* docs for max runs and group round robin
2024-02-26 00:48:46 -05:00
abelanger5
8816a7c016 docs: update logo link (#188) 2024-02-22 15:18:26 -05:00
Gabe Ruttner
4e32c91a5f chore: simplify setup (#185)
* chore: simplify setup

* fix: generate-all
2024-02-22 15:14:57 -05:00
abelanger5
106d09e780 docs: update launch post (#187)
* fix: docker-compose set to pg 15

* docs: add extra step in launch
2024-02-22 15:14:18 -05:00
abelanger5
e15dfc19ae fix: docker-compose set to pg 15 (#186) 2024-02-22 15:04:52 -05:00
abelanger5
149fa7b15e docs: improvements, launch post (#183)
* docs: improvements, launch post

* fix: python sdk exception

* Update README.md

* add videos, remove gifs

* docs logo link should be homepage

* Update README.md

* copy edits and feedback
2024-02-22 14:56:51 -05:00
Alexander Belanger
0f47188c09 feat: github app integration with playground 2024-02-18 21:39:29 -05:00
Alexander Belanger
3a76fc31ec docs: github app setup for contributors 2024-02-18 16:40:58 -05:00
abelanger5
df3f540748 feat: add retries to the engine and SDKs (#171)
This PR adds support for retrying failed step runs against the engine and SDKs. This was tested up to 30 retries per step run, with both failure and success at the 30th step run. Each SDK now has a `retries` configurable param for steps when declaring a workflow.
2024-02-16 13:00:22 -05:00
abelanger5
d5f991d15b feat: add custom user data to each step (#156)
* feat: (wip) bundle rest API in typescript client

* chore: add generated files

* chore: pnpm lock file

* extract tenant id from token subject

* feat: add custom user data to context

* docs: generated with typedoc
2024-02-09 09:43:33 -05:00
abelanger5
73adb7791e feat: custom claims for setting grpc/server addr in token (#150) 2024-02-05 00:18:19 -05:00
abelanger5
7bdfa78bd9 docs: fix npx run worker (#149)
* docs: update quickstart

* docs: npx run -> npm run
2024-02-04 21:27:34 -05:00
abelanger5
ce52a448ae docs: update quickstart (#148) 2024-02-04 20:48:35 -05:00
Gabe Ruttner
703c93c10b Docs: Update typescript docs (#147)
* hotfix: add repository for npm publish

* feat: typescript doc fixes

* fix: drop pythonic speak
2024-02-04 19:07:29 -05:00
abelanger5
69833c3625 docs: improvements from feedback (#146) 2024-02-04 17:47:58 -05:00
abelanger5
d97fe63149 docs: specify SDK environment variables and compatibility (#126)
* docs: initial sdk compatability docs

* feat: style and update docs

* fit: ignore logo for redirects
2024-02-03 23:16:03 -05:00
abelanger5
d63b66a837 feat: concurrency groups (#135)
* first pass at moving controllers around

* feat: concurrency limits for strategy CANCEL_IN_PROGRESS

* fix: linting

* chore: bump python sdk version
2024-01-30 00:00:28 -05:00
abelanger5
40760e0951 chore(python-sdk): improved thread cancellation handling, docs, and custom sleep method (#134)
* feat: timeout on python steps

* chore(python-sdk): improved thread handling and docs

* docs: default timeout
2024-01-27 22:14:48 -05:00
Gabe Ruttner
cd3f7d83ed feat: typescript client (#110)
* (wip) python SDK

* feat: python client, initial version finished

* initial typescript client

* linting and protoc generation

* generated protobuf data shapes

* remove accidental package

* add jest, initial config loader

* add test:watch

* configuration loader

* better error handling

* ts paths

* fix jest: module name mapper

* initial client

* chore rename tests

* chore move client to clients

* class method use this

* stubs

* change protoc generate strategy

* wip push

* fix: tsconfig

* chore: swap for nice-grpc

* feat: event client

* feat: dispatcher client

* chore: barrel files

* wip: action-listener

* fix: actions generator yields local actions

* Merge branch 'main' into typescript-client

* feat: semver

* fix: rename

* revert: python auto-prettier changes

* feat: admin client

* feat: worker

* refactor: rename Client to HatchetClient

* feat: load ssl certs

* wip: example

* fix: credential handling

* fix: tests for clients with optional credentials

* feat: examples

* feat: functional client

* fix: move examples

* cleanup: simple tasks

* cleanup: rm dead code

* fix: example includes parent dependency

* feat: docs

* fix: step types

* fix: dag example

* feat: logging

* fix: docs building

* fix: logging tests

* fix: address review for docs

* ops: github workflow

* fix: typo

* cleanup: rm todo

* feat: attempt to finish tasks before exit

* cleanup

* fix: worker start retires

* Update typescript-sdk-tests.yml

* fix: actions

* chore: rename directory

* fix: test logging

* fix: docs for input param

* feat: publish package!

* fix: action name

* fix: manual release

* fix: update protoc to latest

* feat: replace auto versioning with put

* cleanup: unused imports

* feat: add token and tls options

* feat: token auth

* fix: typo

* fix: test focus

* Update frontend/docs/pages/typescript-sdk/setup.mdx

Co-authored-by: abelanger5 <belanger@sas.upenn.edu>

* fix: rm unused tenantId

* fix: remove input from step context

---------

Co-authored-by: Alexander Belanger <belanger@sas.upenn.edu>
2024-01-27 09:56:49 -07:00
abelanger5
cfa4b5c8f4 fix: python sdk graceful shutdown and retry errors (#118)
* fix: python sdk graceful shutdown and retry errors

* chore: address changes from review
2024-01-22 19:52:02 -05:00
abelanger5
0c94f0d933 feat: python client (#109)
* (wip) python SDK

* feat: python client, initial version finished

* fix: add curl to migration dockerfile

* add insecure option for grpc

* create docs and publishing workflow

* delete old hatchet folder
2024-01-20 09:18:25 -05:00
abelanger5
52fde1e704 feat: dag-style execution (#108)
* feat: dag-style execution

* docs: update to reflect new context

* ensure no cycles

* remove example cycle

* linting

* lint and small fixes

* update deferred rollback

* last rollback handling

* unset max issues

* fix requeue edge case
2024-01-16 11:31:24 -05:00
abelanger5
752d5b0ab7 feat: support passing inputs to scheduled workflows (#104)
* fix: usage of RegisterAction

* make registered actions callable

* chore: update yaml example

* docs: register action documented

* feat: support input to scheduled workflows

* add worker

* add client

* docs: add input to schedule workflow

* chore: generate with updated protoc

* chore: sqlc generate
2024-01-12 00:27:34 -05:00
abelanger5
1f7baacb94 Fix usage of RegisterAction and update docs (#103)
* fix: usage of RegisterAction

* make registered actions callable

* chore: update yaml example

* docs: register action documented
2024-01-11 18:42:20 -05:00
abelanger5
62445dc37f feat: support one-time scheduled workflows (#84)
* feat: support one-time scheduled workflows

* refactor: move schedule out of workflow trigger def

* docs: add scheduling workflows section

* docs: update creating workflow

* only cancel schedules that are in the future
2024-01-08 10:03:32 -05:00
abelanger5
7d1cf5400f feat: add middleware to worker and services (#82)
* feat: add middleware support

* docs: add middleware to docs

* chore: remove commented code

* address review comments
2024-01-05 08:35:19 -05:00
abelanger5
ff30027ae7 feat: update go-sdk workflow syntax to make it less verbose (#78)
* feat: update go-sdk workflow syntax to make it less verbose

* docs: make triggers and definitions more clear
2024-01-03 17:14:12 -05:00