Commit Graph

105 Commits

Author SHA1 Message Date
Gabe Ruttner
b802f9f45f feat: stream by addl meta (#751)
* feat: prop schedule and run

* wip

* fix: filter wfrid

* feat: hangup

* chore: rm debug log

* chore: func name

* fix: cancelled payload

* fix: load

* fix: cleanup the cahce

* fix: single proto

* fix: key -> val

* chore: case

* chore: rm dead code

* chore: rm dead code

* feat: go and docs

* fix: docs
2024-07-29 19:09:51 +00:00
Jürgen Brandstetter
01a66dcf05 The tab order for python/typescript/go was wrong (#753) 2024-07-29 12:51:28 +00:00
Gabe Ruttner
fd947cb5bc feat: go worker assignment (#741)
* feat: create worker with label

* feat: worker context

* feat: dynamic labels

* feat: affinity

* fix: ptr

* fix: nil labels

* feat: sticky dag

* feat: sticky docs

* feat: sticky children

* chore: lint

* fix: tests

* fix: possibly nil workerId

* chore: cleanup unneeded pointers
2024-07-26 10:19:11 -07:00
Gabe Ruttner
ee68786d69 feat: sticky workers (#695)
* wip

* wip: functional query

* feat: expose affinity config

* feat: add weight to proto

* feat: upsert affinity state on worker start

* fix: linting

* feat: add upsert proto

* feat: upsert handler

* feat: revise model

* fix: labels

* feat: functional desired worker

* wip: ui

* feat: add state to step run events

* fix: filter empty keys

* fix: labels as badges

* feat: empty state and descriptive text

* chore: add todo

* chore: whitespace

* chore: cleanup

* chore: cleanup

* chore: fix hash

* chore: squash migrations

* fix: fair worker assignment

* fix: remaining slots on valid desired workers

* wip: sticky

* fix: count slots

* chore: rm log line

* feat: expose sticky config

* wip: sticky dag

* feat: expose desired worker id to trigger

* feat: trigger on desired worker

* feat: typescript docs

* feat: sticky python

* feat: py sticky children

* wip: py affinity

* serverless note

* feat: complete python examples

* linting

* fix: doc link

* chore: rm debug log

* fix: simplify list labels

* fix: typo
2024-07-22 17:20:23 -04:00
Gabe Ruttner
2427707098 Pr 629 (#705)
* docs: added concurrency examples

* docs: added more examples in user guide

* lint: fixed linting and build issues

* docs: added more examples for user guide features

* lint: fixed pre-commit lint issues

* lint: prettier issues fixed

* lint: fixed linting and formatting issues

* lint: formatting fix

* docs: replace deprecated on method in user guide with register workflow and added tabs in cancellation mechanisms

* docs: fixed go sdk registerworkflow params in user guide

* lint-fix: Removed four backticks and random whitespaces in documentation (#715)

---------

Co-authored-by: Akshat Sharma <akshatsharma2602@gmail.com>
Co-authored-by: Akshat Sharma <35724794+akshat2602@users.noreply.github.com>
2024-07-16 14:56:28 +00:00
Gabe Ruttner
d9ce67bf89 fix: remove extra ports (#721) 2024-07-15 09:17:50 -04:00
abelanger5
f36e66cd28 feat: configurable data retention period (#693)
* feat: data retention for tenants

* chore: generate and docs

* chore: lint
2024-07-06 14:31:12 +00:00
Becca Britt
49709e833c Fix: python sdk docs hatchet.admin references (#678)
Fix references to hatchet admin module in python-sdk docs
2024-07-01 14:53:34 -04:00
abelanger5
8a991c1cb0 fix(go-sdk): add schedule timeout (#673)
* fix(go-sdk): add schedule timeout

* chore: lint
2024-06-30 11:38:39 -04:00
Luca Steeb
31cf5be248 docs(webhooks): webhook docs (#646)
* docs(webhooks): webhook docs

* update top description of webhooks doc

* add vercel info

---------

Co-authored-by: Alexander Belanger <alexander@hatchet.run>
2024-06-27 09:38:04 -04:00
abelanger5
29f580af37 docs: use RegisterWorkflow instead of On (#661) 2024-06-27 08:05:03 -04:00
abelanger5
f2c6bc1f44 feat: tenant partitioning (#649)
* feat: tenant partitioning

* fix: rebalance inactive partitions, split into separate partitioner

* fix: shutdown partitioner scheduler properly

* update config options

* fix: config options linting
2024-06-26 21:06:51 +00:00
Luca Steeb
1490d88954 feat: webhook workers (#542)
Adds serverless support via the concept of webhook workers. Allows any webhook to be registered as a serverless endpoint for executing a step.
2024-06-25 17:06:43 -04:00
abelanger5
ff939149de docs: typescript sdk docs overhaul (#621)
* docs: typescript sdk docs overhaul

* docs(typescript): fix imports (#626)

* docs: finish with updated typescript api

* docs: better abort controller doc

* docs: type parameters

---------

Co-authored-by: Luca Steeb <contact@luca-steeb.com>
2024-06-25 15:47:20 +00:00
abelanger5
185f6b37d2 docs: remove request access links (#619) 2024-06-19 14:10:15 -04:00
abelanger5
04fdaae8a3 docs: overhaul python sdk docs (#612) 2024-06-18 17:38:22 -04:00
Luca Steeb
4789f65772 docs(self-hosting): remove invalid k8s link (#607) 2024-06-17 18:00:18 +00:00
Philip Miglinci
7a234bd10f feat(docs): add install Hatchet via Glasskube guide (#591)
Signed-off-by: Philip Miglinci <pmig@glasskube.com>
Co-authored-by: Alexander Belanger <alexander@hatchet.run>
2024-06-17 09:15:30 -04:00
abelanger5
6acb6d131e fix: kubernetes self-hosted key generation script should be able to run as non-root user (#595) 2024-06-14 09:36:21 -04:00
abelanger5
c179da468f docs: update kubernetes self-hosted docs (#590)
* docs: update kubernetes self-hosted docs

* fix: linting and specify .env file

* Update frontend/docs/pages/self-hosting/kubernetes-quickstart.mdx

Co-authored-by: Luca Steeb <contact@luca-steeb.com>

---------

Co-authored-by: Luca Steeb <contact@luca-steeb.com>
2024-06-13 22:28:55 +00:00
Luca Steeb
32f3928844 docs: fixes (#592) 2024-06-13 17:29:38 +01:00
Philip Miglinci
5a90941392 fix(docs): "Edit this page" link was broken (#589)
Signed-off-by: Philip Miglinci <pmig@glasskube.com>
2024-06-13 07:16:51 -04:00
abelanger5
12e0fe6671 docs: hatchet-lite setup guide (#573)
* docs: hatchet-lite setup guide

* chore: docs lint

* fix: add line

* fix: hatchet-lite init

* fix: auto-gen env file for guides

* fix: volume path

* fix: imports
2024-06-10 21:43:39 -04:00
Gabe Ruttner
e09ee98df5 feat: expose retry count (#524)
* feat: expose retry count

* feat: expose retry count go

* docs: accessing retry count

* fix: import

* fix: tests

* fix: docs formatting

---------

Co-authored-by: Alexander Belanger <alexander@hatchet.run>
Co-authored-by: abelanger5 <belanger@sas.upenn.edu>
2024-06-07 15:27:38 +00:00
abelanger5
b7b88bcabb fix: typo (#558) 2024-06-05 09:19:24 -04:00
abelanger5
991c4fd71e Update problems-with-celery.mdx 2024-06-04 10:17:44 -04:00
abelanger5
c7c2c0efc3 docs: celery blog post (#551)
* docs: celery blog post

* chore: lint

* docs: wrap up post
2024-06-04 14:16:29 +00:00
abelanger5
c920a9213e docs: update python sdk (#550)
* docs: update python sdk

* Apply suggestions from code review

Co-authored-by: Gabe Ruttner <gabriel.ruttner@gmail.com>

---------

Co-authored-by: Gabe Ruttner <gabriel.ruttner@gmail.com>
2024-06-03 16:32:10 +00:00
abelanger5
e60ac052b3 fix: typo in docs (#510) 2024-05-17 18:00:39 -04:00
abelanger5
0dd38e45f4 feat: make step run replays more intuitive (#507)
* feat: make step run replays more intuitive

* fix: npmrc file for vercel pnpm version diff

* fix: address changes from PR review
2024-05-17 17:32:15 -04:00
abelanger5
f652dd67df fix: minor docs issue with on failure step page (#506) 2024-05-16 12:24:03 -04:00
Gabe Ruttner
e6617e1381 feat: refresh timeout (#495)
* feat: show timeout on step run

* feat: refresh timeout

* fix: increment timeout from last time

* feat: add step run event for timeout refresh

* chore: generate

* feat: add refreshing timeouts docs section

* chore: linting

* feat: go client

* chore: generate

* chore: generate

* fix: test context

* chore: generate

* fix: rm txn

* fix: validator

* chore: lint

---------

Co-authored-by: Alexander Belanger <alexander@hatchet.run>
2024-05-16 12:23:36 -04:00
Luca Steeb
d1a4d35830 chore(pre-commit): lint whitespace (#494)
Adds a whitespace linter to the pre-commit hook to ensure consistent formatting.
It also enables linting of other SQL files such as for SQLc queries.
2024-05-16 09:17:01 -04:00
abelanger5
d1835458d8 chore: update versions of protoc,pnpm (#497)
* chore: update versions of protoc,pnpm

* chore: bump pnpm
2024-05-14 17:47:01 -04:00
Gabe Ruttner
b728616161 feat: improve reassign and timeout behavior and visibility (#484)
* feat: create step run event

* fix: shorten reassign heartbeat

* feat: add reassign event

* feat: fail timeout instead of cancel

* chore: squash migration

* chore: clarify copy

* docs: improve timeouts doc

* chore: linting

* chore: generate

* fix: test

* fix: send cancellation signal on timeout failure

* fix: rm retry check

* chore: update migration for release

---------

Co-authored-by: Alexander Belanger <belanger@sas.upenn.edu>
2024-05-14 16:47:00 -04:00
Gabe Ruttner
48d06b931a feat: client releasable slots (#476)
* feat: add release slot proto

* feat: add semaphore release state and methods

* feat: go sdk and example

* docs: manual slot release

* chore: linting

* fix: broken test

* fix: unlink step run on manual release

* feat: release slot event

* fix: test

* fix: revert e2e test changes

* chore: remove debug line

* fix: place step run query in same tx

* fix: change migration release version

---------

Co-authored-by: Alexander Belanger <belanger@sas.upenn.edu>
2024-05-14 15:22:46 -04:00
Gabe Ruttner
c8b59d1cc1 Feat add additional meta to trigger (#458)
* feat: add additional metadata to sdk

* docs: metadata

* fix: build

* feat: filter gif
2024-05-08 10:07:28 -04:00
Gabe Ruttner
2157a829b8 feat: on failure docs (#460) 2024-05-08 10:06:43 -04:00
abelanger5
4ce1dd8632 feat: multi-workflow runs listener on a single endpoint
* new api-contract for workflow run events

* feat: initial implementation for new subscribe listener

* fix: sync issues and send workflow runs immediately

* refactor: add context to all engine db queries, fix deadlocking query

* fix: use new ctx for deleting dispatcher and ticker

* add cancellation reasons

* fix: docs linting

---------

Co-authored-by: gabriel ruttner <gabriel.ruttner@gmail.com>
2024-04-18 20:55:11 -04:00
Alexander Belanger
5216a6c31b fix: update explain analyze query 2024-04-18 19:10:25 -04:00
abelanger5
56a098ed63 docs: wrap up fairness blog post (#396)
* docs: wrap up fairness blog post

* fix: docs theme and CTA
2024-04-18 11:22:28 -04:00
Luca Steeb
fcf28b322d feat(docs): automatic theme (#386) 2024-04-17 17:11:48 +04:00
Abhiuday Gupta
c8a79aabf3 chore(format): added pre-commit hooks and formatted files (#294)
Co-authored-by: steebchen <contact@luca-steeb.com>
2024-04-16 22:19:21 +04:00
Gabe Ruttner
f43f32283c feat(py/go): namespaces (#354)
* feat: namespaced python

* wip: namespaced go

* fix: service name

* fix: tests

* feat: client WithNamespace

* feat: namespace example

* feat: namespaced event triggers

* docs: namespace docs

* chore: linting

---------

Co-authored-by: gabriel ruttner <gabe@hatchet.run>
2024-04-15 11:26:05 -07:00
abelanger5
7cf506a026 docs(blog): multi-tenant queues and fairness (#378)
* docs: concurrency blog

* blog: multi-tenant queues and fairness
2024-04-13 09:28:30 -04:00
Gabe Ruttner
e7ed95c717 docs: v0.20 release (#377) 2024-04-12 15:21:30 -07:00
abelanger5
f16a9cd0dc feat: add github sso to dashboard (#373) 2024-04-11 15:32:12 -04:00
Gabe Ruttner
7ab7290eec feat: UI tweaks (#332)
* fix: help button treatment

* feat: revise worker docs

* feat: worker empty state

* fix: docs build

* chore: fix linting

---------

Co-authored-by: gabriel ruttner <gabe@hatchet.run>
2024-04-03 07:35:24 -07:00
Gabe Ruttner
2cd61a6dc0 docs: global rate limits (#330)
* chore: regen protos

* feat: admin put rate limit

* fix: client type

* feat: rate limit example

* feat: workflow config

* feat: step config

* release: py 0.21.0

* feat: rate limit draft

* add behavior description

* chore: cleanup examples

* feat: finalized revision

* chore: linting

---------

Co-authored-by: gabriel ruttner <gabe@hatchet.run>
2024-04-02 17:48:02 +00:00
abelanger5
d01736c15a feat(py-sdk): add support for put_workflow extending from base workflow (#329)
* feat(py-sdk): add put_workflow method and extend from base class

* feat: add cron_input to create workflow API
2024-04-02 13:29:16 -04:00