dd50515aeb
fix: cancelling status on frontend ( #779 )
...
* fix: cancelling status on frontend
* fix: slot grid and dedupe on slots
2024-08-13 17:01:26 +00:00
4ea4712d4d
refactor: performance and throughput ( #756 )
...
Refactors the queueing logic to be fairly balanced between actions, with each action backed as a separate FIFO queue. Also adds support for priority queueing and custom queues, though those aren't exposed on the API layer yet. Improves throughput to be > 5000 tasks/second on a single queue.
---------
Co-authored-by: Alexander Belanger <alexander@hatchet.run >
2024-08-12 14:38:47 +00:00
a245151d91
feat: add workflow kind to workflow versions ( #750 )
...
* feat: support workflow kinds
* chore: generate
2024-07-29 12:07:34 -07:00
c0b01f1b9b
fix: workflow runs replays and show workflow run input ( #744 )
2024-07-25 17:35:10 +00:00
ee68786d69
feat: sticky workers ( #695 )
...
* wip
* wip: functional query
* feat: expose affinity config
* feat: add weight to proto
* feat: upsert affinity state on worker start
* fix: linting
* feat: add upsert proto
* feat: upsert handler
* feat: revise model
* fix: labels
* feat: functional desired worker
* wip: ui
* feat: add state to step run events
* fix: filter empty keys
* fix: labels as badges
* feat: empty state and descriptive text
* chore: add todo
* chore: whitespace
* chore: cleanup
* chore: cleanup
* chore: fix hash
* chore: squash migrations
* fix: fair worker assignment
* fix: remaining slots on valid desired workers
* wip: sticky
* fix: count slots
* chore: rm log line
* feat: expose sticky config
* wip: sticky dag
* feat: expose desired worker id to trigger
* feat: trigger on desired worker
* feat: typescript docs
* feat: sticky python
* feat: py sticky children
* wip: py affinity
* serverless note
* feat: complete python examples
* linting
* fix: doc link
* chore: rm debug log
* fix: simplify list labels
* fix: typo
2024-07-22 17:20:23 -04:00
a5724fc4f9
feat: replay workflow runs ( #732 )
...
* feat: replay workflow runs
* address pr review changes
2024-07-18 08:05:15 -07:00
b7cec9ec53
feat: soft delete ( #717 )
...
* feat: soft delete workflows and versions
* feat: filter soft deletes wf and wfr
* feat: filter events and step runs
* fix: query
* fix: query
* chore: generate
* wip
* chore: squash migrations
* chore: separate retention into new service
* feat: regularly clean up
* chore: migrations
* fix: tests
* fix: queries
* fix: ambiguous
* fix: refs
* fix: ambiguous id
* fix: remove update from
* fix: soft delete
* fix: cleanup retention scheduler
* fix: has more query
* chore: gen
* fix: query
* fix: table
2024-07-18 09:06:05 -04:00
5d87f380ef
feat: managed worker pools ( #725 )
...
* change api extension spec to register custom populators
* fix: support only bearer auth
* fix: correct authn logic
* fix: indexes on workflow runs, events
* feat: managed worker pools
* chore: lint fix
* hide workers view when not enabled
* support internal api tokens, minor improvements
* fix: actually write internal
* fix breaking changes
* don't allow revoking internal tokens
* fix: linting and remove metrics view
* fix: token
* address review and add feat flags
2024-07-16 13:33:46 +00:00
38a4ce647d
feat: improved workflow runs list ( #723 )
...
* feat: add duration to wfr
* chore: generate
* feat: sort order
* feat: add column visibility toggle
* chore: gen
2024-07-15 18:05:57 -04:00
f36e66cd28
feat: configurable data retention period ( #693 )
...
* feat: data retention for tenants
* chore: generate and docs
* chore: lint
2024-07-06 14:31:12 +00:00
461eda194a
feat: worker paused state ( #677 )
...
* feat: worker paused state
* feat: ui
* fix: comment
2024-07-01 18:44:12 +00:00
8a8a033af6
feat: variable token expiration ( #670 )
...
* feat: variable token expiration
* fix: typo
* fix: long tokens for webhook workers
* fix: format
2024-07-01 15:47:32 +00:00
f2c6bc1f44
feat: tenant partitioning ( #649 )
...
* feat: tenant partitioning
* fix: rebalance inactive partitions, split into separate partitioner
* fix: shutdown partitioner scheduler properly
* update config options
* fix: config options linting
2024-06-26 21:06:51 +00:00
68176b725c
feat: list step run archives ( #648 )
...
* feat: query
* feat: api
* fix: import
* fix: include tenant in query and count
* feat: archives in event list
* feat: ui improvements
* fix: collapsible
* fix: build
2024-06-26 16:40:23 -04:00
a8d42819ea
feat: check security service ( #639 )
...
* feat: check security service
* feat: propegate version
* feat: with ident
* fix: lint
* chore: generate
* fix: change domain
* fix: panic recover
* fix: migrations
* fix: hash
* fix: dont check in tests
2024-06-26 16:26:29 -04:00
35979bea68
feat: disable signups ( #643 )
...
* feat: disable signups
* feat: ui and password
* merge main
* fix: disable allow oauth
2024-06-26 16:12:40 -04:00
dc2b544ba8
fix: stub ( #651 )
2024-06-26 13:37:32 -04:00
9c773d3632
fix(webhooks): set deleted to false on upsert ( #650 )
2024-06-26 18:36:53 +01:00
1eafb49a8e
fix(webhooks): return unencrypted secret on create ( #647 )
2024-06-26 16:22:54 +00:00
1490d88954
feat: webhook workers ( #542 )
...
Adds serverless support via the concept of webhook workers. Allows any webhook to be registered as a serverless endpoint for executing a step.
2024-06-25 17:06:43 -04:00
5538196169
fix: correct lengths on random.Generate ( #638 )
2024-06-25 15:12:59 -04:00
697757879f
feat: billing ( #624 )
...
* feat: init lago client
* feat: billable meter
* feat: db persistence
* wip: expose sub
* feat: rename page
* wip: billing section
* wip: lago integration
* feat: separate plan and period
* wip: webhook
* feat: improve empty state
* feat: update limits on plan changes
* feat: can change plans
* feat: change plan loading state
* feat: yearly filter
* feat: billing clarification
* fix: treatment
* feat: filter plans
* feat: prevent non-owner from changing plan
* fix: loading state
* fix: jit portal link
* fix: rm import
* fix: build errors
* fix: default to free
* fix: wrong files
* fix: select or insert customer
* fix: note
* feat: upgrade dependent on payment method state
* fix: dedupe
* chore: remove github-app from core
* chore: port to cloud
* chore: port to cloud
* chore: port to cloud
* chore: port to cloud
* chore: port to cloud
* add new components, repository callbacks
* chore: rm unused packages
* chore: fix generation
* chore: gen
* fix: cloud api references
* debug
* debug
* fix: actually set plans
* chore: rm debug
* fix: build
* feat: callbacks
* fix: add generated code
* chore: group cloud components
* chore: group by feature
* feat: alert change
* feat: confirm
* fix: confirm modal
* fix: ui
* fix: remove arrears
* fix: open in same tab
* fix: wan alert
* fix: call the callback
* fix: callback obj
* fix: disable if no cloud meta
---------
Co-authored-by: Alexander Belanger <alexander@hatchet.run >
2024-06-25 13:57:16 -04:00
b6dcb4e7e9
refactor(random): refactor random string generation ( #633 )
2024-06-24 23:44:03 +01:00
ba7eb72f24
Feat dynamic limits ( #632 )
...
* chore: port from feature branch
* feat: can set limit map
* chore: generate
2024-06-24 11:38:01 -07:00
37c0f6549c
feat: add endpoint to REST API for creating an event, add UI for creating an event ( #616 )
...
* feat: add create event to rest api
* fix: ingestor usage
* feat: add create event to the UI
* fix: address PR review
2024-06-19 19:53:27 +00:00
a9fa824d37
feat: add endpoint for listing queue metrics ( #615 )
...
* wip: create openapi endpoint for queue metrics
* feat: add queue metrics api
2024-06-19 14:43:01 -04:00
7c3ddfca32
feat: api server extensions ( #614 )
...
* feat: allow extending the api server
* chore: remove internal packages to pkg
* chore: update db_gen.go
* fix: expose auth
* fix: move logger to pkg
* fix: don't generate gitignore for prisma client
* fix: allow extensions to register their own api spec
* feat: expose pool on server config
* fix: nil pointer exception on empty opts
* fix: run.go file
2024-06-19 09:36:13 -04:00
b9bab838c4
fix: workflow run sort order ( #567 )
...
* fix: default sort order
* feat: add created at col
2024-06-10 07:42:12 -07:00
bbc4e58dd9
feat: limits ( #559 )
...
* feat: workflow run limits
* fix: resource exhausted 429
* feat: event limit
* feat: worker limit
* fix: sensible error
* fix: pb
* feat: expose limits api
* feat: default limits
* feat: add enable alert option
* feat: slack and email alerts
* fix: cron interval
* feat: make metered util
* wip: schedules and crons
* chore: squash migration
* fix: select or insert
* fix: remove unfinished meter
* chore: atlas migration
* fix: template format
* fix: shared ErrResourceExhausted
* feat: cache
* fix: limit can be nil
* fix: clarification
* fix: close meter ticker
* fix: friendly error for child workflows
2024-06-07 10:57:57 -07:00
e0441a38a1
fix: only print routes in debug mode ( #564 )
2024-06-07 15:39:37 +00:00
f4be542b9f
fix: ensure auth redirects throw an error ( #561 )
...
* fix: ensure auth redirects throw an error
* fix: add line removed by linter
2024-06-06 14:43:44 -04:00
b0b2e26952
feat: hatchet-lite ( #560 )
...
* feat: hatchet-lite mvp
* fix: init shadow db
* fix: install atlas
* fix: correct env
* fix: wait for db ready
* fix: remove name flag
* fix: add hatchet-lite to build
2024-06-06 14:03:53 -04:00
8b1417b1d8
feat: worker semaphore v2 ( #540 )
...
* wip: semaphore slot table
* wip: acquire and release semaphore
* Fix deadlock/pool exhaustion
* fix: update skip locked cte
* feat: release resolver
* wip: migration
* chore: migrate running steps to semaphore
* feat: add next alert column
* feat: add notification templates
* feat: add poll token ticker
* fix: expiring 7 days
* fix: no expired tokens
* fix: subject string
* fix: message string
* fix: slack format
* feat: add config columns
* feat: expose api
* feat: update alerter opts
* feat: update ui
* chore: ui tweaks
* fix: ui tweaks
* fix: migration with loop
* chore: generate
* chore: remove unused fn
* feat: add worker id index on slot
* chore: rm unused fn
* fix: typo
* feat: optimized query
* chore: generate all
* chore: collapse migration
---------
Co-authored-by: Alexander Belanger <alexander@hatchet.run >
2024-06-04 07:56:29 -07:00
207f1bbb08
feat: default email alert group ( #547 )
...
* feat: add next alert column
* feat: add notification templates
* feat: add poll token ticker
* fix: expiring 7 days
* fix: no expired tokens
* fix: subject string
* fix: message string
* fix: slack format
* feat: add config columns
* feat: expose api
* feat: update alerter opts
* feat: update ui
* chore: ui tweaks
* fix: ui tweaks
* Update internal/repository/tenant_alerting.go
Co-authored-by: abelanger5 <belanger@sas.upenn.edu >
* chore: comment
* fix: split emails
* fix: commit context
---------
Co-authored-by: abelanger5 <belanger@sas.upenn.edu >
2024-06-03 12:30:46 -04:00
e94d60538c
fix: old Listen endpoint not setting worker to active ( #534 )
...
* fix: remove active checks from sdk
* fix: add back isActive check
2024-05-28 11:37:47 -04:00
b067744149
feat: delete tenant member ui ( #518 )
...
* feat: delete user ui
* fix: review feedback
* chore: generic confirm
* chore: generate
2024-05-23 06:43:11 -07:00
1b607713e3
fix: worker active bug ( #517 )
...
* fix: only update most recent session
* feat: listener connect visibility
* fix: lint warning
2024-05-21 18:38:57 -04:00
0dd38e45f4
feat: make step run replays more intuitive ( #507 )
...
* feat: make step run replays more intuitive
* fix: npmrc file for vercel pnpm version diff
* fix: address changes from PR review
2024-05-17 17:32:15 -04:00
e6617e1381
feat: refresh timeout ( #495 )
...
* feat: show timeout on step run
* feat: refresh timeout
* fix: increment timeout from last time
* feat: add step run event for timeout refresh
* chore: generate
* feat: add refreshing timeouts docs section
* chore: linting
* feat: go client
* chore: generate
* chore: generate
* fix: test context
* chore: generate
* fix: rm txn
* fix: validator
* chore: lint
---------
Co-authored-by: Alexander Belanger <alexander@hatchet.run >
2024-05-16 12:23:36 -04:00
a37ee57cc1
feat: workflow run cancel ( #489 )
...
* feat: workflow run cancel endpoint
* feat: cancel all running button
* feat: select and cancel runs
* chore: error handling
* fix: remove ani
* fix: error toast
* chore: gen
* fix: feedback
* fix: redundant method
* Update frontend/app/src/pages/main/workflow-runs/$run/index.tsx
Co-authored-by: abelanger5 <belanger@sas.upenn.edu >
* fix: response obj
* fix: cancel by job run
* fix: lint
* chore: generate
---------
Co-authored-by: abelanger5 <belanger@sas.upenn.edu >
Co-authored-by: Alexander Belanger <alexander@hatchet.run >
2024-05-14 17:47:30 -04:00
b728616161
feat: improve reassign and timeout behavior and visibility ( #484 )
...
* feat: create step run event
* fix: shorten reassign heartbeat
* feat: add reassign event
* feat: fail timeout instead of cancel
* chore: squash migration
* chore: clarify copy
* docs: improve timeouts doc
* chore: linting
* chore: generate
* fix: test
* fix: send cancellation signal on timeout failure
* fix: rm retry check
* chore: update migration for release
---------
Co-authored-by: Alexander Belanger <belanger@sas.upenn.edu >
2024-05-14 16:47:00 -04:00
48d06b931a
feat: client releasable slots ( #476 )
...
* feat: add release slot proto
* feat: add semaphore release state and methods
* feat: go sdk and example
* docs: manual slot release
* chore: linting
* fix: broken test
* fix: unlink step run on manual release
* feat: release slot event
* fix: test
* fix: revert e2e test changes
* chore: remove debug line
* fix: place step run query in same tx
* fix: change migration release version
---------
Co-authored-by: Alexander Belanger <belanger@sas.upenn.edu >
2024-05-14 15:22:46 -04:00
8b392e30ea
feat: workflow configuration view ( #491 )
...
* feat: add cron and schedule timeout to config
* feat: interpreted cron
---------
Co-authored-by: abelanger5 <belanger@sas.upenn.edu >
2024-05-13 18:05:04 -04:00
1a8f1d8cab
feat: events view for step runs ( #479 )
...
* feat: events view for step runs
* chore: regen migration
* chore: address pr review changes
2024-05-09 18:25:23 -04:00
7e70ddee93
fix: handle last alerted null case + some logging/cleanup improvements ( #468 )
2024-05-08 19:36:13 -04:00
b50ed62924
feat: alerting from slack and email ( #461 )
...
* feat: alerting. implements slack alerting, email, and refactors tenant settings to make them more manageable
* chore: generate
* chore: generate sqlc after migrate
2024-05-08 10:04:58 -04:00
67b7dc522c
fix: report slot count from semaphore ( #459 )
2024-05-07 15:36:11 -07:00
fa07400159
feat: event and workflow run metadata ( #446 )
...
Adds additional user-defined metadata to events and workflow runs.
2024-05-06 17:10:33 -04:00
2b910a89de
feat: improved optional product analytics ( #452 )
...
* feat: add fe posthog config
* feat: add fe posthog to metadata endpoint
* feat: dynamically load ph on fe
* feat: add analyticsOptOut to tenant db
* feat: respect opt out
* feat: update tenant settings
* feat: mask all text
2024-05-05 18:14:27 -04:00
f71f17f5f7
fix: semaphores increasing on manual replays ( #441 )
...
* fix: semaphores increasing on manual replays
* chore: remove metrics queries
2024-05-01 14:05:39 -04:00
abelanger5