Commit Graph

308 Commits

Author SHA1 Message Date
Mohammed Nafees
5f7b149b5b Add guide for downgrading versions (#2588)
* add downgrading guide and migrate cmd

* cleanup
2025-12-08 12:18:01 +01:00
Andrei Gaspar
64488d2318 fix: Skip relative URLs when checking cross domain links (#2608) 2025-12-05 14:16:56 -05:00
abelanger5
d071a1c36b fix: prevent large worker gRPC stream backlogs (#2597)
* fix: prevent large worker backlogs

* add config value

* add doc for troubleshooting
2025-12-03 17:15:43 -05:00
Andrei Gaspar
36afeece02 Cross-Domain Tracking and Analytics Refactoring (#2587)
* feat: Implement cross-domain tracking (docs -> app)

* fix: Eslint config path issue

* feat: Implement posthog provider

* Revert "fix: Eslint config path issue"

This reverts commit 2baf56819a.

* feat: Implement wildcard support in analytics cross domain targets
2025-12-02 11:52:15 -05:00
Andrei Gaspar
00fda4c377 Setup PostHog and Integrate with Cookie Banner Component (#2557)
* feat: Setup posthog and integrate with cookie banner component

* refactor: Improved error handling
2025-11-28 15:22:35 -05:00
matt
a3a608bf54 Fix: Doc Linters (#2577)
* fix: prettier path

* chore: lint
2025-11-28 11:52:39 -05:00
matt
f14e999a76 Fix: TS & Py versions for log pagination (#2505)
* chore: gen ts

* chore: python

* fix: change default

* chore: regen docs
2025-11-08 10:46:44 +01:00
Mohammed Nafees
17dc738ae3 update setup for new Go SDK (#2500) 2025-11-06 21:17:14 +01:00
matt
7fe9806f5d Feat: Configurable OLAP status update size limits (#2499)
* feat: configurable status updates

* fix: config

* fix: wiring

* feat: export limits from olap

* fix: param drilling
2025-11-06 13:37:40 -05:00
matt
25776624ea Docs: Dataclasses (#2488)
* feat: dataclass docs

* fix: add min version
2025-11-06 16:04:39 +01:00
StefanBRas
2cebade995 Add SERVER_OTEL_COLLECTOR_AUTH to selfhosting docs (#2497) 2025-11-06 15:48:55 +01:00
Sebastian Graz
32823244c9 Docs: Brand alignment (#2485)
* Add local docs prettier rc

* prettier config

* Add logo + proper color setup

* rm svg ratio

* py version

* Add fonts + fix nextra theming tasks, borders, codeblocks

* push pnpm-lock

* remove nextra.css

* fix: docs cmd

* favicon

---------

Co-authored-by: mrkaye97 <mrkaye97@gmail.com>
2025-11-05 20:14:25 +01:00
Sid Premkumar
94a1fb4523 Update contributing.md file to reflect recent updates (#2444)
* Update contributing.md file to reflect recent updates

* PR feedback
2025-10-28 10:19:49 -04:00
Mohammed Nafees
cf5c5989ff add vars to tune concurrency poller (#2428) 2025-10-23 11:36:12 -04:00
matt
c6e154fd03 Feat: OLAP Payloads (#2410)
* feat: olap payloads table

* feat: olap queue messages for payload puts

* feat: wire up writes on task write

* driveby: add + ignore psql-connect

* fix: down migration

* fix: use external id for pk

* fix: insert query

* fix: more external ids

* fix: bit more cleanup

* feat: dags

* fix: the rest of the refs

* fix: placeholder uuid

* fix: write external ids

* feat: wire up messages over the queue

* fix: panic

* Revert "fix: panic"

This reverts commit c0adccf2ea.

* Revert "feat: wire up messages over the queue"

This reverts commit 36f425f3c1.

* fix: rm unused method

* fix: rm more

* fix: rm cruft

* feat: wire up failures

* feat: start wiring up completed events

* fix: more wiring

* fix: finish wiring up completed event payloads

* fix: lint

* feat: start wiring up external ids in the core

* feat: olap pub

* fix: add returning

* fix: wiring

* debug: log lines for pubs

* fix: external id writes

* Revert "debug: log lines for pubs"

This reverts commit fe430840bd.

* fix: rm sample

* debug: rm pub buffer param

* Revert "debug: rm pub buffer param"

This reverts commit b42a5cacbb.

* debug: stuck queries

* debug: more logs

* debug: yet more logs

* fix: rename BulkRetrieve -> Retrieve

* chore: lint

* fix: naming

* fix: conn leak in putpayloads

* fix: revert debug

* Revert "debug: more logs"

This reverts commit 95da7de64f.

* Revert "debug: stuck queries"

This reverts commit 8fda64adc4.

* feat: improve getters, olap getter

* fix: key type

* feat: first pass at pulling olap payloads from the payload store

* fix: start fixing bugs

* fix: start reworking `includePayloads` param

* fix: include payloads wiring

* feat: analyze for payloads

* fix: simplify writes more + write event payloads

* feat: read out event payloads

* feat: env vars for dual writes

* refactor: clean up task prop drilling a bit

* feat: add include payloads params to python for tests

* fix: tx commit

* fix: dual writes

* fix: not null constraint

* fix: one more

* debug: logging

* fix: more debugging, tweak function sig

* fix: function sig

* fix: refs

* debug: more logging

* debug: more logging

* debug: fix condition

* debug: overwrite properly

* fix: revert debug

* fix: rm more drilling

* fix: comments

* fix: partitioning jobs

* chore: ver

* fix: bug, docs

* hack: dummy id and inserted at for payload offloads

* fix: bug

* fix: no need to handle offloads for task event data

* hack: jitter + current ts

* fix: short circuit

* fix: offload payloads in a tx

* fix: uncomment sampling

* fix: don't offload if external store is disabled

* chore: gen sqlc

* fix: migration

* fix: start reworking types

* fix: couple more

* fix: rm unused code

* fix: drill includePayloads down again

* fix: silence annoying error in some cases

* fix: always store payloads

* debug: use workflow run id for input

* fix: improve logging

* debug: logging on retrieve

* debug: task input

* fix: use correct field

* debug: write even null payloads to limit errors

* debug: hide error lines

* fix: quieting more errors

* fix: duplicate example names, remove print lines

* debug: add logging for olap event writes

* hack: immediate event offloads and cutovers

* fix: rm log line

* fix: import

* fix: short circuit events

* fix: duped names
2025-10-20 09:09:49 -04:00
abelanger5
4e729ad9d4 fix: self-hosting doc (#2423) 2025-10-15 17:52:28 -04:00
matt
5b5adcb8ed Feat: Scheduled run detail view, bulk cancel / replay with pagination helper (#2416)
* feat: endpoint for listing external ids

* feat: wire up external id list

* chore: regen api

* feat: py sdk wrapper

* fix: since type

* fix: log

* fix: improve defaults for statuses

* feat: docs

* feat: docs

* fix: rm extra file

* feat: add id column to scheduled runs

* feat: side panel for scheduled runs

* fix: side panel header pinned

* fix: border + padding

* chore: gen

* chore: lint

* chore: changelog, version

* fix: spacing of cols

* fix: empty webhook resource limit

* fix: tsc

* fix: sort organizations and tenants alphabetically
2025-10-15 11:36:45 -04:00
Mohammed Nafees
ddfea53d88 Fix type for hatchet.WithRunMetadata (#2406)
* fix type for hatchet.WithRunMetadata

* edit documentation
2025-10-13 14:26:18 +02:00
Mohammed Nafees
a750ce950d Introduce vars to tune ANALYZE job gocron run intervals (#2407)
* introduce cars to tune ANALYZE job gocron run intervals

* update config doc

* fix assignment
2025-10-10 11:02:10 +02:00
matt
20b465c068 [Docs]: Improve triggering from external services section, fix dependabot vuln (#2393)
* fix: override prismjs version

* fix: confusing inter-service triggering page

* fix: grammar
2025-10-07 11:58:44 -04:00
Mohammed Nafees
cb91f7033d Serve management API swagger docs (#2333)
* serve management API swagger docs

* fix lint
2025-10-02 14:42:26 +02:00
matt
046e47c135 fix: rm event line (#2338) 2025-09-24 17:17:21 -04:00
Mohammed Nafees
cf21550502 Update docs to use Go SDK v1 (#2313)
* SDK fixes

* go docs generate

* simple changes

* more docs changes

* bulk docs done

* cancellation example

* concurrency example

* conditional example

* cron example

* dag example

* durable event example

* durable sleep example

* on failure example

* priority example

* rate limit example

* retries example

* run-no-wait example

* on event example

* run with results example

* running your task example

* scheduled runs example

* streaming example

* workers example

* timeouts example

* sticky example

* docker go

* fix lint and build

* update migration doc

* fix lint

* fix some docs

* fix docker mdx

* remove local lint

* go stub example

* make changes

* child spawning

* migration code examples

* fix child workflow example
2025-09-23 19:19:27 +02:00
Mohammed Nafees
b521521985 Bump pnpm version to 10.16.1 to support minimumReleaseAge (#2308)
* bump pnpm version to support minimumReleaseAge

* use pnpm only in TS SDK scripts
2025-09-17 19:04:59 +02:00
Mohammed Nafees
6bd7d0ec4a set pnpm minimumReleaseAge to 1 day (#2306) 2025-09-17 14:50:38 +02:00
Mohammed Nafees
da6c23ede4 Allow RabbitMQ to be used with Hatchet Lite (#2128)
* allow rabbitmq to be used with lite

* fix docker image

* fix env vars

* WIP

* fix mq kind selection

* lite specific env vars

* failure check

* changes to logic

* fix failing tests

* fix e2e test
2025-09-16 22:34:53 +02:00
Ymir
b8ad5ee94c Added mention of shm_size in docker compose deployment docs. (#2141)
* Update docker-compose.mdx

* chore: lint

---------

Co-authored-by: mrkaye97 <mrkaye97@gmail.com>
2025-09-12 13:16:11 -04:00
Gabe Ruttner
49772f76fd Blog: automated docs (#2226)
* blog automated docs

* example

* Update frontend/docs/pages/blog/automated-documentation.mdx

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* fix

* lint

* fix: rm index

* fix: simplify examples, edit

* fix: use snippet

* fix: spacing

* chore: lint

* Revert "chore: lint"

This reverts commit ae724954bd.

* Revert "fix: spacing"

This reverts commit 2619122516.

* Revert "fix: use snippet"

This reverts commit 4212239fd0.

* fix: use snippet

---------

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: mrkaye97 <mrkaye97@gmail.com>
2025-09-11 12:49:09 -04:00
KonradAdamczyk
a7e20faa17 Update docker-compose.mdx (#1262)
* Update docker-compose.mdx

Change host.docker.internal to hatchet-engine. Suggest adding depends_on to worker. 
host.docker.internal is not production ready. Without depends_on worker will fail randomly depending of starting order.

* chore: lint

* fix: awkward indentation

* fix: pt ii

---------

Co-authored-by: mrkaye97 <mrkaye97@gmail.com>
2025-09-11 11:57:18 -04:00
matt
7538cf4378 fix: credentialless (#2283) 2025-09-10 15:00:30 -04:00
matt
ae1c9cde7b Docs: Fix allowed origin (#2282)
* fix: origin

* fix: use regex to test

* fix: regex

* fix: allow all origins

* fix: rm origin
2025-09-10 10:43:03 -07:00
matt
e5e5d81a33 [FE]: Docs-in-app, Part I (#2183)
* feat: initial commit bringing back side panel

* feat: extend generation to generate docs index in app

* refactor: minor gen cleanup

* feat: side panel first pass

* fix: dragging behavior

* fix: overflow

* fix: replace more uses of `<Sheet`

* fix: slide out animation, back and forward buttons

* fix: drag lag

* feat: docs button, fix header

* fix: lag on drag in iframe

* fix: generation of paths

* feat: first doc button!

* fix: lint

* fix: start fixing builds

* fix: apk

* fix: fe dockerfile

* chore: lint

* fix: gen snips in ci

* fix: copy the python stuff more places

* feat: first empty state

* fix: provider

* fix: reset history on close

* feat: event side panel

* feat: improve styling

* fix: overflow state

* fix: rm selected event, useEffect

* fix: lint

* fix: spacing

* fix: scrollbar for toolbar filters on overflow

* feat: improve scrollbar styling

* fix: scroll metric badges on overflow

* fix: copy improvements

* chore: lint

* fix: sidebar toggle

* fix: empty states, docs button

* fix: docs button variant / size

* feat: theme from param
2025-09-09 17:22:18 -04:00
matt
93454d6e75 Fix: More doc snippets (#2267)
* fix: batch i

* fix: batch ii

* fix: batch iii

* fix: batch iv

* fix: batch v

* fix: guide

* fix: batch vi

* fix: batch vii

* fix: dag docs

* fix: separate dag tasks
2025-09-09 15:37:20 -04:00
matt
cf59a7bcd9 Feat: Worker slot Prom metrics (#2195)
* feat: add slots to prom metrics

* feat: available

* fix: extension instead

* fix: docs

* fix: rm unused query changes

* fix: rm unused struct

* fix: labels

* feat: improve total slots

* fix: pr feedback

* fix: docs

* Revert "fix: docs"

This reverts commit 7fe105da92.

* fix: derive total slots
2025-09-08 14:07:44 -04:00
matt
4a50e454a6 Fix: Python docs examples (#2255)
* feat: client example

* fix: batch i

* fix: batch ii

* fix: batch iii

* fix: batch iv
2025-09-05 15:08:23 -04:00
matt
cf0aa21623 [Python]: Enable force kill on sigterm for hot reloading, stub workflow + task (#2197)
* feat: exit forcefully

* fix: handler, ver

* chore: lint

* feat: stubs client

* fix: more overloads

* chore: version

* chore: changelog

* feat: example of stubs

* feat: comment

* fix: add dedenting

* fix: snippet for running external tasks
2025-08-26 15:22:46 -04:00
Gabe Ruttner
2427e48fa6 docs: introduction sections and nits (#2200)
* new pages

* invoke

* py

* lint

* revert

* lint again...

* Update frontend/docs/pages/home/architecture.mdx

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* Update frontend/docs/pages/home/guarantees-and-tradeoffs.mdx

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* Update frontend/docs/pages/home/guarantees-and-tradeoffs.mdx

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* docs: small improvements (#2205)

* docs: small improvements

* quick fix

* matts comments

* ts snip

* lint

---------

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: abelanger5 <belanger@sas.upenn.edu>
2025-08-26 11:51:50 -07:00
Anders Bredgaard Thuesen
80c4a0e3e7 Update docker-compose.mdx (#2169)
Use internal port 7070 for `hatchet-engine`
2025-08-21 15:07:27 -04:00
Gabe Ruttner
92f97dc81c chore(docs): update mermaid dependency (#2164)
* update

* fix: build
2025-08-20 06:22:48 -07:00
matt
f8e5f357d9 Fix: More examples / snippets fixes + rework (#2150)
* feat: start reworking snippets

* feat: start cleaning up gen script

* fix: start updating refs everywhere

* feat: start fixing broken snippet links

* fix: more snippets

* fix: more updates

* chore: lint

* fix: taskfile

* fix: script

* fix: escaping issue + mergent blog

* fix: bunch more

* chore: lint

* fix: implement more of them

* fix: retry

* fix: the rest

* chore: lint

* fix: highlight

* fix: ugh

* fix: start removing dead code from old snippet method

* fix: rest of the refs

* fix: remove all of the rest of the <GithubSnippet uses

* fix: couple more

* fix: last few errors

* fix: handle example writes

* fix: delete to test update

* fix: CI, attempt 1

* feat: helpful error on no snippet

* fix: lint

* chore: rm unused js file

* feat: improve GHA

* debug: run action on branch

* fix: rm pnpm

* fix: try to leave comment instead

* fix: don't run on branch

* fix: factor out GH info

* fix: include code path

* fix: ts
2025-08-17 10:22:16 -05:00
matt
57bb24aef1 Fix: Auto-generate docs snippets and examples (#2139)
* fix: gitignore all the generated stuff

* debug: try fixing build

* debug: build error part ii

* debug: move more deps out of dev

* fix: lock

* debug: lockfile

* fix: make dir

* fix: ci

* fix: dir

* debug: sed

* fix: sed

* debug: allow skipping

* Revert "debug: allow skipping"

This reverts commit 88e0ff870d.

* debug: ci

* fix: corepack

* debug: dir

* debug: sed

* debug: path

* fix: rm sync docs for now

* fix: remove more stuff

* fix: rm unused stuff

* fix: rm copy:app

* chore: lint

* fix: rm prettier from boot

* fix: couple missing scripts

* feat: auto-gen examples on push to main

* debug: test on this branch

* fix: install pnpm

* fix: cd

* fix: cmd

* Auto-generate files after merge [skip ci]

* fix: only copy examples

* debug: dummy commit for examples check

* chore: regenerate examples

* fix: naming

* fix: unwind dummy

* fix: only run on main

* fix: pre commit

* fix: naming

* chore: gen, fix task pre

* feat: create pr

* feat: only push examples changes

* fix: don't run from this branch

* fix: regen lockfile

* fix: regen docs lockfile

---------

Co-authored-by: GitHub Action <action@github.com>
2025-08-14 18:17:29 -05:00
Gabe Ruttner
3650b09577 docs: missing quotes (#2136) 2025-08-14 12:22:51 -07:00
matt
36924936fa Feat: Webhook fixes / improvements (#2131)
* feat: webhook update

* feat: add headers to cel env

* fix: header casing

* feat: wire up edits

* fix: updates

* fix: finish wiring up updates

* fix: handle save on enter

* fix: lint

* feat: add slack and discord

* feat: initial slack setup

* fix: get slack working

* fix: rm discord for now

* fix: lint

* chore: gen

* fix: explicit save button

* feat: add link to CEL docs

* feat: add callout for reaching out to support

* feat: docs

* refactor: challenge

* fix: naming

* fix: return

* fix: resp codes

* fix: webhooks beta flag

* fix: rm discord

* fix: docs
2025-08-14 10:46:57 -05:00
matt
815a94e25c chore: regen snippets (#2122) 2025-08-12 11:29:45 -04:00
matt
c8d5144ed4 [Python] Feat: Dependency Injection, Improved error handling (#2067)
* feat: first pass at dependency injection

* feat: add DI example + tests

* feat: finish up tests

* feat: docs

* chore: gen

* chore: lint

* chore: changelog + ver

* fix: split up paragraphs

* refactor: improve impl

* chore: gen

* feat: inject input + ctx into deps

* chore: gen

* [Python] Feat: More use of `logger.exception` (#2069)

* feat: add more instances of `logger.exception`

* chore: ver

* chore: changelog

* fix: one more error log

* chore: gen

* chore: gen

* chore: lint

* fix: improve shutdown

* chore: changelog

* unwind: exit handler

* feat: task run error

* feat: improve error serde with more context

* chore: changelog

* fix: changelog

* chore: gen

* fix: rm celpy + lark dep, casing issues

* chore: changelog

* fix: respect log levels over the API

* fix: changelog

* refactor: rename log forwarder

* fix: circular import
2025-08-11 23:10:44 -04:00
matt
4d654f34ec Debug: Fail task tracing (#2101)
* feat: add some span attributes to see how big the batches are

* fix: span naming

* fix: naming

* fix: issues + lint
2025-08-07 12:05:28 -04:00
Sam Wolk
15576254ab Add wsl note for python (#2093)
* add wsl note for python

* lint
2025-08-06 16:30:46 -04:00
matt
9ad051cd8f fix: doc location (#2082) 2025-08-04 19:42:54 -04:00
matt
d6f8be2c0f Feat: OLAP Table for CEL Eval Failures (#2012)
* feat: add table, wire up partitioning

* feat: wire failures into the OLAP db from rabbit

* feat: bubble failures up to controller

* fix: naming

* fix: hack around enum type

* fix: typo

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* fix: typos

* fix: migration name

* feat: log debug failure

* feat: pub message from debug endpoint to log failure

* fix: error handling

* fix: use ingestor

* fix: olap suffix

* fix: pass source through

* fix: dont log ingest failure

* fix: rm debug as enum opt

* chore: gen

* Feat: Webhooks (#1978)

* feat: migration + go gen

* feat: non unique source name

* feat: api types

* fix: rm cruft

* feat: initial api for webhooks

* feat: handle encryption of incoming keys

* fix: nil pointer errors

* fix: import

* feat: add endpoint for incoming webhooks

* fix: naming

* feat: start wiring up basic auth

* feat: wire up cel event parsing

* feat: implement authentication

* fix: hack for plain text content

* feat: add source to enum

* feat: add source name enum

* feat: db source name enum fix

* fix: use source name enums

* feat: nest sources

* feat: first pass at stripe

* fix: clean up source name passing

* fix: use unique name for webhook

* feat: populator test

* fix: null values

* fix: ordering

* fix: rm unnecessary index

* fix: validation

* feat: validation on create

* fix: lint

* fix: naming

* feat: wire triggering webhook name through to events table

* feat: cleanup + python gen + e2e test for basic auth

* feat: query to insert webhook validation errors

* refactor: auth handler

* fix: naming

* refactor: validation errors, part II

* feat: wire up writes through olap

* fix: linting, fallthrough case

* fix: validation

* feat: tests for failure cases for basic auth

* feat: expand tests

* fix: correctly return 404 out of task getter

* chore: generated stuff

* fix: rm cruft

* fix: longer sleep

* debug: print name + events to logs

* feat: limit to N

* feat: add limit env var

* debug: ci test

* fix: apply namespaces to keys

* fix: namespacing, part ii

* fix: sdk config

* fix: handle prefixing

* feat: handle partitioning logic

* chore: gen

* feat: add webhook limit

* feat: wire up limits

* fix: gen

* fix: reverse order of generic fallthrough

* fix: comment for potential unexpected behavior

* fix: add check constraints, improve error handling

* chore: gen

* chore: gen

* fix: improve naming

* feat: scaffold webhooks page

* feat: sidebar

* feat: first pass at page

* feat: improve feedback on UI

* feat: initial work on create modal

* feat: change default to basic

* fix: openapi spec discriminated union

* fix: go side

* feat: start wiring up placeholders for stripe and github

* feat: pre-populated fields for Stripe + Github

* feat: add name section

* feat: copy improvements, show URL

* feat: UI cleanup

* fix: check if tenant populator errors

* feat: add comments

* chore: gen again

* fix: default name

* fix: styling

* fix: improve stripe header processing

* feat: docs, part 1

* fix: lint

* fix: migration order

* feat: implement rate limit per-webhook

* feat: comment

* feat: clean up docs

* chore: gen

* fix: migration versions

* fix: olap naming

* fix: partitions

* chore: gen

* feat: store webhook cel eval failures properly

* fix: pk order

* fix: auth tweaks, move fetches out of populator

* fix: pgtype.Text instead of string pointer

* chore: gen

---------

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
2025-07-30 13:27:38 -04:00
Mohammed Nafees
78be038e1d update self hosting configuration options (#2039) 2025-07-24 13:15:42 +02:00