182 Commits

Author	SHA1	Message	Date
Dillon DuPont	6ec083e28a	Removed reasoning pass	2025-08-28 19:21:04 -04:00
Dillon DuPont	efc2c3e54c	Fixed KeyError	2025-08-28 18:24:20 -04:00
Dillon DuPont	ddd01ee719	Improved image retention callback	2025-08-28 18:18:40 -04:00
Dillon DuPont	e61fbeda5e	Made labels more descriptive	2025-08-28 17:36:56 -04:00
Dillon DuPont	2cf6290c47	Made UI more compact	2025-08-28 17:26:09 -04:00
Dillon DuPont	e2fac486ee	Renamed Response to Message	2025-08-28 17:19:36 -04:00
Dillon DuPont	022f999259	Simplified UI	2025-08-28 17:12:26 -04:00
Dillon DuPont	2ba67d399d	Added wait action	2025-08-28 17:09:35 -04:00
Dillon DuPont	038ad4df10	Force default model for human-in-the-loop	2025-08-28 16:55:28 -04:00
Dillon DuPont	2216043305	Fixed bug in init	2025-08-28 16:50:38 -04:00
Dillon DuPont	b7cbac31a0	Added grounding model fallback	2025-08-28 16:39:43 -04:00
Dillon DuPont	e90997c4ff	Added screenshot_dir and lazy loading of MLX	2025-08-28 13:18:17 -04:00
ddupont	311bbf9709	Merge pull request #371 from trycua/chore/hud-upgrade ... [Agent] Upgrade HUD SDK to 0.4.12	2025-08-28 11:29:18 -04:00
Dillon DuPont	5fafe861ef	added implicit scroll action	2025-08-27 22:59:26 -04:00
Dillon DuPont	4c678f0f4e	normalize { 'click': 'left', ... } hallucination	2025-08-27 22:19:37 -04:00
Dillon DuPont	e8210389a5	added kwarg filter	2025-08-27 21:39:44 -04:00
Dillon DuPont	063bf223d1	added kwarg filter	2025-08-27 21:35:18 -04:00
Dillon DuPont	c003d7ec7b	added more normalizer cases	2025-08-27 21:27:58 -04:00
Dillon DuPont	15301935c0	renamed agent.py to proxy	2025-08-27 21:18:06 -04:00
Dillon DuPont	95cefc50f0	added extended kwargs, renamed callback to normalizer	2025-08-27 20:49:31 -04:00
Dillon DuPont	799d9d3ba7	Normalize common LLM output errors	2025-08-27 19:53:26 -04:00
Dillon DuPont	e261282182	Normalize common LLM output errors	2025-08-27 18:20:13 -04:00
Dillon DuPont	8dee77bf68	updated docs	2025-08-27 17:44:04 -04:00
Dillon DuPont	38026a43f0	improved other grounding prompts	2025-08-27 17:30:13 -04:00
Dillon DuPont	3c1efc8632	improved openai's predict_click prompt	2025-08-27 17:29:29 -04:00
Dillon DuPont	24b2986585	Made button required	2025-08-27 17:10:56 -04:00
Dillon DuPont	0d3f8ea3ff	Improved trajectory saving	2025-08-27 16:48:57 -04:00
Dillon DuPont	f14e9288ac	Broken indent	2025-08-27 16:14:53 -04:00
Dillon DuPont	8de5d3d3a7	Moved try/catch block	2025-08-27 16:10:38 -04:00
Dillon DuPont	fad149d6b9	Simplified composed grounded prompt	2025-08-27 16:09:33 -04:00
Dillon DuPont	1634abe3d0	Added validation level retry logic	2025-08-27 16:06:25 -04:00
Dillon DuPont	a34d541b92	fixed crash with composed loop	2025-08-27 15:16:52 -04:00
Dillon DuPont	e8eaf66e2a	Added latest nb	2025-08-27 13:38:55 -04:00
Dillon DuPont	61a442da56	fixed getattr crash	2025-08-27 13:21:46 -04:00
Dillon DuPont	bf3c3256df	increased max tokens, added trust_remote_code kwarg	2025-08-26 18:15:24 -04:00
Dillon DuPont	52afcd4c6f	Increased max tokens for glm 4.5v grounding calls	2025-08-26 18:14:22 -04:00
Dillon DuPont	eeb2be9b96	Fixed incorrect special token	2025-08-22 13:16:16 -04:00
Dillon DuPont	f72a03be97	Restored MLX/ adapter	2025-08-22 13:00:04 -04:00
Dillon DuPont	b20d2a0a93	Pinned transformers version, first working grounding version	2025-08-21 11:54:13 -04:00
Dillon DuPont	dad6634ffd	Added local inference routing for different models	2025-08-21 10:51:39 -04:00
Dillon DuPont	d7e25048be	Register OpenCUA loop	2025-08-20 10:21:53 -04:00
Dillon DuPont	e065ae59d2	Add OpenCUA Grounding mode	2025-08-20 10:03:41 -04:00
Dillon DuPont	5225de8d88	Added errors for unknown actions	2025-08-19 16:20:19 -04:00
Dillon DuPont	07346d566d	Improved error message	2025-08-19 15:53:59 -04:00
Dillon DuPont	c9e3af8f17	Implemented computer call and tool call errors	2025-08-19 12:41:37 -04:00
Dillon DuPont	6f5b7363f1	Added ToolError and IllegalArgumentError	2025-08-19 12:27:09 -04:00
ddupont	70e863ecc0	Merge pull request #352 from jamesmurdza/fix/readme-images ... Fix images and links in READMEs	2025-08-19 12:07:22 -04:00
James Murdza	9a4c7215d8	Upgrade Claude 3.5 snapshot to a version with computer use support	2025-08-19 11:40:05 -04:00
James Murdza	52b6f1e758	Remove redundant external calls to flush	2025-08-19 06:52:51 -04:00
James Murdza	b62be1bde1	Use absolute paths to fix PyPi project pages	2025-08-18 16:37:20 -04:00