95 Commits

Author	SHA1	Message	Date
Dillon DuPont	c2011f9582	Fixed broken import	2025-08-08 19:06:58 -04:00
Dillon DuPont	30684e0e43	changed default env	2025-08-08 19:04:05 -04:00
Dillon DuPont	b23cac9e8b	improved trajectory saving with run_job	2025-08-08 19:01:08 -04:00
Dillon DuPont	6d42c5d939	ensure screenshot / output call exists	2025-08-08 18:50:12 -04:00
Dillon DuPont	fa88836132	fixed missing screenshots in agent	2025-08-08 18:45:53 -04:00
Dillon DuPont	ae128a2ae4	added run_job's kwargs	2025-08-08 18:21:48 -04:00
Dillon DuPont	8f15c21df9	added run_job	2025-08-08 18:15:56 -04:00
Dillon DuPont	1882fb68e5	Added HUD integration	2025-08-08 12:47:07 -04:00
Dillon DuPont	f78d026060	renamed ComputerHandler to AsyncComputerHandler	2025-08-08 11:09:44 -04:00
Dillon DuPont	feec92a1d6	added support for sync methods	2025-08-08 11:06:43 -04:00
Dillon DuPont	73cd489ac3	Added dict-based custom computers	2025-08-08 10:53:26 -04:00
Dillon DuPont	d47ef3f1b6	Added protocol for custom computer handlers	2025-08-08 10:22:10 -04:00
Dillon DuPont	4b0b07240c	Made coordinates optional for left_mouse_up/down	2025-08-07 16:47:34 -04:00
Dillon DuPont	1b406b197a	Updated anthropic loop to include function_call and function_call_output, along with passing tool exceptions to the agent	2025-08-07 16:39:40 -04:00
Dillon DuPont	0056ae44f5	Disabled pyautogui FAILSAFE	2025-08-06 14:47:29 -04:00
Dillon DuPont	8e249174cd	Moved hotkey splitting into keypress handler	2025-08-06 10:53:51 -04:00
Dillon DuPont	3631caa883	Changed keypress to cast strings to lists	2025-08-06 10:27:59 -04:00
Dillon DuPont	74a25f2003	fixed docstring	2025-08-05 12:54:23 -04:00
Dillon DuPont	0063eccb79	Merge branch 'main' into feat/extra-models	2025-08-05 12:46:26 -04:00
Dillon DuPont	8eb662bf4d	added base models to benchmark	2025-08-05 12:45:00 -04:00
Dillon DuPont	3cc36905ff	added missing abstract mthd	2025-08-05 12:36:22 -04:00
Dillon DuPont	e1e6a7d6a7	Added anthropic click mode	2025-08-05 12:32:42 -04:00
Dillon DuPont	dc0e479170	changed comment	2025-08-05 11:25:29 -04:00
Dillon DuPont	5e7b1e46b0	fixed resolution & OS	2025-08-05 11:23:08 -04:00
Dillon DuPont	01371ed6cf	bump version, add localhost to ui	2025-08-05 10:55:06 -04:00
Dillon DuPont	96e4b7586a	update mcp server to cua-agent==0.4.x	2025-08-05 10:51:21 -04:00
Dillon DuPont	3e7bc0aa79	Add omniparser predict_click	2025-08-04 18:11:21 -04:00
Dillon DuPont	f87b8eaea5	added grounding+planning composed loop	2025-08-04 16:32:05 -04:00
cgutierr	77922c92fc	Dummy (small) models can produce action_types=None, which will later produce a crash, avoid it	2025-08-03 13:04:29 +02:00
cgutierr	9781810451	Move inputs to model's same device, previously hardcoded to CUDA	2025-08-03 13:02:15 +02:00
cgutierr	5b5f17af8e	Use generic AutoModel not tied to specific arch	2025-08-03 13:00:27 +02:00
Dillon DuPont	d5564977f0	working gta1 loop	2025-08-01 15:49:19 -04:00
ddupont	5bfadf8f9a	Update pii_anonymization.py	2025-08-01 11:46:32 -04:00
Morgan Dean	32a8e504d4	Merge branch 'main' into feat/docs/init	2025-07-31 18:04:02 +01:00
Dillon DuPont	5902be2917	updated docs	2025-07-30 16:19:37 -04:00
Dillon DuPont	a98acf96e9	updated docs	2025-07-30 16:18:12 -04:00
Dillon DuPont	8aef7b8b1a	updated metrics	2025-07-30 16:12:51 -04:00
Dillon DuPont	ffc88e2031	added agent benchmarks	2025-07-30 13:41:58 -04:00
Dillon DuPont	2076ec7596	added GTA1 agent and click benchmarks (ss-pro, repl)	2025-07-29 20:48:44 -04:00
Dillon DuPont	3a67485e42	Fix circular deps, add GTA1 models	2025-07-29 18:53:46 -04:00
Dillon DuPont	876d42af0a	Replaced agent loop func with agent config class	2025-07-29 18:16:22 -04:00
Dillon DuPont	6e28da7213	Renamed action from mouse_move to mouse	2025-07-29 15:05:45 -04:00
Dillon DuPont	c981d5d264	Added extra cases for anthropic	2025-07-29 14:45:03 -04:00
Dillon DuPont	55d778f185	Added --usage and --cache to Agent CLI	2025-07-29 09:10:34 -04:00
Dillon DuPont	6db6825516	Updated example, cua-core dep, and added --prompt	2025-07-29 08:27:10 -04:00
Dillon DuPont	9e98c58c55	Fixed anthropic loop transformations	2025-07-29 08:20:28 -04:00
Dillon DuPont	a5101e7d23	Replaced linux typing with pynput	2025-07-29 08:19:59 -04:00
Dillon DuPont	97a2985d37	Removed extra print statement	2025-07-29 07:51:46 -04:00
Dillon DuPont	bd9bbb8aaf	Merge branch 'main' of github.com:trycua/cua into fix/v4-hotfixes	2025-07-29 07:37:11 -04:00
Dillon DuPont	0bc4ac318a	Replaced PostHog identify call	2025-07-29 07:35:10 -04:00