Commit Graph

84 Commits

Author SHA1 Message Date
Dillon DuPont
d47ef3f1b6 Added protocol for custom computer handlers 2025-08-08 10:22:10 -04:00
Dillon DuPont
4b0b07240c Made coordinates optional for left_mouse_up/down 2025-08-07 16:47:34 -04:00
Dillon DuPont
1b406b197a Updated anthropic loop to include function_call and function_call_output, along with passing tool exceptions to the agent 2025-08-07 16:39:40 -04:00
Dillon DuPont
0056ae44f5 Disabled pyautogui FAILSAFE 2025-08-06 14:47:29 -04:00
Dillon DuPont
8e249174cd Moved hotkey splitting into keypress handler 2025-08-06 10:53:51 -04:00
Dillon DuPont
3631caa883 Changed keypress to cast strings to lists 2025-08-06 10:27:59 -04:00
Dillon DuPont
74a25f2003 fixed docstring 2025-08-05 12:54:23 -04:00
Dillon DuPont
0063eccb79 Merge branch 'main' into feat/extra-models 2025-08-05 12:46:26 -04:00
Dillon DuPont
8eb662bf4d added base models to benchmark 2025-08-05 12:45:00 -04:00
Dillon DuPont
3cc36905ff added missing abstract mthd 2025-08-05 12:36:22 -04:00
Dillon DuPont
e1e6a7d6a7 Added anthropic click mode 2025-08-05 12:32:42 -04:00
Dillon DuPont
dc0e479170 changed comment 2025-08-05 11:25:29 -04:00
Dillon DuPont
5e7b1e46b0 fixed resolution & OS 2025-08-05 11:23:08 -04:00
Dillon DuPont
01371ed6cf bump version, add localhost to ui 2025-08-05 10:55:06 -04:00
Dillon DuPont
96e4b7586a update mcp server to cua-agent==0.4.x 2025-08-05 10:51:21 -04:00
Dillon DuPont
3e7bc0aa79 Add omniparser predict_click 2025-08-04 18:11:21 -04:00
Dillon DuPont
f87b8eaea5 added grounding+planning composed loop 2025-08-04 16:32:05 -04:00
cgutierr
77922c92fc Dummy (small) models can produce action_types=None, which will later produce a crash, avoid it 2025-08-03 13:04:29 +02:00
cgutierr
9781810451 Move inputs to model's same device, previously hardcoded to CUDA 2025-08-03 13:02:15 +02:00
cgutierr
5b5f17af8e Use generic AutoModel not tied to specific arch 2025-08-03 13:00:27 +02:00
Dillon DuPont
d5564977f0 working gta1 loop 2025-08-01 15:49:19 -04:00
ddupont
5bfadf8f9a Update pii_anonymization.py 2025-08-01 11:46:32 -04:00
Morgan Dean
32a8e504d4 Merge branch 'main' into feat/docs/init 2025-07-31 18:04:02 +01:00
Dillon DuPont
5902be2917 updated docs 2025-07-30 16:19:37 -04:00
Dillon DuPont
a98acf96e9 updated docs 2025-07-30 16:18:12 -04:00
Dillon DuPont
8aef7b8b1a updated metrics 2025-07-30 16:12:51 -04:00
Dillon DuPont
ffc88e2031 added agent benchmarks 2025-07-30 13:41:58 -04:00
Dillon DuPont
2076ec7596 added GTA1 agent and click benchmarks (ss-pro, repl) 2025-07-29 20:48:44 -04:00
Dillon DuPont
3a67485e42 Fix circular deps, add GTA1 models 2025-07-29 18:53:46 -04:00
Dillon DuPont
876d42af0a Replaced agent loop func with agent config class 2025-07-29 18:16:22 -04:00
Dillon DuPont
6e28da7213 Renamed action from mouse_move to mouse 2025-07-29 15:05:45 -04:00
Dillon DuPont
c981d5d264 Added extra cases for anthropic 2025-07-29 14:45:03 -04:00
Dillon DuPont
55d778f185 Added --usage and --cache to Agent CLI 2025-07-29 09:10:34 -04:00
Dillon DuPont
6db6825516 Updated example, cua-core dep, and added --prompt 2025-07-29 08:27:10 -04:00
Dillon DuPont
9e98c58c55 Fixed anthropic loop transformations 2025-07-29 08:20:28 -04:00
Dillon DuPont
a5101e7d23 Replaced linux typing with pynput 2025-07-29 08:19:59 -04:00
Dillon DuPont
97a2985d37 Removed extra print statement 2025-07-29 07:51:46 -04:00
Dillon DuPont
bd9bbb8aaf Merge branch 'main' of github.com:trycua/cua into fix/v4-hotfixes 2025-07-29 07:37:11 -04:00
Dillon DuPont
0bc4ac318a Replaced PostHog identify call 2025-07-29 07:35:10 -04:00
Dillon DuPont
78d031c516 Added telemetry fallback 2025-07-29 07:27:05 -04:00
Dillon DuPont
3dfed017d8 Changed agent_type kwarg 2025-07-28 13:49:57 -04:00
Dillon DuPont
d9cd8154fc Added telemtry_enabled kwarg 2025-07-28 13:47:25 -04:00
Dillon DuPont
c61a55c986 removed agent2 2025-07-28 10:17:25 -04:00
Dillon DuPont
16d0abb332 Updated README, notebooks, docs 2025-07-28 10:17:04 -04:00
Dillon DuPont
56a4ee0b28 0.4.0b3 2025-07-27 15:22:22 -04:00
Dillon DuPont
0971464c8d 0.4.0b2 2025-07-27 15:20:24 -04:00
Dillon DuPont
6f177d7f6a renamed to agent 2025-07-25 19:01:20 -04:00
Dillon DuPont
52005c592f Updated ReadME 2025-07-25 17:06:09 -04:00
Dillon DuPont
b91821718b Added new agent SDK 2025-07-24 21:41:44 -04:00
Morgan Dean
350795615f Rename c/ua - cua 2025-07-22 10:04:13 -07:00