50 Commits

Author	SHA1	Message	Date
Dillon DuPont	8f15c21df9	added run_job	2025-08-08 18:15:56 -04:00
Dillon DuPont	1882fb68e5	Added HUD integration	2025-08-08 12:47:07 -04:00
Dillon DuPont	f78d026060	renamed ComputerHandler to AsyncComputerHandler	2025-08-08 11:09:44 -04:00
Dillon DuPont	feec92a1d6	added support for sync methods	2025-08-08 11:06:43 -04:00
Dillon DuPont	73cd489ac3	Added dict-based custom computers	2025-08-08 10:53:26 -04:00
Dillon DuPont	d47ef3f1b6	Added protocol for custom computer handlers	2025-08-08 10:22:10 -04:00
Dillon DuPont	4b0b07240c	Made coordinates optional for left_mouse_up/down	2025-08-07 16:47:34 -04:00
Dillon DuPont	1b406b197a	Updated anthropic loop to include function_call and function_call_output, along with passing tool exceptions to the agent	2025-08-07 16:39:40 -04:00
Dillon DuPont	8e249174cd	Moved hotkey splitting into keypress handler	2025-08-06 10:53:51 -04:00
Dillon DuPont	3631caa883	Changed keypress to cast strings to lists	2025-08-06 10:27:59 -04:00
Dillon DuPont	74a25f2003	fixed docstring	2025-08-05 12:54:23 -04:00
Dillon DuPont	0063eccb79	Merge branch 'main' into feat/extra-models	2025-08-05 12:46:26 -04:00
Dillon DuPont	8eb662bf4d	added base models to benchmark	2025-08-05 12:45:00 -04:00
Dillon DuPont	3cc36905ff	added missing abstract mthd	2025-08-05 12:36:22 -04:00
Dillon DuPont	e1e6a7d6a7	Added anthropic click mode	2025-08-05 12:32:42 -04:00
Dillon DuPont	dc0e479170	changed comment	2025-08-05 11:25:29 -04:00
Dillon DuPont	5e7b1e46b0	fixed resolution & OS	2025-08-05 11:23:08 -04:00
Dillon DuPont	01371ed6cf	bump version, add localhost to ui	2025-08-05 10:55:06 -04:00
Dillon DuPont	3e7bc0aa79	Add omniparser predict_click	2025-08-04 18:11:21 -04:00
Dillon DuPont	f87b8eaea5	added grounding+planning composed loop	2025-08-04 16:32:05 -04:00
cgutierr	77922c92fc	Dummy (small) models can produce action_types=None, which will later produce a crash, avoid it	2025-08-03 13:04:29 +02:00
cgutierr	9781810451	Move inputs to model's same device, previously hardcoded to CUDA	2025-08-03 13:02:15 +02:00
cgutierr	5b5f17af8e	Use generic AutoModel not tied to specific arch	2025-08-03 13:00:27 +02:00
Dillon DuPont	d5564977f0	working gta1 loop	2025-08-01 15:49:19 -04:00
ddupont	5bfadf8f9a	Update pii_anonymization.py	2025-08-01 11:46:32 -04:00
Dillon DuPont	5902be2917	updated docs	2025-07-30 16:19:37 -04:00
Dillon DuPont	a98acf96e9	updated docs	2025-07-30 16:18:12 -04:00
Dillon DuPont	8aef7b8b1a	updated metrics	2025-07-30 16:12:51 -04:00
Dillon DuPont	ffc88e2031	added agent benchmarks	2025-07-30 13:41:58 -04:00
Dillon DuPont	2076ec7596	added GTA1 agent and click benchmarks (ss-pro, repl)	2025-07-29 20:48:44 -04:00
Dillon DuPont	3a67485e42	Fix circular deps, add GTA1 models	2025-07-29 18:53:46 -04:00
Dillon DuPont	876d42af0a	Replaced agent loop func with agent config class	2025-07-29 18:16:22 -04:00
Dillon DuPont	6e28da7213	Renamed action from mouse_move to mouse	2025-07-29 15:05:45 -04:00
Dillon DuPont	c981d5d264	Added extra cases for anthropic	2025-07-29 14:45:03 -04:00
Dillon DuPont	55d778f185	Added --usage and --cache to Agent CLI	2025-07-29 09:10:34 -04:00
Dillon DuPont	6db6825516	Updated example, cua-core dep, and added --prompt	2025-07-29 08:27:10 -04:00
Dillon DuPont	9e98c58c55	Fixed anthropic loop transformations	2025-07-29 08:20:28 -04:00
Dillon DuPont	97a2985d37	Removed extra print statement	2025-07-29 07:51:46 -04:00
Dillon DuPont	78d031c516	Added telemetry fallback	2025-07-29 07:27:05 -04:00
Dillon DuPont	3dfed017d8	Changed agent_type kwarg	2025-07-28 13:49:57 -04:00
Dillon DuPont	d9cd8154fc	Added telemtry_enabled kwarg	2025-07-28 13:47:25 -04:00
Dillon DuPont	16d0abb332	Updated README, notebooks, docs	2025-07-28 10:17:04 -04:00
Dillon DuPont	74f56d2308	add disable_response_storage to ui	2025-07-22 09:19:38 -04:00
Dillon DuPont	9068ec32d8	Added disable_response_storage	2025-07-21 12:07:54 -04:00
Dillon DuPont	96fd9cb98e	Fixed OS type that gets passed to OAI	2025-07-17 11:25:34 -07:00
Dillon DuPont	a1563c273b	Fixed anthropic usage showing as 0	2025-07-14 18:43:09 -07:00
Dillon DuPont	3e6f61f54f	Refactored reused code in python interface	2025-07-01 10:57:55 -04:00
Morgan Dean	718000f9c8	Merge branch 'main' into feature/computer/typescript	2025-06-26 12:55:34 -07:00
Morgan Dean	519ff8d4a4	Merge branch 'main' into feature/computer/typescript	2025-06-24 10:43:19 -07:00
Morgan Dean	0246d18347	Reorganize lib folder w/typescript and python roots, initialize core library.	2025-06-23 10:22:36 -07:00