Commit Graph

194 Commits

Author SHA1 Message Date
Dillon DuPont
d930032c82 Fix cua adapter 2025-11-19 10:52:50 -05:00
ddupont
210fc01eea Merge pull request #592 from trycua/feat/fix-cua-adapter
Fix cua adapter, add UI-TARS-2 model
2025-11-18 17:21:27 -05:00
Dillon DuPont
9ca508380f Add UI-TARS 2 2025-11-18 17:14:47 -05:00
ddupont
c67593cd4f Merge pull request #548 from LucaStngn/fix/anthropic-custom-function-tools
Fix: Enable custom function tools with Anthropic models
2025-11-18 16:29:23 -05:00
Dillon DuPont
8284f85950 Update params dict 2025-11-18 15:31:30 -05:00
Adam
c59a4a7e3d Formatting Fix 2025-11-13 12:21:51 -05:00
Sarina Li
41c1d38ee4 Merge branch 'main' into new-improve-docs-home 2025-11-13 11:30:06 -05:00
Sarina Li
a8d21ae77b change default model 2025-11-13 11:26:47 -05:00
Francesco Bonacci
91ef479217 Merge pull request #506 from trycua/feat/inference-provider
Add "cua/" LLM provider
2025-11-13 12:31:11 +01:00
ddupont
e109b422db Merge branch 'main' into main 2025-11-12 10:41:08 -05:00
Dillon DuPont
ac1511210b add a more specific env CUA_INFERENCE_API_KEY 2025-11-11 10:13:14 -05:00
Tamoghno Kandar
a1c394bcc2 Add files via upload 2025-11-10 12:20:13 -08:00
Tamoghno Kandar
ef842cf1e6 Add files via upload 2025-11-10 12:19:01 -08:00
Tamoghno Kandar
2ca0773ebe Add files via upload 2025-11-10 12:10:21 -08:00
Tamoghno Kandar
17b0ffa99f Add files via upload 2025-11-10 12:06:31 -08:00
Tamoghno Kandar
4b6a96f079 Add files via upload 2025-11-10 12:05:04 -08:00
Tamoghno Kandar
99858ddcb4 Delete libs/python/agent/agent/loops/ui_ins.py 2025-11-10 12:04:37 -08:00
Tamoghno Kandar
abfcf9cfe2 Add files via upload 2025-11-10 12:03:38 -08:00
Tamoghno Kandar
c2648975c9 Update __init__.py
Fixed order of imports
2025-11-10 11:22:27 -08:00
Tamoghno Kandar
2f5f887b3d Update __init__.py 2025-11-10 11:13:05 -08:00
Tamoghno Kandar
3c03ea51c9 Add files via upload 2025-11-10 11:12:17 -08:00
Tamoghno Kandar
76fac6621d Update __init__.py
Added new model UI-INS
2025-11-06 09:16:16 -08:00
Tamoghno Kandar
9e46de3078 Create uiins.py
Added new model UI-INS
2025-11-06 09:14:42 -08:00
Luca Steingen
7b2ecb8a9a Fix: Enable custom function tools with Anthropic models
This commit fixes three bugs that prevented custom function tools from working alongside the computer tool with Anthropic Claude models:

1. Tool format conversion: Convert OpenAI format to Anthropic format
- Changed from {type, function: {parameters}} to {name, description, input_schema}

2. Response handling (content format): Add custom tool detection
- Check tool name and handle custom tools separately from computer actions
- Prevents 'Unknown action type: None' errors

3. Response handling (tool_calls format): Add custom tool handling
- Parse JSON arguments and route custom tools correctly
- Ensures compatibility with litellm's normalized response format

These changes enable developers to use custom Python functions as tools alongside computer control tools without breaking existing functionality.

Fixes: Custom function tools now work correctly with Anthropic models.
2025-11-06 15:26:40 +01:00
Sarina Li
7c727339a2 fix backlinks for seo 2025-10-31 16:18:21 -04:00
Dillon DuPont
21ce5b4d3b rename api_url to api_base 2025-10-30 12:40:31 -04:00
Dillon DuPont
9bcf5ead1b add api key/url param to cli 2025-10-30 12:38:18 -04:00
Dillon DuPont
4026ed3aa2 Merge branch 'main' into feat/api_key_overrides 2025-10-30 12:34:40 -04:00
Sarina Li
dc102b584a remove debug logs 2025-10-29 14:20:07 -04:00
Sarina Li
f2a3dcf48c merge main 2025-10-29 01:02:40 -04:00
Sarina Li
3769c3d731 omni parser refactor with acompletions + coords normalizing 2025-10-29 01:00:33 -04:00
Sarina Li
11e8f891c3 lint formatting 2025-10-27 17:37:18 -07:00
Sarina Li
0465ffd200 debug removal 2025-10-27 17:29:23 -07:00
Sarina Li
1cb405c9f8 fix output of gpt 4o 2025-10-27 17:27:07 -07:00
Sarina Li
5376afba79 Merge upstream/main to resolve conflicts with trycua/cua 2025-10-27 16:06:06 -07:00
Dillon DuPont
cfedce2806 adjust url 2025-10-23 15:45:59 -07:00
Dillon DuPont
4abae2f262 Add "cua/" LLM provider 2025-10-23 10:49:40 -07:00
Dillon DuPont
a19ae76a58 Document api_key and api_base kwarg, rename **kwargs to **additional_generation_kwargs for clarity 2025-10-22 17:40:00 -07:00
Dillon DuPont
f18103dc20 Add api_base and api_url kwarg and threading 2025-10-22 17:25:55 -07:00
Dillon DuPont
682609b7e8 Run uv run pre-commit run --all-files on qwen.py 2025-10-22 16:36:32 -07:00
Dillon DuPont
a78dcd3331 Fix qwen3 hallucinating coords w/o screenshots 2025-10-22 16:14:43 -07:00
Dillon DuPont
7631412694 Add qwen3 VL computer-use loop 2025-10-22 15:51:51 -07:00
James Murdza
ddc5a5de91 Format codebase with uv run pre-commit run --all-files 2025-10-22 11:35:31 -07:00
James Murdza
2da9e39eb6 Merge pull request #480 from masterbatcoderman10/fix/f-string-error-handle-item
Fix: Corrected f-string syntax error in agent.py
2025-10-17 14:47:29 -07:00
Dillon DuPont
090edb8f33 Fix torch dependency in cua-agent 2025-10-17 10:49:32 -04:00
masterbatcoderman10
0d16571d40 Fix: Corrected f-string syntax error in agent.py 2025-10-17 11:40:33 +04:00
Dillon DuPont
0709d6a370 Fix claude-haiku-4 usage 2025-10-15 14:52:06 -04:00
Dillon DuPont
99adca4b15 register gemini model 2025-10-15 10:16:46 -04:00
Dillon DuPont
0c1a6f445a Merge branch 'main' into feat/gemini-2_5-cua 2025-10-14 11:33:24 -04:00
Dillon DuPont
ef28a64b8f Add gemini CUA loop 2025-10-07 17:23:33 -04:00