Commit Graph

280 Commits

Author SHA1 Message Date
github-actions[bot] b716f2feaa Bump cua-agent to v0.4.38 2025-11-12 12:17:00 +00:00
Dillon DuPont ac1511210b add a more specific env CUA_INFERENCE_API_KEY 2025-11-11 10:13:14 -05:00
Tamoghno Kandar a1c394bcc2 Add files via upload 2025-11-10 12:20:13 -08:00
Tamoghno Kandar ef842cf1e6 Add files via upload 2025-11-10 12:19:01 -08:00
Tamoghno Kandar 2ca0773ebe Add files via upload 2025-11-10 12:10:21 -08:00
Tamoghno Kandar 17b0ffa99f Add files via upload 2025-11-10 12:06:31 -08:00
Tamoghno Kandar 4b6a96f079 Add files via upload 2025-11-10 12:05:04 -08:00
Tamoghno Kandar 99858ddcb4 Delete libs/python/agent/agent/loops/ui_ins.py 2025-11-10 12:04:37 -08:00
Tamoghno Kandar abfcf9cfe2 Add files via upload 2025-11-10 12:03:38 -08:00
Tamoghno Kandar c2648975c9 Update __init__.py
Fixed order of imports
2025-11-10 11:22:27 -08:00
Tamoghno Kandar 2f5f887b3d Update __init__.py 2025-11-10 11:13:05 -08:00
Tamoghno Kandar 3c03ea51c9 Add files via upload 2025-11-10 11:12:17 -08:00
Tamoghno Kandar 76fac6621d Update __init__.py
Added new model UI-INS
2025-11-06 09:16:16 -08:00
Tamoghno Kandar 9e46de3078 Create uiins.py
Added new model UI-INS
2025-11-06 09:14:42 -08:00
Luca Steingen 7b2ecb8a9a Fix: Enable custom function tools with Anthropic models
This commit fixes three bugs that prevented custom function tools from working alongside the computer tool with Anthropic Claude models:

1. Tool format conversion: Convert OpenAI format to Anthropic format
- Changed from {type, function: {parameters}} to {name, description, input_schema}

2. Response handling (content format): Add custom tool detection
- Check tool name and handle custom tools separately from computer actions
- Prevents 'Unknown action type: None' errors

3. Response handling (tool_calls format): Add custom tool handling
- Parse JSON arguments and route custom tools correctly
- Ensures compatibility with litellm's normalized response format

These changes enable developers to use custom Python functions as tools alongside computer control tools without breaking existing functionality.

Fixes: Custom function tools now work correctly with Anthropic models.
2025-11-06 15:26:40 +01:00
Sarina Li 7c727339a2 fix backlinks for seo 2025-10-31 16:18:21 -04:00
Dillon DuPont 21ce5b4d3b rename api_url to api_base 2025-10-30 12:40:31 -04:00
Dillon DuPont 9bcf5ead1b add api key/url param to cli 2025-10-30 12:38:18 -04:00
Dillon DuPont 4026ed3aa2 Merge branch 'main' into feat/api_key_overrides 2025-10-30 12:34:40 -04:00
James Murdza 5bf4c5732e Merge pull request #526 from YeIIcw/fix/agent-sdk-links
Updated Agent SDK readme for supported model/agent link
2025-10-29 14:26:43 -07:00
github-actions[bot] d35e6e4b2a Bump cua-agent to v0.4.37 2025-10-29 18:38:26 +00:00
Sarina Li dc102b584a remove debug logs 2025-10-29 14:20:07 -04:00
Sarina Li f2a3dcf48c merge main 2025-10-29 01:02:40 -04:00
Sarina Li 3769c3d731 omni parser refactor with acompletions + coords normalizing 2025-10-29 01:00:33 -04:00
github-actions[bot] c8cd29aeb1 Bump cua-agent to v0.4.36 2025-10-29 01:57:40 +00:00
James Murdza e3ab4fe7b0 Format tests with uv run pre-commit run --all-files 2025-10-28 17:03:26 -07:00
James Murdza 3ee5206baf Merge pull request #491 from AceAtDev/CI/CDtests
Add test infrastructure with CI/CD #478
2025-10-28 17:00:05 -07:00
Adam a15141ff0c Update README.md 2025-10-28 15:19:08 -07:00
Sarina Li 11e8f891c3 lint formatting 2025-10-27 17:37:18 -07:00
Sarina Li 0465ffd200 debug removal 2025-10-27 17:29:23 -07:00
Sarina Li 1cb405c9f8 fix output of gpt 4o 2025-10-27 17:27:07 -07:00
Sarina Li 5376afba79 Merge upstream/main to resolve conflicts with trycua/cua 2025-10-27 16:06:06 -07:00
Elshoubky M 59016608da fixed ImportPathMismatchError caused by init files 2025-10-25 01:54:04 -04:00
Dillon DuPont cfedce2806 adjust url 2025-10-23 15:45:59 -07:00
Dillon DuPont 4abae2f262 Add "cua/" LLM provider 2025-10-23 10:49:40 -07:00
Dillon DuPont a19ae76a58 Document api_key and api_base kwarg, rename **kwargs to **additional_generation_kwargs for clarity 2025-10-22 17:40:00 -07:00
Dillon DuPont f18103dc20 Add api_base and api_url kwarg and threading 2025-10-22 17:25:55 -07:00
Dillon DuPont 682609b7e8 Run uv run pre-commit run --all-files on qwen.py 2025-10-22 16:36:32 -07:00
Dillon DuPont bdb5f8918b Bump cua-agent to v0.4.35 2025-10-22 16:22:33 -07:00
Dillon DuPont cb17e27445 Bump cua-agent to v0.4.34 2025-10-22 16:22:29 -07:00
Dillon DuPont 16072f19a3 Bump cua-agent to v0.4.33 2025-10-22 16:22:05 -07:00
Dillon DuPont 6d9fddea13 Fix cua-agent version for bump-version 2025-10-22 16:22:02 -07:00
Dillon DuPont 5bad437f47 add qwen3 vl requirements to pyproj 2025-10-22 16:18:19 -07:00
Dillon DuPont a78dcd3331 Fix qwen3 hallucinating coords w/o screenshots 2025-10-22 16:14:43 -07:00
Dillon DuPont 7631412694 Add qwen3 VL computer-use loop 2025-10-22 15:51:51 -07:00
James Murdza ddc5a5de91 Format codebase with uv run pre-commit run --all-files 2025-10-22 11:35:31 -07:00
Aditya Bavadekar c33517a42d chore: consolidate Ruff configs, add prettier dependancy and updated documentation usage
- Remove per-package Black, Ruff, and MyPy settings in individual pyproject.toml files
- Centralize Ruff configuration in root pyproject.toml under [tool.ruff.lint] with selected ignores
- Add Prettier setup and usage instructions to Development.md
- Include pnpm install instructions for JS/TS dependencies
- Ensure pre-commit hooks enforce Python and JS/TS formatting consistently
2025-10-22 11:10:21 -07:00
Elshoubky M 451c9c2c01 Add test infrastructure with CI/CD
- Add separate test directories for all 7 packages (core, agent, computer, computer-server, mcp-server, pylume, som)
- Create 30+ unit tests with mocks for external dependencies (liteLLM, PostHog, Computer)
- Add conftest.py fixtures for each package to enable isolated testing
- Implement GitHub Actions CI workflow with matrix strategy to test each package independently
- Add TESTING.md with comprehensive testing guide and architecture documentation
- Follow SOLID principles: SRP, Vertical Slice Architecture, and Testability as Design Signal

Note:
- No API keys required for unit tests
2025-10-21 18:58:40 -04:00
James Murdza b7f5e1dd89 Fix dependency conflict with transformers 2025-10-20 07:18:10 -07:00
James Murdza 2da9e39eb6 Merge pull request #480 from masterbatcoderman10/fix/f-string-error-handle-item
Fix: Corrected f-string syntax error in agent.py
2025-10-17 14:47:29 -07:00