Commit Graph

1449 Commits

Author SHA1 Message Date
Adam
3274cfafe7 add concurrent session management and resource isolation
Implement concurrent session management for MCP server with:

- SessionManager with computer instance pooling
- Concurrent task execution support
- New tools: get_session_stats, cleanup_session
- Graceful shutdown and resource cleanup
- Fix nested asyncio event loop issues
- Add comprehensive tests and documentation

Enables multiple concurrent clients with proper resource isolation
while maintaining backward compatibility.
2025-10-06 18:37:10 -04:00
Adam
671845001c update README with corrected MCP config and clarified usage
- Updated the README to clarify how to configure cua-mcp-server for Claude Desktop and other MCP clients.
- Fixed the example development configuration to use an absolute/expanded path rather than `~`, preventing issues with Claude’s sandboxed execution.
- Aligned instructions with the current start_mcp_server.sh behavior, ensuring the correct virtual environment and PYTHONPATH are always set.
- Improved wording for consistency across installation, development, and usage sections.
2025-10-01 11:49:17 -04:00
Adam
37864faef2 Fix MCP server startup and tool schema issues in server.py and start_mcp_server.sh
Changes
- Refactored `server.py`:
  - Delayed server instantiation to avoid double-import issues and RuntimeWarning.
  - Reworked `run_cua_task` and `run_multi_cua_tasks` to yield structured output
    (text + screenshots) in a Pydantic-compatible format.
  - Added helper functions for normalising message content, extracting text,
    and serialising tool outputs.
  - Improved logging and error handling for clearer debugging.

- Updated `start_mcp_server.sh`:
  - Ensures Python path points to repo-local `.venv`.
  - Sets `PYTHONPATH` correctly for all `libs/python/*` packages.
  - Added clear debug output for python binary, repo dir, and PYTHONPATH.

Why
- Fixed `PydanticSchemaGenerationError` when returning `Image` objects from
  tool functions.
- Prevented `FastMCP.__init__()` errors by aligning with supported arguments.
- Removed duplicate module loading at startup that triggered RuntimeWarnings.
- Improved clarity of server startup logs for easier integration with Claude Desktop.

Outcome
The MCP server now starts cleanly, registers all tools, and stays connected
with Claude Desktop without schema errors or double-import issues.
2025-09-30 18:52:04 -04:00
Adam
ee615390e9 Typo Correction
test_mcp_server_streaming.py update typo
2025-09-25 16:26:24 -04:00
Adam
65263112cd Stream MCP responses instead of buffering 2025-09-25 16:07:53 -04:00
James Murdza
bdb8e56e10 Merge pull request #420 from JagjeevanAK/jagjeevan/372
fix: updated server endpoint from `/vms/push` to `/lume/vms/push`
2025-09-22 15:07:16 -04:00
Jagjeevan Kashid
1b008332da updated server endpoint from /vms/push to /lume/vms/push
Signed-off-by: Jagjeevan Kashid <jagjeevandev97@gmail.com>
2025-09-22 14:54:23 +05:30
James Murdza
99aaab7688 Clarify Prebuilt Images documentation 2025-09-21 13:32:11 -06:00
James Murdza
ee90efb85d Merge pull request #419 from YeIIcw/examples/hud_eval
🔧 Improve HUD eval script: auto-discover .env and simplify usage
2025-09-21 14:22:32 -04:00
Adam
fb8268f794 Update hud_eval_examples.py 2025-09-21 07:04:55 -04:00
Adam
dd5892d7bd Update hud_eval_examples.py
added documentation
2025-09-21 07:04:24 -04:00
Adam
6dd46742be Create hud_eval_examples.py
Created .py file for running hud eval
2025-09-20 20:58:45 -04:00
f-trycua
0c817960b0 Remove blogpost videos from assets 2025-09-20 19:47:32 +02:00
f-trycua
81e32846c2 Update windows-sandbox.md 2025-09-20 19:46:14 +02:00
f-trycua
ae69a12483 Update introducing-cua-cloud-containers.md 2025-09-20 19:43:22 +02:00
f-trycua
961be43708 Update human-in-the-loop.md 2025-09-20 19:41:47 +02:00
f-trycua
b4eea2be31 Update build-your-own-operator-on-macos-2.md 2025-09-20 19:39:53 +02:00
f-trycua
c089b9afd3 Update build-your-own-operator-on-macos-1.md 2025-09-20 19:38:24 +02:00
f-trycua
ef5f9d3eb2 Update bringing-computer-use-to-the-web.md 2025-09-20 19:34:04 +02:00
f-trycua
65b12f2a5b Update app-use.md 2025-09-20 19:32:43 +02:00
f-trycua
ae4d31ef60 Update trajectory-viewer.md 2025-09-20 19:27:37 +02:00
f-trycua
3f5d0546bd Fix broken blogpost assets ref 2025-09-20 19:24:41 +02:00
Dillon DuPont
28f097f987 Merge branch 'main' of https://github.com/trycua/cua 2025-09-19 19:23:16 -04:00
Dillon DuPont
1346feb125 Add postponed annotations to internvl.py 2025-09-19 19:23:13 -04:00
ddupont
3ac566f53a Merge pull request #416 from trycua/feat/auth-ttl
[Agent] Add CUA_AUTH_TTL_SECONDS env, change default from 5s to 60s
2025-09-19 19:22:03 -04:00
Dillon DuPont
26ff9e1105 Add CUA_AUTH_TTL_SECONDS env, change default from 5s to 60s 2025-09-18 12:40:59 -04:00
ddupont
c6740fe097 Merge pull request #415 from trycua/integrations/ollama
Add ollama notebook
2025-09-18 11:36:03 -04:00
Dillon DuPont
821bd03e48 remove extra prints 2025-09-18 11:27:50 -04:00
Dillon DuPont
ed42c17fa8 Merge branch 'main' into integrations/ollama 2025-09-18 10:56:43 -04:00
Dillon DuPont
297801fecb fixed wording 2025-09-18 10:55:39 -04:00
Dillon DuPont
e7a20fe4c2 latest nb 2025-09-18 10:53:00 -04:00
Dillon DuPont
03d7806549 Fixed invalid trajectory names on ollama 2025-09-18 10:52:45 -04:00
Dillon DuPont
13fc9e2e90 updated nb 2025-09-18 10:51:16 -04:00
Dillon DuPont
af4a328cec latest notebook 2025-09-18 10:42:48 -04:00
Dillon DuPont
5928c41dc0 Rewrote notebook to be easier to follow 2025-09-18 10:39:19 -04:00
f-trycua
6faaf0dea8 Add oss blogposts 2025-09-17 17:07:58 +02:00
Dillon DuPont
b9185ad54e Merge branch 'main' into integrations/ollama 2025-09-16 19:09:25 -04:00
ddupont
88ee0ecaee Merge pull request #362 from trycua/models/opencua
[Agent] Add OpenCUA, InternVL, and Holo models
2025-09-16 12:56:31 -04:00
Dillon DuPont
6ddddf8f88 fix internVL inference 2025-09-16 12:56:07 -04:00
Dillon DuPont
9147e8eeaf Added "cua-agent[internvl-hf]" dep 2025-09-16 12:02:07 -04:00
Dillon DuPont
7cf27b1cc3 docs organization 2025-09-15 16:47:34 -04:00
Dillon DuPont
a46c276e70 updated model docs 2025-09-15 16:41:39 -04:00
Dillon DuPont
c5bbd4611a add qwen2_5_vl.py 2025-09-15 16:29:26 -04:00
Dillon DuPont
7a7de5d50f add holo models 2025-09-15 16:10:54 -04:00
Dillon DuPont
c217ed13af wording change 2025-09-15 16:01:31 -04:00
Dillon DuPont
3a1244e1c1 updated model zoo 2025-09-15 15:59:33 -04:00
Dillon DuPont
eba94ce919 added internVL, Holo1.5, and OpenCUA to readme 2025-09-15 15:55:33 -04:00
Dillon DuPont
ca564b2436 Merge branch 'main' into models/opencua 2025-09-15 15:11:15 -04:00
James Murdza
b4b45e5b8b Upgrade HUD SDK to 0.4.26 2025-09-14 00:34:51 -04:00
James Murdza
8096fbfd34 Upgrade HUD SDK to 0.4.25 2025-09-13 22:43:12 -04:00