Skip to content

Conversation

@ddupont808
Copy link
Contributor

@ddupont808 ddupont808 commented Dec 4, 2025

This pull request introduces significant improvements and new features to the agent system, focusing on extensibility, Azure Foundry integration, and developer usability.

Azure Foundry Integration:

  • Added the new AzureMLAdapter class to support direct OpenAI-compatible API calls to Azure Foundry endpoints, including a workaround for Azure ML's argument parsing bug and full support for synchronous, asynchronous, and streaming completions. (azure_ml_adapter.py)
  • Registered AzureMLAdapter in the adapters package and integrated it into the agent's provider map, enabling seamless use of Azure Foundry models. (__init__.py, agent.py) [1] [2] [3]

Tool Handling Improvements:

  • Enhanced tool processing to support new BaseTool and BaseComputerTool classes: tools are now recognized and their schemas extracted for use in agent loops, and execution logic accommodates these new types. (agent.py) [1] [2] [3] [4] [5]
  • Updated generic VLM loop to dynamically build function schemas from the provided tools, supporting both computer and function tool types for improved extensibility. (generic_vlm.py)

Playground Server Feature:

  • Added a new open() method to the agent class to launch a local playground server and automatically open the CUA playground interface in the browser for interactive development and testing. (agent.py, playground/__init__.py) [1] [2]

@vercel
Copy link

vercel bot commented Dec 4, 2025

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Preview Comments Updated (UTC)
docs Ready Ready Preview Comment Dec 5, 2025 6:54pm

@codecov-commenter
Copy link

codecov-commenter commented Dec 4, 2025

⚠️ Please install the 'codecov app svg image' to ensure uploads and comments are reliably processed by Codecov.

Codecov Report

❌ Patch coverage is 15.08678% with 636 lines in your changes missing coverage. Please review.

Files with missing lines Patch % Lines
libs/python/agent/agent/loops/fara.py 7.93% 232 Missing ⚠️
libs/python/agent/agent/tools/browser_tool.py 16.84% 158 Missing ⚠️
...bs/python/agent/agent/adapters/azure_ml_adapter.py 17.64% 98 Missing ⚠️
libs/python/agent/agent/tools/base.py 40.00% 48 Missing ⚠️
libs/python/agent/agent/responses.py 0.00% 47 Missing ⚠️
libs/python/agent/agent/loops/generic_vlm.py 0.00% 30 Missing ⚠️
libs/python/agent/agent/agent.py 17.85% 23 Missing ⚠️

📢 Thoughts on this report? Let us know!

@ddupont808
Copy link
Contributor Author

Closes issue #621

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants