ivo's home

AQuA is a framework for diagnosing agent behavior by analyzing production telemetry via Cloud Trace, Logging, or BigQuery. It functions as an ambient quality agent that monitors live sessions to identify silent failure patterns and attribute them to specific code revisions or upstream data sources. The system operates outside the request path and generates actionable, code-anchored insights for human review.

This is worth implementing if you are struggling to manage the drift between your static evaluation datasets and live user traffic. It is not a silver bullet for deployment, as it requires you to write domain-specific goal files and deterministic metrics to be effective. Expect to spend significant time tuning the evaluation prompts before the insights become truly reliable.

more: https://developers.googleblog.com/the-outer-loop-insights-first-an-ambient-quality-agent-that-diagnoses-your-production-agent/

my other side: ivo.blogspot.com

Agent Lightning v1.0 is a 3,500-line open-source framework from Microsoft Research for applying reinforcement learning to existing agent harnesses. Instead of forcing you to rewrite your agent's execution loop inside the training framework, it sits between your agent and the LLM API as an OpenAI-compatible proxy. It records model calls and handles collocated asynchronous training on a shared pool of GPUs.

It is worth a look if you are already maintaining a custom harness like OpenHands or mini-SWE-agent and want to tune it without rewriting your stack. The catch is that splitting rollouts into variable training samples introduces complex data alignment challenges, and it assumes you have the compute infrastructure to run heavy concurrent agent loops. Skip it if you are looking for an out-of-the-box training environment with zero systems overhead.

more: https://www.microsoft.com/en-us/research/blog/agent-lightning-v1-0-a-3500-line-lightweight-agentic-rl-framework-for-training-agents-with-real-harnesses/

my other side: ivo.blogspot.com

Pinvou Agent is an open-source desktop workspace that combines document chat, vector knowledge bases, and design generation into a single Electron application. It supports local models via vLLM alongside any OpenAI-compatible endpoint, and lets you hook up CLI tools and MCP servers. The codebase also includes ACP support for plugging in coding agents like Claude Code or Codex against a local project directory.

If you are tired of juggling CLI windows and browser tabs for different AI tasks, this consolidates them neatly under ~/.pinvou3/ with persistent sessions and local voice input. However, it is a heavy desktop wrapper that still requires managing your own model backends and API keys for cloud endpoints. Skip it if you prefer keeping your workflow strictly inside a terminal or your existing text editor.

more: https://github.com/Pinvou/pinvou-agent

my other side: ivo.blogspot.com