90
min of engaging and interactive sessions
30
executives from Fortune 500 companies
1
hour of post-session conversation and networking
Workshop topic: “The invisible risk: Evaluating AI agents before they fail you”
Join Microsoft and Grid Dynamics for a private executive workshop focused on the AI Software Development Life Cycle (SDLC) in financial services. We’ll take a practical look at AI agent evaluation, an emerging discipline where expectations are high, risks are growing, and clear standards are still taking shape.
Building on this foundation, the workshop will focus on a challenge many banks, wealth managers, and insurers now face as AI agents move from pilots into production: how to define, measure, and sustain quality in highly regulated environments with strict model risk management, audit requirements, and compliance obligations.
We will unpack:
- Evaluation methodologies: deterministic, model-based, and human-in-the-loop
- Failure modes and quality drift: how to identify degradation in long-running, tool-augmented, and research-style agents
- Multi-agent orchestration: where and how to evaluate performance across complex workflows
- RAG systems and prompt reliability: discerning systemic flaws from design errors
You’ll gain insights from real financial services AI agent implementations, learn what works (and what doesn’t), and leave with actionable frameworks to help your teams deploy AI agents with confidence.
Following the main session, please join us for a delightful social hour featuring complimentary food and beverages.
Agenda
Arrival and Registration
Welcome and Opening Remarks
Keynote Presentation: “The Invisible Risk: evaluating AI agents before they fail you.”
Panel discussion: “Quality at scale – challenges in AI agent evaluation.”
Networking Break
Breakout session: “Client Perspective: risks, realities, and lessons learned.”
Summary & Q&A
Closing Remarks & Next Steps
Networking Reception
Intended audience
This workshop is designed for:
Why should you attend?
- Hear insights about AI risk management and governance from experienced professionals at Microsoft and Grid Dynamics
- Explore tested approaches to evaluating AI agents
- Understand how to effectively govern AI beyond the pilot phase
- Connect with peers facing the same challenges
- Engage in off-the-record executive dialogue
