Agent + Local Model + Evals — One‑Pager

🚀 Purpose If you’ve ever wondered how to compare a locally‑hosted LLM with a hosted OpenAI model side‑by‑side, while keeping the whole experiment observable from end‑to‑end, you’re in the right place. This one‑pager walks you through the starter repo that stitches together three distinct paths: Path Stack Observability A .NET 8 + Semantic Kernel + Ollama (local model) Azure Monitor (OTEL) B OpenAI Agents SDK (TypeScript/Node) OpenAI Logs → optional OTLP → Azure Monitor C Python Evals (OpenAI‑provided) Same prompts, same metrics The goal? A clean, reproducible harness that lets you run the same prompt against a local model and an OpenAI model, invoke tools, and then score the outputs with a single Python‑based eval suite. All of this is fully instrumented with OpenTelemetry, so you can follow the request flow from the client code right into Azure Application Insights (or any OTEL backend you prefer). ...

August 10, 2025 · 5 min · Fabian Williams
Python Plus Microsoft Graph

Microsoft Graph and Python

Why you should read this post If you are interested in Microsoft Graph and how it can work with Python this post gives two examples of an art of the possible. In this post i will be addressing the following topics: Using MSAL libraries in Python Using 2 different Authentication Flows to gain access to Microsoft Graph resources Bonus - Access to my GitHub repo where you can get the code as well as a Jupyter Notebook to runs this on your own Wiring this all up This is not very onerous, in fact if you have ever played with Python, its the simplicity that is really astounding. Basically you need to work the the below libraries to get this sorted: ...

May 10, 2021 · 5 min · Fabian Williams