An engineering guide to LLM agent evals: failure map, evaluation levels, graders, pass^k, trial statistics, LLM-as-judge calibration, harness architecture, and release gates.
LLM Agent Systems
Practical guides on LLM agents: architecture choices, Responses API migration, evaluation design, tool orchestration, and safety controls for production workloads.
An engineering guide to turning product logs from search, recommendations, and multimodal retrieval into data for SFT, DPO, GRPO, reward models, and LLM-as-judge pipelines.
An engineering article on the context selection layer around GPT, Claude, and Gemini: how to search, rank, and package PDFs, tables, screenshots, and visual evidence for grounded LLM answers.
A field guide for search teams adding tool calling as a bounded capability layer without losing relevance, latency discipline, safety, or rollback control.
Official timeline, architecture mapping, breaking changes, and a practical runbook to migrate from Assistants API to Responses plus Conversations without service regressions.
A practical engineering framework for choosing between workflow and agent: criteria, architecture patterns, evals, security, cost, and rollout plan.
A practical guide to shipping a support RAG agent with tool-calls: architecture contract, release gates, policy enforcement, observability, and FinOps.
igorOS is a browser-based desktop demo that shows what agent UX looks like when a model can call tools, manipulate state, and act inside a visible environment.