Tag: dspy

3 entries tagged "dspy" — 1 post, 2 links.

Posts

Feb 24, 2026 — 6 min — Platform & AI

DSPy + RAG Evaluation Ops in Production

How to turn DSPy and RAG evaluation into a production release loop with golden sets, retrieval checks, generation rubrics, regression thresholds, and versioned prompt programs.

Outcome: Promoted the note into an essay by defining a repeatable RAG evaluation workflow that separates retrieval quality from generation quality and blocks prompt-program regressions before release.

dspy rag evaluation mlops agents

Links

Articlepedramnavid.comApr 26, 2026Permalink

Evaluating and Optimizing LLM Applications with DSPy

Pedram Navid

This is the DSPy link I would hand to someone who keeps saying "prompt engineering" when they really mean eval-driven optimization. The example is concrete, costed, and honest about train, validation, and holdout splits.

Especially useful because it makes LLM application work feel closer to data science: define a task, build examples, pick a metric, optimize, and check whether the gains survive outside the optimizer.

Articlepedramnavid.comApr 25, 2026Permalink

I finally tried DSPy

Pedram Navid

Part one is the practical on-ramp: a transcript-search use case, a RAG-ish starting point, and the moment DSPy becomes more than a nicer prompt template.

Good to keep because it explains why declarative signatures and modules matter before jumping into optimizer results. The concept lands better when the first problem is messy enough to deserve it.

dspy rag llm evaluation ai engineering

All tags