DSPy seems to be a capable but complex ai system that feels under the radar (considering the problem it aims to solve). it’d be interesting and relevant for me to know what it is and try it out, since my terminus is building on-device ai systems.

steps to build a new system with dspy:

  1. define my task: what are the inputs and outputs?
  2. define initial program. start simple
    1. what is a “program” in dspy?
  3. define 20-30 i/o examples and try program
  4. define one or few initial metric and run zero-shot evals
  5. compile with a dspy optimizer
    1. use (or transform) existing datasets to match your task
  6. iterate!