AI notetakers can't be accurately tested without a generated meeting context.

I wanted to know which AI notetaker transcribes most accurately — Granola, Fathom, or Otter. So I did the obvious thing: I recorded a real meeting, ran it through all three, and compared the transcripts. That experiment is worthless, and it took me one afternoon to see why. To score a transcript you