How do you log LLM API calls without storing user prompts?

I’ve been working on a small API infrastructure project recently, and one question keeps coming up: How much should we log for LLM API calls without accidentally storing sensitive user data? For normal API calls, I usually log things like status code, latency, request ID, and error type. For LLM cal

Related Stories

📰

tgo Devlog #3: Taming Context Windows, Compiling Lodash, and the Repetitive Reality of True Ownership

Samsung plans $648 billion investment as AI revolutionizes South Korea

India Among 35 Nations Uniting on AI Opportunity at Global Summit

📰

Exploring the Superiority of Recommender Systems Lab Over Netflix and Amazon