I built a private LLM API in one morning that logs nothing — here's exactly how
I was frustrated. Every LLM API provider logs your prompts. OpenAI. Anthropic. Google. All of them. For teams building on sensitive data — healthcare, fintech, legal — this is a blocker. So this mo...

Source: DEV Community
I was frustrated. Every LLM API provider logs your prompts. OpenAI. Anthropic. Google. All of them. For teams building on sensitive data — healthcare, fintech, legal — this is a blocker. So this morning I built NullLog. A private LLM inference API with zero data retention. Not a policy. Architecture. Nothing is ever written to storage. Here's exactly how I built it in a few hours. The stack Cloudflare Workers — edge routing, auth, key management Cloudflare Workers AI — inference (free tier covers a lot) Cloudflare KV — API key storage only (no prompts, no responses) Stripe — payments, instant API key delivery Resend — transactional email Total infra cost to run: near zero. How it works Customer pays Stripe → Webhook fires to Cloudflare Worker → Worker generates API key → Key stored in KV (email + tier only, no usage logs) → Customer gets key by email in 60 seconds → They hit /v1/chat/completions → Worker routes to inference → Response returned → Nothing written anywhere The worker (sim