DoorDash built an LLM moderation system to keep the app honest

DoorDash has put an LLM-based moderation platform into production to handle the flood of user-generated content — reviews, photos, and messages — that a food delivery app of this scale generates every day. The system runs on a standard open-source model and acts as a first pass, flagging content that crosses the line into harassment, fraud, or policy violations before a human ever sees it.

The architecture is straightforward: the model evaluates content on a handful of policy dimensions, scores each one, and sends flagged items to a queue for human review. The idea is to catch the low-hanging fruit at machine speed so the moderation team isn't drowning in spam, fake reviews, or the occasional bad actor trying to game the system. DoorDash has been public about its reliance on AI for content moderation for a while now; this is the next step — a dedicated system rather than a patchwork of ad-hoc classifiers.

What's notable is the honesty in the write-up: the LLM is a first filter, not a replacement for judgment. The human-in-the-loop is the real system. This is how most companies are actually doing it — models do the heavy lifting, people handle the edge cases, and the business keeps moving. DoorDash is one of the bigger examples of this pattern applied to a consumer-facing platform with millions of users.

Why this matters for us: la gente uses these apps every day, and when the moderation works, it keeps the platform usable; when it doesn't, it's our money and our time on the line.