TechPrep
Securing AI systemsReadPracticeCheck

Data protection, tenancy and retention

Know what data enters prompts, logs, indexes and caches, and keep each tenant's data in its own lane everywhere it goes.

Response caches keyed only on the prompt text will eventually serve one customer's answer to another. Include tenant and user scope in every cache key.

Practice

Written for this site to drill the lesson. Not reported interview questions.

  1. A customer invokes their right to deletion. List every store in an LLM support system that must be purged.
  2. Design tenant isolation for a vector index serving 2,000 business customers, three of them regulated.

Check yourself

Are eval datasets built from user traffic production data?

Yes; classify, protect and retain them as such.

What must every cache key include in a multi-tenant LLM system?

Tenant (and where relevant user) scope.

Saved in this browser.