Semantic Search Guide

Home / Semantic caching

Semantic caching guides

7 published guides. Start with What is semantic caching.

Start hereWhat is semantic caching

Semantic caching reuses answers for questions that mean the same thing. How it works and when it is safe.

Learning path

All guides

Understand it2 guides

Start hereWhat is semantic cachingSemantic caching reuses answers for questions that mean the same thing. How it works and when it is safe.ExplainerGPTCacheHow GPTCache implements semantic caching, its components and the alternatives worth comparing.

Build and run it2 guides

TutorialSemantic caching for LLM appsAdding a semantic cache in front of an LLM: where it sits, what to cache and expected hit rates.TutorialSimilarity thresholds for cachingToo low a threshold returns wrong answers, too high gets no hits. How to tune it with data.

How it works1 guides

ExplainerSemantic cache invalidationKeeping cached answers correct when source data changes: TTLs, versioning and selective purge.

Compare and choose2 guides

ComparisonAI gateway semantic cachingHow AI gateways offer semantic caching as a feature and what to check before turning it on.ComparisonSemantic caching vs prompt cachingThree caching methods for LLM apps compared on what they reuse, savings and correctness risk.

Related sections

Filtering Search evaluation Scale and cost How it works