Topic

Framework Cost & Latency Optimization Tutorials

4 posts on framework cost & latency optimization tutorials — part of framework tutorials on the n4n AI blog.

Prompt caching in LangChain: cut Claude costs by 90%

Hands-on LangChain tutorial: use Anthropic prompt caching with Claude to slash input token costs by 90%. Step-by-step code, usage metrics, and gotchas.

July 19, 20263 min read

Framework tutorialsHow-to

Cut LangChain costs with semantic caching via GPTCache

Step-by-step guide to langchain semantic caching gptcache cost reduction: deploy a semantic cache layer to slash LLM token spend and p95 latency.

July 19, 20263 min read

Framework tutorialsTutorial

Cache embeddings in LlamaIndex to reduce OpenAI API spend

Learn how to implement a LlamaIndex embedding cache to avoid duplicate OpenAI embedding calls, cut token spend, and speed up RAG pipelines.

July 19, 20263 min read

Framework tutorialsHow-to

Automatic model fallback in LiteLLM to cut GPT-4 spend

Implement LiteLLM automatic model fallback to route around GPT-4 limits and slash inference costs. Step-by-step proxy config and code.

July 19, 20264 min read