Topic

Multimodal & Voice Apps with AI Frameworks

6 posts on multimodal & voice apps with ai frameworks — part of framework tutorials on the n4n AI blog.

Speech-to-speech apps with the OpenAI Realtime API

A practical openai realtime api speech-to-speech tutorial: build low-latency voice apps with WebSockets, handle audio, and avoid common pitfalls.

July 19, 20263 min read

Framework tutorialsHow-to

Real-time voice apps with LiveKit Agents and Whisper

Step-by-step guide to building a production-ready real-time voice app with LiveKit Agents and Whisper STT, including LLM wiring and TTS.

July 19, 20264 min read

Framework tutorialsTutorial

Multimodal RAG in LlamaIndex with GPT-4o and images

Build a working multimodal RAG pipeline in LlamaIndex with GPT-4o and images. Step-by-step code for indexing and querying visual documents.

July 19, 20263 min read

Framework tutorialsHow-to

Build a voice bot with Vapi and Twilio integration

Step-by-step vapi twilio voice bot integration tutorial: connect Vapi assistants to Twilio telephony and a custom LLM endpoint in production.

July 19, 20264 min read

Framework tutorialsHow-to

Build a voice assistant with Pipecat and GPT-4o Realtime

Step-by-step pipecat gpt-4o realtime voice assistant tutorial: build a low-latency voice agent with Pipecat and OpenAI Realtime, from install to verification.

July 19, 20264 min read

Framework tutorialsTutorial

Analyze images and PDFs with Gemini 2.0 in LangChain

Hands-on tutorial: build multimodal pipelines with Gemini 2.0 and LangChain to analyze images and PDFs locally, with runnable code and expected outputs.

July 19, 20263 min read