🎯 Project Vision IN DEVELOPMENT

Real-time multi-language translation bot for Microsoft Teams meetings — UN simultaneous interpretation style.

Enable multi-language meetings where everyone hears conversations in their preferred language simultaneously, just like UN meetings with human interpreters.

🇩🇪 🇺🇸 🇪🇸 🇫🇷 🇮🇹 🇵🇹 🇯🇵 🇨🇳
<1s
Translation Latency
4
Languages (Initial)
~$35
Per 60min Meeting
9
Languages (Planned)

✨ Core Features

🗣️ Multi-Language Support

German, English, Spanish, French (expandable to 9+ languages)

⚡ Real-time Translation

Sub-second latency using optimized STT → Translation → TTS pipeline

👤 Speaker Identification

"Klaus (German): We need analysis..." with Teams integration

🎧 Individual Audio Streams

Each participant hears their chosen language only

📝 Live Captions

Visual translation backup with speaker attribution

🔀 Crosstalk Handling

Leverages Teams' built-in speaker separation

🔧 Translation Pipeline

1
Audio Capture (50-100ms)
Teams Bot Framework captures speaker audio
2
Speech-to-Text (200-300ms)
OpenAI Whisper transcribes in source language
3
Translation (100-200ms)
Claude API translates to all target languages
4
Text-to-Speech (200-300ms)
ElevenLabs synthesizes natural audio per language
5
Audio Routing (50-100ms)
Per-participant delivery of their chosen language

📅 Development Roadmap

Phase 1: Foundation (Week 1) IN PROGRESS

✅ Project structure • Teams bot framework • Language selection UI • Basic 1-language translation

Phase 2: Multi-Language (Week 2)

Multi-language routing • Per-participant audio streams • Speaker identification • Live captions

Phase 3: Optimization (Week 3)

Latency optimization (<1s) • Quality improvements • Error handling • Fallback mechanisms

Phase 4: Production (Week 4)

Azure deployment • Teams app store submission • Documentation • User testing

🛠️ Tech Stack

Teams Bot Framework Azure Node.js OpenAI Whisper Claude API ElevenLabs WebRTC

📁 Project Location

/Users/tommie/clawd/projects/teams-un-translator/

Started: February 4, 2026

Status: 🟡 In Development — Next: Teams bot framework + language selection