Voice Live API: AI Sales Coach

A demo application showcasing AI-powered voice training for sales professionals, built on Azure.

   

---

Overview

Voice Live API Salescoach is a demo application showcasing how AI-based training could be used in sales education using Azure AI services. Practice real-world sales scenarios with AI-powered virtual customers, receive instant feedback on your performance, and improve your sales skills through immersive voice conversations.

Features

• Real-time Voice Conversations - Practice sales calls with AI agents that respond naturally using Azure Voice Live API
• Performance Analysis - Get detailed feedback on your conversation skills
• Pronunciation Assessment - Improve your speaking clarity and confidence with Azure Speech Services
• Scoring System - Track your progress with metrics

Demo

See the Voice Live API Salescoach in action:

demo.mp4

How It Works

1. Choose a Scenario - Select from various industry-specific sales situations
2. Start the Conversation - Click the microphone to start your simulation
3. Engage with AI - The virtual customer responds realistically based on the scenario
4. Receive Feedback - Get instant analysis on your performance including:
   • Speaking tone and style
   • Content quality
   • Needs assessment
   • Value proposition delivery
   • Objection handling skills

Getting Started

Deploy to Azure

1. Deploy to Azure:

   azd up

2. Access your application: The deployment will output the URL where your application is running.

Local Development

This project includes a dev container for easy setup and a build script for development.

1. Use Dev Container (Recommended)

   • Open in VS Code and select "Reopen in Container" when prompted
   • All dependencies and tools are pre-configured

2. Fill in the .env file

   • Copy .env.template to .env
   • Fill in your Azure AI Foundry and Speech service keys and endpoints (you can run azd provision to create these resources if you haven't already)

3. Build and run

   # Build the application
   ./scripts/build.sh
   
   # Start the server
   cd backend && python src/app.py

Visit http://localhost:8000 to start training!

Architecture

The application leverages multiple Azure AI services to deliver real-time voice-based sales training: Azure AI Foundry - AI platform including: Voice Live API for real-time speech-to-speech conversations and avatar simulation Large language models (GPT-4o) as underlying LLM for performance analysis Speech Services for post-conversation pronunciation and fluency assessment Optional AI Agent Service React + Fluent UI - Modern web interface Python Flask - Backend API and WebSocket communication Conversation Flow: User speech → Voice Live API → GPT-4o processing → AI agent response → Performance analysis → Detailed feedback

Contributors

Contributing

This project welcomes contributions and suggestions. Most contributions require you to agree to a Contributor License Agreement (CLA) declaring that you have the right to, and actually do, grant us the rights to use your contribution. For details, visit https://cla.opensource.microsoft.com.

When you submit a pull request, a CLA bot will automatically determine whether you need to provide a CLA and decorate the PR appropriately (e.g., status check, comment). Simply follow the instructions provided by the bot. You will only need to do this once across all repos using our CLA.

This project has adopted the Microsoft Open Source Code of Conduct. For more information see the Code of Conduct FAQ or contact [email protected] with any additional questions or comments.

Security

Microsoft takes the security of our software products and services seriously, which includes all source code repositories managed through our GitHub organizations, which include Microsoft, Azure, DotNet, AspNet and Xamarin.

If you believe you have found a security vulnerability in any Microsoft-owned repository that meets Microsoft's definition of a security vulnerability, please report it to us as described in SECURITY.md.

Trademarks

This project may contain trademarks or logos for projects, products, or services. Authorized use of Microsoft trademarks or logos is subject to and must follow Microsoft's Trademark & Brand Guidelines. Use of Microsoft trademarks or logos in modified versions of this project must not cause confusion or imply Microsoft sponsorship. Any use of third-party trademarks or logos are subject to those third-party's policies. Any use of third-party trademarks or logos are subject to those third-party's policies.

Made with ❤️ in 🇨🇭