Edumate is a state-of-the-art educational application designed to transform how you consume and learn from documents. By leveraging advanced AI, Edumate converts static PDFs into interactive summaries, audio experiences, and smart quizzes.
Click here: https://appetize.io/app/b_zdef4khdymkld5dwifymkj5dea
Click here: https://drive.google.com/file/d/1-haxJelWiwj_aRDNgr2MBb75OFtxLYHN/view?usp=sharing
| Auth & Google Login | Home Screen | Library View | Create Page |
|---|---|---|---|
 |
 |
 |
 |
| Summary Page | Interactive Quiz | User Profile | Forgot Password (OTP) |
 |
 |
 |
 |
Edumate uses a sophisticated pipeline to ensure you get the best learning experience:
- Upload: You upload a study document (PDF).
- Analysis: The backend extracts the text, breaks it into semantic chunks, and creates vector embeddings to understand the context.
- Summarization: Google Gemini processes the content to generate a structured, easy-to-read summary.
- Interactive Learning:
- Audio Generation: The summary is converted to speech.
- Visual Sync: As you listen, the app highlights the corresponding text in real-time.
- Quiz Time: Edumate generates 5-10 multiple-choice questions based on the source material to test your retention.
- Organization: Your summaries are stored in your library and can be organized into playlists for later review.
- 🚀 Advanced Seq2Seq Summarization: Upload any PDF and get a structured "Concept Map + Summary" generated natively bypassing basic prompts using Hugging Face BART-large-cnn pipelines.
- 🎵 Emotion-Aware Audio Experience: Listen to your summaries with high-quality Text-to-Speech adapting pacing automatically based on your RL performance and adopting unique voice expressions depending on subject matter semantics. Data synchronizes visually with highlighting.
- 🧠 Reinforcement Learning Quizzes: Deep Learning quiz generation tuned via T5 inference limits and logic-based distractors. Content difficulty automatically adapts to your past scores using a built-in Epsilon-greedy Bandits RL Tracker.
- 🔍 Intelligent RAG Retrieval: Powerful search using Hierarchical Chunking mapped directly through ChromaDB, explicitly verified and scored before generation using an MS-Marco Cross-Encoder Model ensuring zero-hallucination tracking.
- 📂 Personalized Playlists: Organize your summaries and quizzes into custom playlists for structured learning sessions.
- 🔐 Secure Authentication: Full authentication system supporting both Email/Password and Google Sign-in.
- 📊 Adaptive Progress Tracking: Earn scores on quizzes mapped secretly to your personalized learning Knowledge Vectors securely in MongoDB scaling your next outputs.
The backend is built with a seamlessly proxied and decentralized service-oriented architecture:
- API Layer: FastAPI provides high-performance, asynchronous endpoints tightly protecting schema signatures.
- Machine Learning Integration:
- Seq2Seq Inference (BART): Powers abstraction over long documents locally reducing latency overhead across REST endpoints.
- T5 Inference: Specifically tuned for deep learning quiz structure logic avoiding basic LLM hallucinations.
- Adaptive Engine (RL Tracker): Secure algorithm hooking MongoDB scores organically into personalized future generation pacing/metrics.
- ChromaDB + Cross Encoder RAG: A localized vector database managing hierarchical structures seamlessly re-ranked for ultimate query-awareness dynamically.
- Media Processing:
- Emotion-Aware TTS: Converts text summaries into adaptive natural-sounding audio natively scaling speeds alongside the RL engines.
- PDF Service: Hierarchical extraction clustering semantic sections contextually.
- Storage & Databases:
- MongoDB: Primary database for user profiles, summary metadata, quizzes, recursive embedded user vectors, and playlists.
- Cloudinary: Secure cloud storage for all uploaded PDFs and generated audio assets.
- Redis: Used for caching and session management.
A premium mobile experience built for performance:
- Expo Router: File-based routing for seamless navigation.
- NativeWind: Utility-first styling with Tailwind CSS for a sleek, modern UI.
- Zustand: Lightweight and fast state management.
- Audio Synchronization: Custom implementation using
expo-avto sync audio playback with text highlighting.
Edumate-app/
├── Edumate/ # Frontend (Expo/React Native)
│ ├── app/ # Expo Router screens
│ ├── components/ # Reusable UI components
│ ├── store/ # Zustand state management
│ └── api/ # Axios API services
└── backend/ # Backend (FastAPI)
├── app/
│ ├── routes/ # API Endpoints (Auth, Summarizer, Playlists)
│ ├── services/ # Business logic (Gemini, MongoDB, Cloudinary, TTS)
│ └── models/ # Pydantic & MongoDB models
└── main.py # Entry point- Node.js (v18+)
- Python (v3.10+)
- MongoDB Instance
- API Keys: Google Gemini, Cloudinary, Resend (for emails)
- Navigate to the backend directory:
cd backend - Create and activate a virtual environment:
python -m venv .venv source .venv/bin/activate # On Windows: .venv\Scripts\activate
- Install dependencies:
pip install -r requirements.txt
- Create a
.envfile based on the environment variables needed:MONGODB_URI=your_mongodb_uri GEMINI_API_KEY=your_gemini_key CLOUDINARY_CLOUD_NAME=your_name CLOUDINARY_API_KEY=your_key CLOUDINARY_API_SECRET=your_secret
- Run the server:
uvicorn main:app --reload
- Navigate to the Edumate directory:
cd Edumate - Install dependencies:
npm install
- Start the Expo development server:
npx expo start
Contributions are welcome! Please feel free to submit a Pull Request.
This project is licensed under the MIT License - see the LICENSE file for details.
Made by Prakhar Shrivastava for better learning !