Skip to content

Latest commit

 

History

History
591 lines (400 loc) · 25.1 KB

README.md

File metadata and controls

591 lines (400 loc) · 25.1 KB

AI Launchpad Projects

MLOps Projects

  • 📂 aibrix
    Cost-efficient and pluggable infrastructure components for GenAI inference.

  • 📂 R2R
    The most advanced AI retrieval system. Agentic Retrieval-Augmented Generation (RAG) with a RESTful API.

  • 📂 LitServe
    Lightning-fast serving engine for any AI model of any size. Flexible, easy, and enterprise-scale.

  • 📂 docling
    A document processing framework for AI-driven extraction and analysis.

  • 📂 Metaflow
    Build, deploy, and manage AI/ML systems - from Netflix.

  • 📂 APIPark
    An open-source platform for creating, managing, and deploying APIs for AI applications.

  • 📂 Beta9
    Run serverless GPU workloads with fast cold starts on bare-metal servers, anywhere in the world.

  • 📂 dstack
    A lightweight, open-source alternative to Kubernetes & Slurm, simplifying AI container orchestration with multi-cloud and on-prem support. Natively supports NVIDIA, AMD, TPU, and Intel accelerators.

  • 📂 n8n
    Fair-code workflow automation platform with native AI capabilities. Combines visual building with custom code, self-host or cloud, 400+ integrations.

  • 🌐 k0rdent
    A platform for building and deploying AI-driven solutions (details limited).

  • 📂 Haystack
    An open-source framework for building search systems with NLP and LLMs.

  • 📂 Jina Serve
    Build multimodal AI applications with a cloud-native stack.

  • 📂 exo
    Run your own AI cluster at home with everyday devices.

  • 📂 Oumi
    Everything you need to build state-of-the-art foundation models, end-to-end.

  • 📂 Seldon Core
    An open-source platform for deploying machine learning models at scale.

  • 📖 vLLM
    A high-performance LLM serving framework; hard to configure and deploy.

  • 🌐 BentoML
    A framework for building, shipping, and scaling AI applications with ease.

    • 🌐 Yatai Model Deployment at Scale on Kubernetes 🦄️

  • 📂 OpenLLM
    Run any open-source LLMs (e.g., Llama, Mistral) as OpenAI-compatible API endpoints in the cloud.

  • 📂 LMDeploy
    A toolkit for deploying large language models efficiently.

  • 📂 KubeAI
    Private Open AI on Kubernetes – very easy to test locally.

  • 🌐 Ray
    A distributed computing framework for scaling AI and Python workloads.

  • 📂 Flyte
    A workflow automation platform for data and ML; similar to Ray.

  • 📖 SkyPilot
    A framework for running AI workloads across clouds with cost optimization.

  • 🌐 KubeFlow
    An open-source platform for deploying and managing ML workflows on Kubernetes.

  • 🌐 MLFlow
    An open-source platform for managing the end-to-end machine learning lifecycle.

  • 🌐 ZenML
    An extensible, open-source MLOps framework for reproducible ML pipelines.

  • 📂 KAN
    Kolmogorov-Arnold Networks for AI modeling on Azure.

  • 📂 LangChain
    A framework for developing applications powered by language models.

  • 📂 LangGraph
    A library for building stateful, multi-agent LLM applications.

  • 📂 LangGraph GUI
    A graphical interface for LangGraph workflows.

  • 📂 LangServe
    A tool for deploying LangChain apps as APIs; deprecated by:

  • 📂 Mage AI
    An open-source tool for building, running, and managing data pipelines.

  • 🌐 Argilla
    A collaboration platform for building high-quality datasets for NLP.

  • 📜 Great LangChain Projects
    A curated list of notable LangChain-dependent projects.

  • 📂 ClearML
    An open-source MLOps platform for experiment tracking and automation.

  • 📂 MindsDB
    An open-source platform for applying ML to databases.

  • 📂 H2O AI
    A suite of tools for building and deploying ML models.

  • 📂 KServe
    A Kubernetes-based serverless ML inference platform from Red Hat.

  • 📂 TrustyAI Explainability
    Tools for explainable AI, from Red Hat.

  • 🌐 LLaMA Index
    Turn your data into production-ready LLM applications.

  • 📂 OPEA Project
    Open Platform for Enterprise AI, from Intel – runs on Xeon and Gaudi (as of 2024-10-20).

  • 📜 AWS MLOps Samples
    A collection of MLOps examples for AWS SageMaker.

  • 📂 Data on EKS
    Deploy data and ML workloads on Amazon EKS.

  • 📂 Kubernetes LWS Project
    Lightweight Workload Specification for Kubernetes.

  • 📂 Danswer
    An AI-powered question-answering system for enterprise knowledge bases.

    • Similar projects:
      • 📂 Continue: An open-source autopilot for software development.
      • 📂 Dataline: A data processing and visualization tool.

  • 📂 Plandex
    An AI-driven terminal for planning and executing coding tasks.

  • 📂 Alluxio
    Data orchestration for analytics and machine learning in the cloud.

  • 📜 FastChat
    An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

  • 📂 LiteLLM
    A lightweight library for calling LLM APIs with a unified interface.

  • 📂 Vespa
    Search, make inferences in, and organize vectors, tensors, text, and structured data, at serving time and any scale.

  • 📂 Pezzo
    An open-source platform for managing and optimizing LLM operations.

  • 📂 Bolt.new
    A platform for building AI-powered apps with any LLM.

  • 📂 TensorZero
    A framework for scalable tensor operations in AI workflows.

  • 📖 LiteLLM Proxy Server
    A proxy server for routing requests to multiple LLM providers.

Prompt Engineering

Responsible LLM

  • 📂 Awesome Production ML
    A collection of resources for ethical and production-ready ML.

  • 🌐 Guardrails AI
    A framework for adding safety and compliance to LLM applications.

  • 🌐 E2B
    A sandbox environment for running AI agents securely.

Vector Databases

  • 📖 Chroma
    An open-source vector database for AI applications.

  • 📂 FAISS
    A library for efficient similarity search and clustering of dense vectors.

  • 🌐 Pinecone
    A managed vector database for building AI-powered search.

  • 🌐 Qdrant
    A high-performance vector database for similarity search.

Coding Agents

Projects that can finish apps autonomously or assist with troubleshooting:

  • 📂 Fragments
    A tool for generating code snippets using AI agents.

  • 🌐 Bolt.new
    A web-based platform for rapid AI-driven app development.

  • 🌐 V0
    A generative UI tool powered by AI.

  • 🌐 Lovable
    An AI-assisted platform for building software.

  • 📝 Claude Artifacts
    Interactive code and content generation from Anthropic’s Claude.

  • 📂 Vercel AI Chatbot
    A full-featured, hackable Next.js AI chatbot built by Vercel.

  • 📂 CodeAct
    An agent framework for autonomous code execution.

  • 📂 OpenHands
    An open-source AI coding assistant for software development.

  • 📂 SWE-Agent
    An agent for solving software engineering tasks, from Princeton NLP.

  • 📂 Goose
    An AI agent for code execution and testing.

  • 📂 MetaGPT
    A multi-agent framework for simulating a software company with LLMs.

  • 📂 Multi-Agent Orchestrator
    A framework for coordinating multiple AI agents, from AWS Labs.

Blogs

UI

  • 🌐 Streamlit
    A framework for building interactive data apps in Python.

  • 🌐 Gradio
    A tool for creating web-based interfaces for ML models.

  • 📖 Chainlit
    A library for building conversational AI interfaces.

Security

  • 📂 Garak
    A tool for testing LLM vulnerabilities, from NVIDIA.

  • 📂 LLM Backdoor
    Research on backdoor attacks in large language models.

Courses

  • 📂 LLM Course
    A comprehensive course on building LLM applications.

  • 📚 LLM Apps: Evaluation
    A course on evaluating LLM applications with Weights & Biases.

Tutorials

Training and Fine-Tuning

Learn by Videos

Platforms

  • 📂 Dify
    An open-source platform for building AI-native applications.

GitHub Organizations

Agent Frameworks

  • 📂 Surf
    A computer-use AI agent powered by OpenAI, interacting with E2B's virtual desktop environment via natural language.

  • 📂 Letta
    Formerly MemGPT – a stateful agents framework with memory, reasoning, and context management.

  • 📂 OctoTools
    An agentic framework with extensible tools for complex reasoning.

  • 📂 AI Companion
    Meet Ava, the WhatsApp Agent.

  • 📂 MAGMA
    A Foundation Model for Multimodal AI Agents from Microsoft.

  • 📂 Autogen
    A multi-agent conversation framework from Microsoft.

  • 📂 CrewAI
    A framework for orchestrating role-playing AI agents.

  • 📂 LangFlow
    A visual framework for building LLM-powered applications.

  • 📂 FlowWise
    A drag-and-drop tool for creating LLM workflows.

  • 📂 Julep
    Not fully open-sourced – a new DSL and server for AI agents and multi-step tasks.

  • 📂 Vision Agent
    An AI agent for vision-based tasks.

  • 📂 Parlant
    A customer-facing LLM-agent framework to increase accuracy and reliability.

  • 📂 Tribe
    Low-code tool to rapidly build and coordinate multi-agent teams.

  • 📂 Goose
    An extensible AI agent that installs, executes, edits, and tests with any LLM.

  • 📂 SlackAgent An AI agent integrated with Slack for workflow automation.

  • 📂 LightAgent
    A highly lightweight, active Agentic Framework designed for multi-agent collaboration, resembling a swarm

  • 📂 Refact
    AI Agent that handles engineering tasks end-to-end

Deep Research

LLM-Based Scrapers

  • 📂 ScrapeGraphAI
    Python scraper based on AI for web data extraction.

  • 📂 FireCrawl
    A web crawler optimized for LLM data collection.

  • 📂 Crawl4AI
    An AI-powered web crawling framework.

  • 📂 Tourist
    A lightweight scraper for LLM training data.

  • 📂 GPT-Crawler
    A crawler designed for GPT-based data gathering.

Autonomous Software Engineering

  • 📂 OpenHands
    An open-source AI coding assistant for autonomous software development.

  • 📂 AutoCodeRover
    An autonomous code generation and debugging tool.

  • 📂 SWE-bench
    Multimodal: Can Language Models Resolve Real-World GitHub Issues?

  • 📂 Web UI
    A web-based UI for autonomous software engineering.

  • 📂 OpenManus
    An open platform for autonomous AI development.

Evaluation, Observability, and Monitoring

  • 📂 Helicone
    An observability platform for LLM applications.

  • 📂 DeepEval
    The LLM Evaluation Framework.

  • 📂 LangFuse
    Open-source LLM engineering platform: observability, metrics, evals, prompt management, playground, datasets. Integrates with LlamaIndex, LangChain, OpenAI SDK, LiteLLM, and more. YC W23.

  • 📂 Opik
    Debug, evaluate, and monitor LLM applications, RAG systems, and agentic workflows with tracing, automated evaluations, and production-ready dashboards.

  • 📂 OptiLLM
    Optimizing inference proxy for LLMs.

  • 📂 Phoenix
    AI Observability & Evaluation platform.

Awesomeness

  • 📂 Awesome LLM
    A curated list of awesome LLM resources.

LangGraph Examples and Tutorials

MCP

  • 📂 Awesome MCP Servers
    A list of MCP (Model Context Protocol) servers.

  • 📂 Agent Toolkit
    Tools for implementing MCP in AI agents.

  • 📂 MCP Server Axiom
    An Axiom-based MCP server implementation.

  • 📂 TFMCP
    A TensorFlow-based MCP project.

  • 📂 FastAPI MCP A zero-configuration tool for automatically exposing FastAPI endpoints as Model Context Protocol (MCP) tools.

Aggregation Sites

  • 🌐 Smithery AI
    An aggregation site for AI tools and resources.

  • 🌐 MCP.so
    A hub for Model Context Protocol resources.

LLM API Pricing

Datasets

  • 📂 LLM Datasets
    A collection of datasets for LLM training and evaluation.

Manus Related

  • 📂 CortexON
    An agentic AI framework for cognitive tasks.

  • 📂 UI-TARS Desktop
    A GUI Agent application based on UI-TARS (Vision-Language Model) to control your computer using natural language.

  • 📂 OpenManus
    No fortress, purely open ground. OpenManus is coming.

  • 📂 LangManus
    A language-driven Manus framework.