This is an MCP server that helps interact with and compare different GitHub Models.
- List available GitHub Models with metadata
- Compare responses from different models
- Filter and sort models by various criteria
- Comprehensive error handling and fallbacks
-
Install dependencies:
npm install
-
Set up environment variables: Copy
.env.template
to.env
and add your GitHub token:GITHUB_TOKEN=your_github_personal_access_token
-
Build the project
npm run build
-
Run the MCP server in development mode:
npx @modelcontextprotocol/inspector dist/index.js
-
Add the MCP server to Claude Desktop: In
claude_desktop_config.json
{ "mcpServers": { "GitHub Models Helper": { "command": "node", "args": [ "/absolute/path/to/gh-models-helper/dist/index.js" ], "env": { "GITHUB_TOKEN": "your_github_personal_access_token" } } } }
Try variants on these prompts to see the MCP server in action:
- "list all available phi-3 models"
- "compare Phi-3-mini-4k-instruct and mistral-small on this prompt: how many ns in bananasss??"
- "Do a comparison between the Phi-4, gpt-4o-mini, and mistral-small models"