confident-ai.com
Confident AI is a platform for evaluating, observing, and improving AI systems, including LLM evaluations, tracing, prompt management, and annotations. It also maintains DeepEval, an open-source LLM evaluation framework that integrates with the Confident AI platform.
Confident AI exposes a hosted MCP server and the DeepEval Python CLI; both authenticate with a Confident AI project API key.
- Confident AI MCP Serverdiscovered
- DeepEval CLIdiscovered
Sign in to Confident AI or create an account from Sign Up. In the platform Settings page, copy the Project API Key. The DeepEval setup guide says you can also run deepeval login and paste the key when prompted, or pass it directly with deepeval login --confident-api-key "<your-confident-api-key>". The key is commonly stored as CONFIDENT_API_KEY.
conventions · 0/7 published
- integrations.json——
- llms.txt✗
/llms.txt - API catalog✗
/.well-known/api-catalog - OpenAPI document✗
/api/schema/, /openapi.json, /swagger.json, /api/openapi.json, or /v1/openapi.json - MCP server card✗
/.well-known/mcp/server-card.json - OAuth protected resource✗
/.well-known/oauth-protected-resource - Agent card✗
/.well-known/agent-card.json - Agent skills✗
/.well-known/agent-skills/index.json
Publish these signals → /publishing