| Price | Free | Free |
|---|
| Usage quota | Starter: 10 model credits monthly/month · Pro: 249 model credits monthly/month | Pro: 50 cloud usage multiplier vs-free · Max: 5 cloud usage multiplier vs pro |
|---|
| Seat count | Starter: Unlimited users: Yes · Pro: Unlimited users: Yes · Enterprise: Unlimited users: Yes | Team: 5 minimum seats; Usage included per seat: Yes |
|---|
| Storage | Starter: 1 processed data gb monthly/month · Pro: 5 processed data gb monthly/month | |
|---|
| Priority support | Starter: Priority support: No · Pro: Priority support: Yes · Enterprise: Priority support: Yes | |
|---|
| Other limits | Starter: 10000 scores monthly/month; 14 data retention days; 1 human review scores per project; Unlimited projects: Yes; Unlimited playgrounds: Yes; Unlimited experiments: Yes; Unlimited datasets: Yes; Custom charts: No; Environments: No; Custom data retention rules: No; S3 data export: No; Saml sso: No; Rbac: No; Dpa agreement: No; Baa agreement: No; Sla uptime: No; Loop agent: No; Playground annotations: No; Saved table views: Yes; Custom columns: Yes; Custom trace views: Yes · Pro: 50000 scores monthly/month; 30 data retention days; unlimited human review scores per project; Unlimited projects: Yes; Unlimited playgrounds: Yes; Unlimited experiments: Yes; Unlimited datasets: Yes; Custom charts: Yes; Environments: Yes; Custom data retention rules: No; S3 data export: No; Saml sso: No; Rbac: Yes; Dpa agreement: No; Baa agreement: No; Sla uptime: No; Loop agent: Yes; Playground annotations: Yes; Saved table views: Yes; Custom columns: Yes; Custom trace views: Yes · Enterprise: unlimited human review scores per project; Unlimited projects: Yes; Unlimited playgrounds: Yes; Unlimited experiments: Yes; Unlimited datasets: Yes; Custom charts: Yes; Environments: Yes; Custom data retention rules: Yes; S3 data export: Yes; Saml sso: Yes; Rbac: Yes; Dpa agreement: Yes; Baa agreement: Yes; Sla uptime: Yes; Loop agent: Yes; Playground annotations: Yes; Saved table views: Yes; Custom columns: Yes; Custom trace views: Yes | Free: 1 concurrent cloud models; Local model execution: Yes; Cloud model access: Yes; Private model upload: No · Pro: 3 concurrent cloud models; Private model upload: Yes · Max: 10 concurrent cloud models · Team: Shared billing: Yes |
|---|
| Roles & permissions | Role-based access control | |
|---|
| MCP | Model Context Protocol (MCP) server integration | |
|---|
| Multi-model | | Support for multiple models including Claude, Codex, OpenCode, Hermes Agent, OpenClaw |
|---|
| Agents | | Integration with coding agents |
|---|
| Overage cost | Starter: USD 4 per extra processed data gb · Pro: USD 3 per extra processed data gb | |
|---|
| Free trial | Starter: Free trial, no card required | |
|---|
| Billing commitment | | Pro: Monthly billing available |
|---|
| All stated limits | Starter: 10 model credits monthly/month; 1 processed data gb monthly/month; 10000 scores monthly/month; 14 data retention days; 1 human review scores per project; Unlimited users: Yes; Unlimited projects: Yes; Unlimited playgrounds: Yes; Unlimited experiments: Yes; Unlimited datasets: Yes; Custom charts: No; Environments: No; Custom data retention rules: No; S3 data export: No; Saml sso: No; Rbac: No; Dpa agreement: No; Baa agreement: No; Sla uptime: No; Priority support: No; Loop agent: No; Playground annotations: No; Saved table views: Yes; Custom columns: Yes; Custom trace views: Yes · Pro: 249 model credits monthly/month; 5 processed data gb monthly/month; 50000 scores monthly/month; 30 data retention days; unlimited human review scores per project; Unlimited users: Yes; Unlimited projects: Yes; Unlimited playgrounds: Yes; Unlimited experiments: Yes; Unlimited datasets: Yes; Custom charts: Yes; Environments: Yes; Custom data retention rules: No; S3 data export: No; Saml sso: No; Rbac: Yes; Dpa agreement: No; Baa agreement: No; Sla uptime: No; Priority support: Yes; Loop agent: Yes; Playground annotations: Yes; Saved table views: Yes; Custom columns: Yes; Custom trace views: Yes · Enterprise: unlimited human review scores per project; Unlimited users: Yes; Unlimited projects: Yes; Unlimited playgrounds: Yes; Unlimited experiments: Yes; Unlimited datasets: Yes; Custom charts: Yes; Environments: Yes; Custom data retention rules: Yes; S3 data export: Yes; Saml sso: Yes; Rbac: Yes; Dpa agreement: Yes; Baa agreement: Yes; Sla uptime: Yes; Priority support: Yes; Loop agent: Yes; Playground annotations: Yes; Saved table views: Yes; Custom columns: Yes; Custom trace views: Yes | Free: 1 concurrent cloud models; Local model execution: Yes; Cloud model access: Yes; Private model upload: No · Pro: 3 concurrent cloud models; 50 cloud usage multiplier vs-free; Private model upload: Yes · Max: 10 concurrent cloud models; 5 cloud usage multiplier vs pro · Team: 5 minimum seats; Shared billing: Yes; Usage included per seat: Yes |
|---|
| Quality | Catalog score 42 | Catalog score 65 |
|---|
| Privacy | Residency: Hybrid deployment available on Enterprise. Retention: 14 days (Starter), 30 days (Pro), custom (Enterprise) | Does not train on user data. Residency: Primarily United States, with routing to Europe and Singapore for additional capacity. Retention: Zero data retention for cloud models |
|---|
| Integrations | Python SDK, TypeScript SDK, Go SDK, Ruby SDK, C# SDK, Model Context Protocol (MCP), S3, OAuth providers, SAML identity providers | Claude Code, Codex, OpenCode, Hermes Agent, OpenClaw, VS Code, Pi, n8n |
|---|
| API | Yes | Yes |
|---|
| Offline | No | Yes |
|---|
| Regional availability | | EU, SG, US |
|---|
| Learning curve | Intermediate | Intermediate |
|---|
| Model choice | | gpt-5.6-sol, claude-fable-5, kimi-k3, deepseek-v4-pro, DeepSeek v4 Flash, gpt-oss:20b |
|---|
| Agent / MCP | Yes | |
|---|