PegaFlow External KV Cache for vLLM
PegaFlow external KV cache helps vLLM serving teams preserve and share KV cache across restarts, instances, and RDMA nodes.
PegaFlow external KV cache helps vLLM serving teams preserve and share KV cache across restarts, instances, and RDMA nodes.
Configure Novita AI as a native provider in Goose. Access 200+ open-source models at $0.02/M tokens for agentic coding workflows.
DeepSeek-V4-Pro is a 1.6T-parameter open-source MoE model delivering 1 LiveCodeBench score (93.5) and 1M-token context. Available now via Novita AI.
DeepSeek-V4-Flash is available via Novita AI with the July 31, 2026 refresh. Same 284B/13B MoE design, 1M context, and $0.14/$0.28 pricing.
Ling-2.6-1T is Ant Group's trillion-scale model built on MLA + Hybrid Linear Attention — not standard MoE. It achieves open-source SOTA on agent benchmarks (SWE-bench, BFCLv4, TAU2
AI agents have different infrastructure needs than chatbots. Learn the 5 criteria — tool calling, context, burst traffic, cold start, concurrency
Ling-2.6-flash is a 104B MoE model (7.4B active) delivering 340 tokens/s and 7x better token efficiency than Nemotron-3-Super on agent benchmarks. Available now via OpenRouter with
Compare top inference API providers for open-source models: pricing, model coverage, and output quality across Novita AI, Together AI, Fireworks, DeepInfra, and Groq.
Kimi K2.6 is now on Novita AI. 1T MoE open-source model, 256K context, 58.6% SWE-Bench Pro — built for long-horizon agentic coding. Try free via OpenAI-compatible API.
Discover the top 8 AI inference platforms in 2026. Compare features, pricing, and performance of leading providers like Novita AI, Together AI, and Groq.
Discover how to access Kimi K2.5 through web playground, API, or local deployment with minimal setup time.
Unlock the power of MiniMax M2.5 on Novita for cost-effective AI coding at exceptional speeds and performance.
MiniMax M2.7 now on Novita AI at $0.3/Mt. Self-evolving reasoning model with 97% tool adherence and production-grade agent capabilities.
Explore GLM 4.7 API Provider options to find the best balance of cost, speed, and flexibility for your deployment needs.