Using ai-gradio with Novita AI: A Comprehensive Guide

AI-gradio is a Python package built on top of Gradio that empowers developers to build interactive AI demos and APIs effortlessly using Gradio’s intuitive framework. By integrating AI-Gradio with Novita AI, developers will unlock unparalleled potential through Novita AI’s cutting-edge large language models (LLMs). This article offers a comprehensive guide for you to learn how to leverage this powerful combination.

Key Features and Functions of ai-gradio

• Multi-Provider Support: This connects seamlessly with 15+ leading AI services including OpenAI, Google Gemini, Anthropic, and many others.
• Text Chat: This builds engaging dialogue interfaces compatible with all text-based AI models.
• Voice Chat: This creates immersive speech-based experiences with OpenAI’s audio processing capabilities.
• Video Chat: This unlocks visual processing functionalities through Google Gemini’s video analysis technology
• Code Generation: This implements specialized programming assistance interfaces with syntax highlighting.
• Multi-Modal: This handles diverse content types including text, images, and video in a single interface
• Agent Teams: This leverages CrewAI integration for complex problem-solving with coordinated AI agents.
• Browser Automation: This deploys intelligent agents capable of performing sophisticated internet-based tasks independently.

Supporting Models of Novita AI in ai-gradio

• meta-llama/llama-3.3-70b-instruct
• meta-llama/llama-3.1-8b-instruct
• meta-llama/llama-3.1-70b-instruct
• meta-llama/llama-3-8b-instruct
• meta-llama/llama-3-70b-instruct
• meta-llama/llama-3.2-1b-instruct
• meta-llama/llama-3.2-11b-vision-instruct
• meta-llama/llama-3.2-3b-instruct
• meta-llama/llama-3.1-8b-instruct-bf16
• deepseek/deepseek-r1
• deepseek/deepseek_v3
• deepseek/deepseek-r1-distill-llama-70b
• deepseek/deepseek-r1-distill-qwen-14b
• deepseek/deepseek-r1-distill-qwen-32b
• deepseek/deepseek-r1-distill-llama-8b
• mistralai/mistral-nemo
• mistralai/mistral-7b-instruct
• teknium/openhermes-2.5-mistral-7b
• microsoft/wizardlm-2-8x22b
• gryphe/mythomax-l2-13b
• qwen/qwen-2.5-72b-instruct
• qwen/qwen-2-vl-72b-instruct
• qwen/qwen-2-7b-instruct

How to Install ai-gradio

# Install core package
pip install ai-gradio

# Install with specific provider support
pip install 'ai-gradio[openai]'     # OpenAI support
pip install 'ai-gradio[gemini]'     # Google Gemini support
pip install 'ai-gradio[anthropic]'  # Anthropic Claude support
pip install 'ai-gradio[groq]'       # Groq support

# Install all providers
pip install 'ai-gradio[all]'

How to use Novita AI’s LLMs in ai-gradio

Step 1: Set up environment variables.

• Set NOVITA_API_KEY to your Novita API key.

export NOVITA_API_KEY=<your api key>

Step 2: Modify the app.py entry file.

import gradio as gr
import ai_gradio
gr.load(
    name='novita:deepseek/deepseek-r1',
    src=ai_gradio.registry,
).launch()

Step 3: Run the app.py file with python.

Conclusion

Novita AI serves as the essential foundation for this strategic partnership, providing robust infrastructure that seamlessly powers the extensive array of cutting-edge AI models available through ai-gradio. This powerful integration democratizes access to advanced language AI technology, enabling developers and businesses to focus on innovative solutions and creative applications without the burden of managing complex technical infrastructure.

Frequently Asked Questions

Limited-time Offer

Novita AI now offers a Referral Program which can be a benefit for Helicone users: If someone is interested, users can share their invitation link/code, and both they and their referrals will receive $20 in credits to use with the DeepSeek R1 & V3 APIs.

About Novita AI

Novita AI is an AI cloud platform that offers developers an easy way to deploy AI models using our simple API, while also providing an affordable and reliable GPU cloud for building and scaling.