Model Providers Overview

Documentation Index

Fetch the complete documentation index at: https://mintlify.com/firebase/genkit/llms.txt

Use this file to discover all available pages before exploring further.

​

Supported Providers

​

Google AI Providers

• Google AI (Gemini Developer API) - Quick access to Gemini models with API key authentication. Ideal for prototyping and smaller projects.
• Vertex AI - Enterprise-grade Google Cloud AI platform with advanced features, IAM integration, and broader model access including Imagen, Lyria, and Model Garden.

​

Third-Party Providers

• Anthropic - Access to Claude models (Haiku, Sonnet, Opus) with advanced reasoning capabilities.
• OpenAI-Compatible APIs - Support for OpenAI, xAI (Grok), DeepSeek, and any OpenAI-compatible endpoint.
• Ollama - Run open-source models locally for privacy and offline usage.

​

Custom Providers

• Custom Providers - Build your own model provider plugin to integrate any AI service.

​

Provider Comparison

​

How to Choose a Provider

​

For Prototyping

import { genkit } from 'genkit';
import { googleAI } from '@genkit-ai/google-genai';

const ai = genkit({
  plugins: [googleAI()],
});

const { text } = await ai.generate({
  model: googleAI.model('gemini-2.5-flash'),
  prompt: 'Explain quantum computing',
});

​

For Production

• IAM-based access control
• Integration with other Google Cloud services
• Model versioning and governance
• Access to Model Garden (Anthropic, Meta, and more)
• Vector Search for RAG applications

​

For Advanced Reasoning

• Extended thinking for complex problem-solving
• Document citations for factual accuracy
• Long context windows (200K+ tokens)
• Prompt caching for efficiency

​

For Local Development

• Privacy (data never leaves your machine)
• Offline capabilities
• No API costs
• Experimentation with open-source models

​

For OpenAI Compatibility

• OpenAI (GPT-4o, o1, etc.)
• xAI (Grok models)
• DeepSeek
• Any service with an OpenAI-compatible API

​

Installation

# Google AI
npm install @genkit-ai/google-genai

# Anthropic
npm install @genkit-ai/anthropic

# OpenAI-compatible
npm install @genkit-ai/compat-oai

# Ollama
npm install genkitx-ollama

​

Using Multiple Providers

import { genkit } from 'genkit';
import { googleAI } from '@genkit-ai/google-genai';
import { anthropic } from '@genkit-ai/anthropic';
import { ollama } from 'genkitx-ollama';

const ai = genkit({
  plugins: [
    googleAI(),
    anthropic({ apiKey: process.env.ANTHROPIC_API_KEY }),
    ollama({
      models: [{ name: 'llama3' }],
      serverAddress: 'http://localhost:11434',
    }),
  ],
});

// Use different models for different tasks
const summary = await ai.generate({
  model: googleAI.model('gemini-2.5-flash'),
  prompt: 'Summarize this text...',
});

const analysis = await ai.generate({
  model: anthropic.model('claude-sonnet-4-5'),
  prompt: 'Analyze this data...',
});

const local = await ai.generate({
  model: ollama.model('llama3'),
  prompt: 'Generate a response...',
});

​

Next Steps

• Set up Google AI provider
• Set up Vertex AI
• Set up Anthropic
• Configure OpenAI-compatible APIs
• Run local models with Ollama
• Build a custom provider