Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
30 changes: 17 additions & 13 deletions fern/providers/model/anyscale.mdx
Original file line number Diff line number Diff line change
@@ -1,39 +1,43 @@
---
title: Anyscale
subtitle: Use an OpenAI-compatible Anyscale endpoint as the language model for your Vapi voice agent.
description: Connect Anyscale to Vapi to use an OpenAI-compatible endpoint as your voice agent's language model. Covers how to specify the model in the API.
subtitle: Connect Anyscale and configure a model available to your account.
description: Connect an Anyscale account to Vapi and configure an assistant with the exact model ID available through your Anyscale account.
slug: providers/model/anyscale
---

Anyscale is a large language model provider whose OpenAI-compatible endpoints serve open models. Connect Anyscale to use one as the LLM on a Vapi assistant. This page covers what Anyscale is and how to use it.

## What is Anyscale

Anyscale serves open large language models through an OpenAI-compatible API. Anyscale has no preset model list in Vapi. You enter the name of the model your Anyscale endpoint provides.
Anyscale provides OpenAI-compatible endpoints for serving language models. Use the Anyscale integration when you want your Vapi assistant to use a model available through your Anyscale account.

You can use Anyscale through Vapi's default integration, or use your own Anyscale account by connecting it in [Integrations](/providers/integrations).
## Connect Anyscale

{/* verify: Anyscale's public hosted LLM endpoints may be discontinued. Confirm the provider is still active before publishing this page. */}
Before using Anyscale, connect your account on the [Integrations](https://dashboard.vapi.ai/settings/integrations) page.

## Language model

Set `model.provider` to `anyscale` and `model.model` to a model your Anyscale endpoint serves.
Set `model.provider` to `anyscale`. Set `model.model` to the exact model ID available through your connected Anyscale account.

```bash
curl -X PATCH "https://api.vapi.ai/assistant/ASSISTANT_ID" \
-H "Authorization: Bearer $VAPI_API_KEY" \
-H "Content-Type: application/json" \
-d '{
"model": { "provider": "anyscale", "model": "YOUR_MODEL" }
"model": {
"provider": "anyscale",
"model": "YOUR_ANYSCALE_MODEL_ID"
}
}'
```

For additional API configuration options, review the [`AnyscaleModel` fields](/api-reference/assistants/create#request.body.model.AnyscaleModel) in the Create Assistant API reference.
For additional configuration options, review the [`AnyscaleModel` fields](/api-reference/assistants/create#request.body.model.AnyscaleModel) in the Create Assistant API reference.

## Related

<CardGroup cols={1}>
<Card title="Model providers" icon="brain" href="/providers/model/overview">
Compare every LLM provider Vapi supports.
<CardGroup cols={2}>
<Card title="Anyscale model serving" icon="arrow-up-right-from-square" href="https://docs.anyscale.com/llm/serving">
Learn how Anyscale serves language models through OpenAI-compatible endpoints.
</Card>
<Card title="Language models" icon="brain" href="/providers/model/overview">
Compare every language model provider Vapi supports.
</Card>
</CardGroup>
133 changes: 12 additions & 121 deletions fern/providers/model/deepinfra.mdx
Original file line number Diff line number Diff line change
@@ -1,144 +1,35 @@
---
title: DeepInfra
subtitle: Use a DeepInfra model as the language model for your Vapi voice agent.
description: Connect DeepInfra to Vapi and configure a model served by your DeepInfra account as your assistant's language model.
subtitle: Connect DeepInfra and configure any model available to your account.
description: Connect a DeepInfra account to Vapi and configure an assistant with an exact model ID from DeepInfra's current model catalog.
slug: providers/model/deepinfra
---

{/* Legacy marketing copy retained temporarily during provider-page standardization.
## What is DeepInfra

**What is DeepInfra?**
DeepInfra provides hosted inference for language models. Use the DeepInfra integration when you want your Vapi assistant to use a model available through your DeepInfra account.

DeepInfra is an innovative platform that provides scalable and cost-effective infrastructure for deploying machine learning models. By offering a simple API and autoscaling capabilities, DeepInfra allows businesses and developers to efficiently manage and deploy AI models, ensuring high performance and low latency. This platform supports a wide range of AI applications, making it an ideal solution for diverse industries.
## Connect DeepInfra


**The Evolution of AI Infrastructure:**

AI infrastructure has advanced from on-premises solutions to cloud-based platforms that offer flexibility, scalability, and cost efficiency. DeepInfra leverages these advancements to provide robust and scalable infrastructure, enabling seamless deployment and management of machine learning models.

**Overview of DeepInfra’s Offerings:**

DeepInfra offers a comprehensive suite of tools and services designed to support various AI applications:

**Machine Learning Models:**

DeepInfra provides access to a wide range of pre-trained machine learning models, including text generation, text-to-image, automatic speech recognition, and embeddings. These models are optimized for performance and can be easily integrated into various applications.


**API:**

DeepInfra’s API allows for easy integration of machine learning models into applications, offering low latency and high availability. The API supports various programming languages, making it accessible to a broad range of developers.

**Scalability:**

DeepInfra’s infrastructure is designed to scale automatically based on demand, ensuring optimal performance and cost efficiency. This scalability is crucial for handling large volumes of requests and maintaining low latency.

**Machine Learning Model Deployment:**

DeepInfra’s model deployment capabilities offer several key features and benefits:

**Features:**

- Low Latency Streaming: Ensures quick response times for real-time applications.
- High Availability: Delivers reliable performance even under heavy loads.
- Expressive Models: Provides high-quality outputs for various AI tasks.

**Benefits:**

- Efficiency: Reduces the time and resources needed for model deployment.
- Scalability: Handles large volumes of requests without compromising performance.
- Cost-Effectiveness: Offers pay-per-use pricing, minimizing upfront costs.

**Scalable Infrastructure:**

DeepInfra’s scalable infrastructure provides several advantages:

**Autoscaling:**

- Dynamic Resource Allocation: Automatically adjusts resources based on demand.
- Consistent Performance: Maintains low latency and high availability during peak usage.

**Low Latency:**

- Optimized Network: Ensures fast data transmission and processing.
- Regional Deployment: Deploys models close to users for reduced latency.


**Cost Efficiency:**

- Pay-per-Use Pricing: Charges based on actual usage, avoiding unnecessary costs.
- Resource Sharing: Maximizes infrastructure utilization, reducing overall expenses.

**Developer API:**

DeepInfra offers a robust API with comprehensive documentation and SDKs, facilitating seamless integration:

**Integration:**

- SDKs: Available for multiple programming languages.
- Low Latency: Supports real-time applications with quick response times.
- Documentation: Detailed guides and support for easy implementation.

**Use Cases:**

- Research: Efficiently access and analyze vast amounts of data.
- Application Development: Integrate advanced AI capabilities into applications.
- Business Intelligence: Gain insights for strategic decision-making.

**Use Cases for DeepInfra:**

DeepInfra’s versatile platform supports a wide range of applications:

**Research:**

Facilitate academic and scientific research with efficient and accurate AI model deployment.


**Application Development:**

Streamline the development process by integrating high-performance AI models into applications.

**Business Intelligence:**

Enhance business operations with powerful AI models that provide valuable insights and data analysis.

**Impact on AI Development:**

DeepInfra is revolutionizing AI development by providing tools that enhance productivity and efficiency. By automating the deployment process and offering scalable infrastructure, developers can focus on innovation and optimization rather than infrastructure management.


**Innovation and Research:**

DeepInfra is committed to continuous innovation and research in AI infrastructure. Their team of experts focuses on advancing the capabilities of machine learning models and exploring new applications, ensuring that they remain at the forefront of the industry.

**AI Safety and Ethics:**

Ensuring the ethical use of AI is a core principle at DeepInfra. They implement robust safeguards to prevent misuse of their technology and are actively involved in promoting responsible AI development. Protecting user data and maintaining transparency in AI operations are central to their mission.

**Integrations and Compatibility:**

DeepInfra’s API allows seamless integration with various platforms and applications. This ensures that users can incorporate DeepInfra’s AI capabilities into their existing systems effortlessly, enhancing functionality and improving user experience.

*/}

DeepInfra provides hosted model inference that you can use to generate your voice agent's responses. In Vapi, you supply the model ID served by DeepInfra rather than choosing from a Vapi-maintained model list.

You can use DeepInfra through Vapi's default integration, or use your own DeepInfra account by connecting it in [Integrations](/providers/integrations).
Before using DeepInfra, connect your account on the [Integrations](https://dashboard.vapi.ai/settings/integrations) page.

## Language model

Set `model.provider` to `deepinfra`. For `model.model`, use any model ID available to your DeepInfra account.
Set `model.provider` to `deepinfra`. Set `model.model` to the exact model ID from the [DeepInfra model catalog](https://docs.deepinfra.com/api-reference/models/models-list) that your connected account can access.

```bash
curl -X PATCH "https://api.vapi.ai/assistant/ASSISTANT_ID" \
-H "Authorization: Bearer $VAPI_API_KEY" \
-H "Content-Type: application/json" \
-d '{
"model": { "provider": "deepinfra", "model": "YOUR_MODEL" }
"model": {
"provider": "deepinfra",
"model": "YOUR_DEEPINFRA_MODEL_ID"
}
}'
```

For additional API configuration options, review the [`DeepInfraModel` fields](/api-reference/assistants/create#request.body.model.DeepInfraModel) in the Create Assistant API reference.
For additional configuration options, review the [`DeepInfraModel` fields](/api-reference/assistants/create#request.body.model.DeepInfraModel) in the Create Assistant API reference.

## Related

Expand Down
122 changes: 12 additions & 110 deletions fern/providers/model/openrouter.mdx
Original file line number Diff line number Diff line change
@@ -1,133 +1,35 @@
---
title: OpenRouter
subtitle: Use models from OpenRouter's dynamic catalog with your Vapi voice agent.
description: Connect OpenRouter to Vapi and use a text-generation model ID from OpenRouter's current model catalog.
subtitle: Connect OpenRouter and configure any model available to your account.
description: Connect an OpenRouter account to Vapi and configure an assistant with an exact model ID from OpenRouter's current model catalog.
slug: providers/model/openrouter
---

{/* Legacy marketing copy retained temporarily during provider-page standardization.
## What is OpenRouter

**What is OpenRouter?**
OpenRouter provides a single API for language models from multiple model developers. Use the OpenRouter integration when you want your Vapi assistant to use a model available through your OpenRouter account.

OpenRouter is a cutting-edge AI platform offering a unified interface for integrating multiple large language models (LLMs). Designed to streamline AI access, OpenRouter provides a comprehensive suite of tools and APIs that enable businesses and developers to leverage a variety of LLMs for diverse applications. This platform focuses on enhancing efficiency, scalability, and cost-effectiveness.
## Connect OpenRouter

**The Evolution of AI Integration:**

AI integration has significantly evolved from isolated systems to unified platforms that provide seamless access to multiple AI models. Advances in API technology, cloud computing, and machine learning have enabled platforms like OpenRouter to offer comprehensive solutions that cater to modern AI needs.

**Overview of OpenRouter’s Offerings:**

OpenRouter provides a range of AI-driven tools and services:

**LLM Access:**

OpenRouter offers access to a wide variety of LLMs, including models specialized in different tasks such as roleplaying, programming, marketing, and more. This allows users to select the best models for their specific needs.

**APIs:**

OpenRouter’s robust APIs enable developers to integrate LLM capabilities into their applications, ensuring low latency and high availability. The APIs support multiple programming languages, making them accessible to a broad range of developers.

**Unified Interface:**

OpenRouter provides a unified interface that simplifies the process of accessing and managing multiple AI models. This interface enhances usability and efficiency, making it easier to deploy and utilize AI solutions.


**AI Integration Technology:**

OpenRouter’s AI integration technology offers several key features and benefits:

**Features:**

- Unified Access: Provides a single interface for managing multiple AI models.
- High Availability: Ensures reliable performance even under heavy loads.
- Scalability: Easily scales to meet the demands of growing applications.


**Benefits:**

- Efficiency: Reduces the time and resources needed for AI integration.
- Flexibility: Supports a wide range of applications and use cases.
- Cost-Effectiveness: Offers competitive pricing compared to traditional solutions.

**Unified Access to LLMs:**

OpenRouter excels in providing unified access to multiple LLMs:

**Combining Multiple Models in One Interface:**

- Streamlined Management: Simplifies the process of accessing and managing different AI models.
- Diverse Applications: Supports various tasks, from programming to marketing.

**Developer API:**


OpenRouter offers a comprehensive API for easy integration:**

**Integration:**

- SDKs: Available for multiple programming languages.
- Comprehensive Documentation: Detailed guides and support for seamless implementation.

**Use Cases:**

- Business Solutions: Enhance operational efficiency and decision-making.
- Research: Facilitate academic and scientific research with advanced AI tools.
- Content Creation: Automate and optimize content production processes.

**Use Cases for OpenRouter:**

OpenRouter supports a wide range of applications across various sectors:

**Business Solutions:**

Leverage AI to improve business operations, enhance customer experiences, and drive innovation.


**Research:**

Utilize advanced AI tools to support academic and scientific research.

**Content Creation:**

Enhance content creation with high-quality AI-generated text, images, and more.

**Impact on AI Development:**

OpenRouter is transforming AI development by providing tools that enhance productivity and innovation. By offering scalable and cost-effective solutions, developers can focus on creating advanced AI applications without worrying about infrastructure constraints.

**Innovation and Research:**

OpenRouter is committed to continuous innovation and research in AI integration. Their team of experts focuses on advancing the capabilities of AI models and exploring new applications to stay at the forefront of the industry.


**AI Safety and Ethics:**

Ensuring the ethical use of AI is a core principle at OpenRouter. They implement robust safeguards to prevent misuse of their technology and are actively involved in promoting responsible AI development. Protecting user data and maintaining transparency in AI operations are central to their mission.

**Integrations and Compatibility:**

OpenRouter’s API allows seamless integration with various platforms and applications. This ensures that users can incorporate OpenRouter’s AI capabilities into their existing systems effortlessly, enhancing functionality and improving user experience.

*/}

OpenRouter provides a single API for a changing catalog of models from multiple model developers. In Vapi, you configure OpenRouter as the language-model provider and pass an OpenRouter model ID.

You can use OpenRouter through Vapi's default integration, or use your own OpenRouter account by connecting it in [Integrations](/providers/integrations).
Before using OpenRouter, connect your account on the [Integrations](https://dashboard.vapi.ai/settings/integrations) page.

## Language model

Set `model.provider` to `openrouter` and `model.model` to a text-generation model ID from the [OpenRouter model catalog](https://openrouter.ai/models). OpenRouter updates its catalog continuously, and Vapi accepts the model ID you provide instead of limiting this integration to a fixed model list.
Set `model.provider` to `openrouter`. Set `model.model` to the exact text-generation model ID from the [OpenRouter model catalog](https://openrouter.ai/models) that your connected account can access.

```bash
curl -X PATCH "https://api.vapi.ai/assistant/ASSISTANT_ID" \
-H "Authorization: Bearer $VAPI_API_KEY" \
-H "Content-Type: application/json" \
-d '{
"model": { "provider": "openrouter", "model": "YOUR_MODEL" }
"model": {
"provider": "openrouter",
"model": "YOUR_OPENROUTER_MODEL_ID"
}
}'
```

For additional API configuration options, review the [`OpenRouterModel` fields](/api-reference/assistants/create#request.body.model.OpenRouterModel) in the Create Assistant API reference.
For additional configuration options, review the [`OpenRouterModel` fields](/api-reference/assistants/create#request.body.model.OpenRouterModel) in the Create Assistant API reference.

## Related

Expand Down
Loading
Loading