diff --git a/fern/providers/model/anyscale.mdx b/fern/providers/model/anyscale.mdx index 7af5331e4..aeb40ac12 100644 --- a/fern/providers/model/anyscale.mdx +++ b/fern/providers/model/anyscale.mdx @@ -1,39 +1,43 @@ --- title: Anyscale -subtitle: Use an OpenAI-compatible Anyscale endpoint as the language model for your Vapi voice agent. -description: Connect Anyscale to Vapi to use an OpenAI-compatible endpoint as your voice agent's language model. Covers how to specify the model in the API. +subtitle: Connect Anyscale and configure a model available to your account. +description: Connect an Anyscale account to Vapi and configure an assistant with the exact model ID available through your Anyscale account. slug: providers/model/anyscale --- -Anyscale is a large language model provider whose OpenAI-compatible endpoints serve open models. Connect Anyscale to use one as the LLM on a Vapi assistant. This page covers what Anyscale is and how to use it. - ## What is Anyscale -Anyscale serves open large language models through an OpenAI-compatible API. Anyscale has no preset model list in Vapi. You enter the name of the model your Anyscale endpoint provides. +Anyscale provides OpenAI-compatible endpoints for serving language models. Use the Anyscale integration when you want your Vapi assistant to use a model available through your Anyscale account. -You can use Anyscale through Vapi's default integration, or use your own Anyscale account by connecting it in [Integrations](/providers/integrations). +## Connect Anyscale -{/* verify: Anyscale's public hosted LLM endpoints may be discontinued. Confirm the provider is still active before publishing this page. */} +Before using Anyscale, connect your account on the [Integrations](https://dashboard.vapi.ai/settings/integrations) page. ## Language model -Set `model.provider` to `anyscale` and `model.model` to a model your Anyscale endpoint serves. +Set `model.provider` to `anyscale`. Set `model.model` to the exact model ID available through your connected Anyscale account. ```bash curl -X PATCH "https://api.vapi.ai/assistant/ASSISTANT_ID" \ -H "Authorization: Bearer $VAPI_API_KEY" \ -H "Content-Type: application/json" \ -d '{ - "model": { "provider": "anyscale", "model": "YOUR_MODEL" } + "model": { + "provider": "anyscale", + "model": "YOUR_ANYSCALE_MODEL_ID" + } }' ``` -For additional API configuration options, review the [`AnyscaleModel` fields](/api-reference/assistants/create#request.body.model.AnyscaleModel) in the Create Assistant API reference. +For additional configuration options, review the [`AnyscaleModel` fields](/api-reference/assistants/create#request.body.model.AnyscaleModel) in the Create Assistant API reference. ## Related - - - Compare every LLM provider Vapi supports. + + + Learn how Anyscale serves language models through OpenAI-compatible endpoints. + + + Compare every language model provider Vapi supports. diff --git a/fern/providers/model/deepinfra.mdx b/fern/providers/model/deepinfra.mdx index 45699ab89..4bf491ee9 100644 --- a/fern/providers/model/deepinfra.mdx +++ b/fern/providers/model/deepinfra.mdx @@ -1,144 +1,35 @@ --- title: DeepInfra -subtitle: Use a DeepInfra model as the language model for your Vapi voice agent. -description: Connect DeepInfra to Vapi and configure a model served by your DeepInfra account as your assistant's language model. +subtitle: Connect DeepInfra and configure any model available to your account. +description: Connect a DeepInfra account to Vapi and configure an assistant with an exact model ID from DeepInfra's current model catalog. slug: providers/model/deepinfra --- -{/* Legacy marketing copy retained temporarily during provider-page standardization. +## What is DeepInfra -**What is DeepInfra?** +DeepInfra provides hosted inference for language models. Use the DeepInfra integration when you want your Vapi assistant to use a model available through your DeepInfra account. -DeepInfra is an innovative platform that provides scalable and cost-effective infrastructure for deploying machine learning models. By offering a simple API and autoscaling capabilities, DeepInfra allows businesses and developers to efficiently manage and deploy AI models, ensuring high performance and low latency. This platform supports a wide range of AI applications, making it an ideal solution for diverse industries. +## Connect DeepInfra - -**The Evolution of AI Infrastructure:** - -AI infrastructure has advanced from on-premises solutions to cloud-based platforms that offer flexibility, scalability, and cost efficiency. DeepInfra leverages these advancements to provide robust and scalable infrastructure, enabling seamless deployment and management of machine learning models. - -**Overview of DeepInfra’s Offerings:** - -DeepInfra offers a comprehensive suite of tools and services designed to support various AI applications: - -**Machine Learning Models:** - -DeepInfra provides access to a wide range of pre-trained machine learning models, including text generation, text-to-image, automatic speech recognition, and embeddings. These models are optimized for performance and can be easily integrated into various applications. - - -**API:** - -DeepInfra’s API allows for easy integration of machine learning models into applications, offering low latency and high availability. The API supports various programming languages, making it accessible to a broad range of developers. - -**Scalability:** - -DeepInfra’s infrastructure is designed to scale automatically based on demand, ensuring optimal performance and cost efficiency. This scalability is crucial for handling large volumes of requests and maintaining low latency. - -**Machine Learning Model Deployment:** - -DeepInfra’s model deployment capabilities offer several key features and benefits: - -**Features:** - -- Low Latency Streaming: Ensures quick response times for real-time applications. -- High Availability: Delivers reliable performance even under heavy loads. -- Expressive Models: Provides high-quality outputs for various AI tasks. - -**Benefits:** - -- Efficiency: Reduces the time and resources needed for model deployment. -- Scalability: Handles large volumes of requests without compromising performance. -- Cost-Effectiveness: Offers pay-per-use pricing, minimizing upfront costs. - -**Scalable Infrastructure:** - -DeepInfra’s scalable infrastructure provides several advantages: - -**Autoscaling:** - -- Dynamic Resource Allocation: Automatically adjusts resources based on demand. -- Consistent Performance: Maintains low latency and high availability during peak usage. - -**Low Latency:** - -- Optimized Network: Ensures fast data transmission and processing. -- Regional Deployment: Deploys models close to users for reduced latency. - - -**Cost Efficiency:** - -- Pay-per-Use Pricing: Charges based on actual usage, avoiding unnecessary costs. -- Resource Sharing: Maximizes infrastructure utilization, reducing overall expenses. - -**Developer API:** - -DeepInfra offers a robust API with comprehensive documentation and SDKs, facilitating seamless integration: - -**Integration:** - -- SDKs: Available for multiple programming languages. -- Low Latency: Supports real-time applications with quick response times. -- Documentation: Detailed guides and support for easy implementation. - -**Use Cases:** - -- Research: Efficiently access and analyze vast amounts of data. -- Application Development: Integrate advanced AI capabilities into applications. -- Business Intelligence: Gain insights for strategic decision-making. - -**Use Cases for DeepInfra:** - -DeepInfra’s versatile platform supports a wide range of applications: - -**Research:** - -Facilitate academic and scientific research with efficient and accurate AI model deployment. - - -**Application Development:** - -Streamline the development process by integrating high-performance AI models into applications. - -**Business Intelligence:** - -Enhance business operations with powerful AI models that provide valuable insights and data analysis. - -**Impact on AI Development:** - -DeepInfra is revolutionizing AI development by providing tools that enhance productivity and efficiency. By automating the deployment process and offering scalable infrastructure, developers can focus on innovation and optimization rather than infrastructure management. - - -**Innovation and Research:** - -DeepInfra is committed to continuous innovation and research in AI infrastructure. Their team of experts focuses on advancing the capabilities of machine learning models and exploring new applications, ensuring that they remain at the forefront of the industry. - -**AI Safety and Ethics:** - -Ensuring the ethical use of AI is a core principle at DeepInfra. They implement robust safeguards to prevent misuse of their technology and are actively involved in promoting responsible AI development. Protecting user data and maintaining transparency in AI operations are central to their mission. - -**Integrations and Compatibility:** - -DeepInfra’s API allows seamless integration with various platforms and applications. This ensures that users can incorporate DeepInfra’s AI capabilities into their existing systems effortlessly, enhancing functionality and improving user experience. - -*/} - -DeepInfra provides hosted model inference that you can use to generate your voice agent's responses. In Vapi, you supply the model ID served by DeepInfra rather than choosing from a Vapi-maintained model list. - -You can use DeepInfra through Vapi's default integration, or use your own DeepInfra account by connecting it in [Integrations](/providers/integrations). +Before using DeepInfra, connect your account on the [Integrations](https://dashboard.vapi.ai/settings/integrations) page. ## Language model -Set `model.provider` to `deepinfra`. For `model.model`, use any model ID available to your DeepInfra account. +Set `model.provider` to `deepinfra`. Set `model.model` to the exact model ID from the [DeepInfra model catalog](https://docs.deepinfra.com/api-reference/models/models-list) that your connected account can access. ```bash curl -X PATCH "https://api.vapi.ai/assistant/ASSISTANT_ID" \ -H "Authorization: Bearer $VAPI_API_KEY" \ -H "Content-Type: application/json" \ -d '{ - "model": { "provider": "deepinfra", "model": "YOUR_MODEL" } + "model": { + "provider": "deepinfra", + "model": "YOUR_DEEPINFRA_MODEL_ID" + } }' ``` -For additional API configuration options, review the [`DeepInfraModel` fields](/api-reference/assistants/create#request.body.model.DeepInfraModel) in the Create Assistant API reference. +For additional configuration options, review the [`DeepInfraModel` fields](/api-reference/assistants/create#request.body.model.DeepInfraModel) in the Create Assistant API reference. ## Related diff --git a/fern/providers/model/openrouter.mdx b/fern/providers/model/openrouter.mdx index 1ed1e8176..19f62fc21 100644 --- a/fern/providers/model/openrouter.mdx +++ b/fern/providers/model/openrouter.mdx @@ -1,133 +1,35 @@ --- title: OpenRouter -subtitle: Use models from OpenRouter's dynamic catalog with your Vapi voice agent. -description: Connect OpenRouter to Vapi and use a text-generation model ID from OpenRouter's current model catalog. +subtitle: Connect OpenRouter and configure any model available to your account. +description: Connect an OpenRouter account to Vapi and configure an assistant with an exact model ID from OpenRouter's current model catalog. slug: providers/model/openrouter --- -{/* Legacy marketing copy retained temporarily during provider-page standardization. +## What is OpenRouter -**What is OpenRouter?** +OpenRouter provides a single API for language models from multiple model developers. Use the OpenRouter integration when you want your Vapi assistant to use a model available through your OpenRouter account. -OpenRouter is a cutting-edge AI platform offering a unified interface for integrating multiple large language models (LLMs). Designed to streamline AI access, OpenRouter provides a comprehensive suite of tools and APIs that enable businesses and developers to leverage a variety of LLMs for diverse applications. This platform focuses on enhancing efficiency, scalability, and cost-effectiveness. +## Connect OpenRouter -**The Evolution of AI Integration:** - -AI integration has significantly evolved from isolated systems to unified platforms that provide seamless access to multiple AI models. Advances in API technology, cloud computing, and machine learning have enabled platforms like OpenRouter to offer comprehensive solutions that cater to modern AI needs. - -**Overview of OpenRouter’s Offerings:** - -OpenRouter provides a range of AI-driven tools and services: - -**LLM Access:** - -OpenRouter offers access to a wide variety of LLMs, including models specialized in different tasks such as roleplaying, programming, marketing, and more. This allows users to select the best models for their specific needs. - -**APIs:** - -OpenRouter’s robust APIs enable developers to integrate LLM capabilities into their applications, ensuring low latency and high availability. The APIs support multiple programming languages, making them accessible to a broad range of developers. - -**Unified Interface:** - -OpenRouter provides a unified interface that simplifies the process of accessing and managing multiple AI models. This interface enhances usability and efficiency, making it easier to deploy and utilize AI solutions. - - -**AI Integration Technology:** - -OpenRouter’s AI integration technology offers several key features and benefits: - -**Features:** - -- Unified Access: Provides a single interface for managing multiple AI models. -- High Availability: Ensures reliable performance even under heavy loads. -- Scalability: Easily scales to meet the demands of growing applications. - - -**Benefits:** - -- Efficiency: Reduces the time and resources needed for AI integration. -- Flexibility: Supports a wide range of applications and use cases. -- Cost-Effectiveness: Offers competitive pricing compared to traditional solutions. - -**Unified Access to LLMs:** - -OpenRouter excels in providing unified access to multiple LLMs: - -**Combining Multiple Models in One Interface:** - -- Streamlined Management: Simplifies the process of accessing and managing different AI models. -- Diverse Applications: Supports various tasks, from programming to marketing. - -**Developer API:** - - -OpenRouter offers a comprehensive API for easy integration:** - -**Integration:** - -- SDKs: Available for multiple programming languages. -- Comprehensive Documentation: Detailed guides and support for seamless implementation. - -**Use Cases:** - -- Business Solutions: Enhance operational efficiency and decision-making. -- Research: Facilitate academic and scientific research with advanced AI tools. -- Content Creation: Automate and optimize content production processes. - -**Use Cases for OpenRouter:** - -OpenRouter supports a wide range of applications across various sectors: - -**Business Solutions:** - -Leverage AI to improve business operations, enhance customer experiences, and drive innovation. - - -**Research:** - -Utilize advanced AI tools to support academic and scientific research. - -**Content Creation:** - -Enhance content creation with high-quality AI-generated text, images, and more. - -**Impact on AI Development:** - -OpenRouter is transforming AI development by providing tools that enhance productivity and innovation. By offering scalable and cost-effective solutions, developers can focus on creating advanced AI applications without worrying about infrastructure constraints. - -**Innovation and Research:** - -OpenRouter is committed to continuous innovation and research in AI integration. Their team of experts focuses on advancing the capabilities of AI models and exploring new applications to stay at the forefront of the industry. - - -**AI Safety and Ethics:** - -Ensuring the ethical use of AI is a core principle at OpenRouter. They implement robust safeguards to prevent misuse of their technology and are actively involved in promoting responsible AI development. Protecting user data and maintaining transparency in AI operations are central to their mission. - -**Integrations and Compatibility:** - -OpenRouter’s API allows seamless integration with various platforms and applications. This ensures that users can incorporate OpenRouter’s AI capabilities into their existing systems effortlessly, enhancing functionality and improving user experience. - -*/} - -OpenRouter provides a single API for a changing catalog of models from multiple model developers. In Vapi, you configure OpenRouter as the language-model provider and pass an OpenRouter model ID. - -You can use OpenRouter through Vapi's default integration, or use your own OpenRouter account by connecting it in [Integrations](/providers/integrations). +Before using OpenRouter, connect your account on the [Integrations](https://dashboard.vapi.ai/settings/integrations) page. ## Language model -Set `model.provider` to `openrouter` and `model.model` to a text-generation model ID from the [OpenRouter model catalog](https://openrouter.ai/models). OpenRouter updates its catalog continuously, and Vapi accepts the model ID you provide instead of limiting this integration to a fixed model list. +Set `model.provider` to `openrouter`. Set `model.model` to the exact text-generation model ID from the [OpenRouter model catalog](https://openrouter.ai/models) that your connected account can access. ```bash curl -X PATCH "https://api.vapi.ai/assistant/ASSISTANT_ID" \ -H "Authorization: Bearer $VAPI_API_KEY" \ -H "Content-Type: application/json" \ -d '{ - "model": { "provider": "openrouter", "model": "YOUR_MODEL" } + "model": { + "provider": "openrouter", + "model": "YOUR_OPENROUTER_MODEL_ID" + } }' ``` -For additional API configuration options, review the [`OpenRouterModel` fields](/api-reference/assistants/create#request.body.model.OpenRouterModel) in the Create Assistant API reference. +For additional configuration options, review the [`OpenRouterModel` fields](/api-reference/assistants/create#request.body.model.OpenRouterModel) in the Create Assistant API reference. ## Related diff --git a/fern/providers/model/perplexity.mdx b/fern/providers/model/perplexity.mdx index 3c2c6b037..4df52338e 100644 --- a/fern/providers/model/perplexity.mdx +++ b/fern/providers/model/perplexity.mdx @@ -1,148 +1,40 @@ --- title: Perplexity -subtitle: Use a Perplexity model as the language model for your Vapi voice agent. -description: Connect Perplexity to Vapi and configure a model served by your Perplexity account as your assistant's language model. +subtitle: Connect Perplexity and configure a Sonar model available to your account. +description: Connect a Perplexity account to Vapi and configure an assistant with an exact model ID supported by the Perplexity Sonar API. slug: providers/model/perplexity --- -{/* Legacy marketing copy retained temporarily during provider-page standardization. +## What is Perplexity -**What is Perplexity.ai?** +Perplexity provides online language models that can generate responses using current web information. Use the Perplexity integration when you want a Sonar model to generate your Vapi assistant's responses. -Perplexity.ai is an advanced AI-powered search engine that delivers precise and real-time answers to user queries. Utilizing state-of-the-art AI algorithms and knowledge graphs, Perplexity.ai enhances the search experience by providing structured and accurate information. This innovative platform is designed to cater to diverse needs, from research and education to business intelligence, making information retrieval more efficient and reliable. +## Connect Perplexity -**The Evolution of AI Search Engines:** - -Search engines have significantly evolved from simple keyword-based systems to sophisticated AI-driven platforms capable of understanding and answering complex queries. Advances in natural language processing, machine learning, and data integration have revolutionized how search engines operate. Perplexity.ai leverages these advancements to offer a more intuitive and accurate search experience, setting a new standard in information retrieval. - -**Overview of Perplexity.ai’s Offerings:** - -Perplexity.ai provides a range of AI-driven tools designed to enhance search capabilities: - -**AI-Powered Answers:** - -Perplexity.ai’s core offering is its AI-powered search engine, which delivers accurate and relevant answers to user queries. The AI algorithms understand the context and intent behind each query, providing precise and comprehensive results. - -**Knowledge Graphs:** - -Perplexity.ai integrates knowledge graphs to enhance search results with structured and interconnected information. This feature helps users understand the relationships between different entities and access detailed insights quickly. - -**Real-time Information:** - -Perplexity.ai ensures that users receive the most up-to-date information by continuously updating its database. This real-time capability is crucial for queries requiring the latest data and developments. - -**AI-Powered Search Technology:** - -Perplexity.ai’s search technology offers several key features and benefits: - -**Features:** - -- Contextual Understanding: Interprets the context and intent behind queries for accurate answers. -- Comprehensive Results: Provides detailed and relevant information, enhancing the search experience. -- User-Friendly Interface: Intuitive design for easy navigation and quick access to information. - -**Benefits:** - -- Efficiency: Reduces the time needed to find accurate information. -- Reliability: Delivers precise and trustworthy results. -- Enhanced Insights: Offers deeper understanding through structured knowledge graphs. - -**Knowledge Graphs:** - -Perplexity.ai’s knowledge graphs enrich search results by organizing information into structured entities and relationships: - -**Enhancing Search Results:** - -- Interconnected Information: Displays related entities and their connections. -- Detailed Insights: Provides comprehensive information at a glance, improving understanding. - -**Real-time Information:** - -Perplexity.ai’s real-time information feature ensures users receive the latest data and updates: - -**Providing Up-to-date Answers:** - -- Continuous Updates: Regularly refreshes data to maintain accuracy. -- Timely Information: Crucial for time-sensitive queries and decisions. - -**Developer API:** - -Perplexity.ai offers a robust API for easy integration into various applications: - - -**Integration:** - -- SDKs: Available for multiple programming languages. -- Documentation: Comprehensive guides and support for seamless implementation. - -**Use Cases:** - -- Research: Efficiently access and analyze vast amounts of data. -- Business Intelligence: Gain insights for strategic decision-making. - -Use Cases for Perplexity.ai - -Perplexity.ai’s versatile platform supports a wide range of applications: - - -**Research:** - -Facilitate academic and scientific research with accurate and comprehensive information retrieval. - - -**Education:** - -Enhance learning experiences by providing students and educators with reliable answers and insights. - - -**Business Intelligence:** - -Support business decisions with precise data and detailed analyses. - - -**Impact on Information Retrieval:** - -Perplexity.ai is revolutionizing information retrieval by providing tools that enhance productivity and accuracy. By automating the search process and integrating knowledge graphs, users can quickly access relevant information, reducing the time and effort required for manual data collection. - - -**Innovation and Research:** - -Perplexity.ai is committed to continuous innovation and research in AI search technology. Their team of experts focuses on advancing the capabilities of AI algorithms and knowledge graphs, exploring new applications, and refining existing technologies to stay at the forefront of the industry. - -**AI Safety and Ethics:** - -Ensuring the ethical use of AI is a core principle at Perplexity.ai. They implement robust safeguards to prevent misuse of their technology and are actively involved in promoting responsible AI development. Protecting user data and maintaining transparency in AI operations are central to their mission. - - -**Integrations and Compatibility:** - -Perplexity.ai’s API allows seamless integration with various platforms and applications. This ensures that users can incorporate Perplexity.ai’s AI capabilities into their existing systems effortlessly, enhancing functionality and improving user experience. - -*/} - -Perplexity provides online language models that can generate responses using current web information. In Vapi, Perplexity acts as the language model for your assistant. - -You can use Perplexity through Vapi's default integration, or use your own Perplexity account by connecting it in [Integrations](/providers/integrations). +Before using Perplexity, connect your account on the [Integrations](https://dashboard.vapi.ai/settings/integrations) page. ## Language model -Set `model.provider` to `perplexity-ai`. For `model.model`, use a model ID available through the Perplexity Sonar API. +Set `model.provider` to `perplexity-ai`. Set `model.model` to the exact model ID from the [Perplexity Sonar model catalog](https://docs.perplexity.ai/docs/sonar/models) that your connected account can access. ```bash curl -X PATCH "https://api.vapi.ai/assistant/ASSISTANT_ID" \ -H "Authorization: Bearer $VAPI_API_KEY" \ -H "Content-Type: application/json" \ -d '{ - "model": { "provider": "perplexity-ai", "model": "YOUR_MODEL" } + "model": { + "provider": "perplexity-ai", + "model": "YOUR_PERPLEXITY_MODEL_ID" + } }' ``` -For additional API configuration options, review the [`PerplexityAIModel` fields](/api-reference/assistants/create#request.body.model.PerplexityAIModel) in the Create Assistant API reference. +For additional configuration options, review the [`PerplexityAIModel` fields](/api-reference/assistants/create#request.body.model.PerplexityAIModel) in the Create Assistant API reference. ## Related - + Browse the Sonar model IDs currently accepted by Perplexity. diff --git a/fern/providers/model/togetherai.mdx b/fern/providers/model/togetherai.mdx index 5957b4a8e..82ad5745e 100644 --- a/fern/providers/model/togetherai.mdx +++ b/fern/providers/model/togetherai.mdx @@ -1,141 +1,35 @@ --- title: Together AI -subtitle: Use a Together AI model as the language model for your Vapi voice agent. -description: Connect Together AI to Vapi and configure a model served by your Together AI account as your assistant's language model. +subtitle: Connect Together AI and configure any model available to your account. +description: Connect a Together AI account to Vapi and configure an assistant with an exact model ID from Together AI's current serverless catalog. slug: providers/model/togetherai --- -{/* Legacy marketing copy retained temporarily during provider-page standardization. +## What is Together AI -**What is Together AI?** +Together AI provides hosted inference for language models. Use the Together AI integration when you want your Vapi assistant to use a model available through your Together AI account. -Together AI is a leading cloud platform designed for building and running generative AI models. It provides state-of-the-art AI inference, fine-tuning capabilities, and high-performance GPU clusters, enabling businesses and developers to harness the full potential of AI. Together AI focuses on speed, scalability, and cost-efficiency, making it an ideal solution for various AI applications. +## Connect Together AI -**The Evolution of AI Cloud Platforms:** - -AI cloud platforms have significantly evolved, offering more powerful and efficient solutions for AI model deployment and training. Advances in cloud computing, GPU technology, and AI algorithms have enabled platforms like Together AI to provide comprehensive services that cater to modern AI needs. - -**Overview of Together AI’s Offerings:** - -Together AI offers a range of AI-driven tools and services: - -**AI Inference:** - -Together AI provides the fastest AI inference stack available, ensuring quick and efficient processing of AI tasks. This service supports large-scale deployments and offers significant cost savings. - -**Fine-Tuning:** - -Together AI enables users to fine-tune leading open-source models with their private data, achieving greater accuracy for specific tasks. This service supports various models, including LLaMA-2, RedPajama, and more. - -**GPU Clusters:** - -Together AI offers high-performance GPU clusters for large-scale training and fine-tuning. These clusters are equipped with top-tier hardware like NVIDIA A100 and H10 GPUs, ensuring optimal performance and scalability. - -**AI Inference Technology:** - -Together AI’s inference technology offers several key features and benefits: - -**Features:** - -- High Speed: Provides the fastest inference on the market. -- Scalability: Easily scales to handle large volumes of requests. -- Cost Efficiency: Offers lower costs compared to traditional inference services. - - -**Benefits:** - -- Efficiency: Reduces the time required for AI tasks. -- Reliability: Ensures consistent and high-quality performance. -- Flexibility: Adapts to various application needs. - -**Fine-Tuning and Custom Models:** - -Together AI’s fine-tuning capabilities allow users to personalize AI models with their private data: - -**Personalizing AI Models:** - -- Custom Data Integration: Fine-tune models with specific datasets for improved accuracy. -- Wide Model Support: Supports various open-source models for diverse applications. - - -**GPU Clusters:** - -Together AI’s GPU clusters provide high-performance hardware for AI training: - -**High-Performance Hardware:** - -- NVIDIA A100 and H100 GPUs: Equipped with the latest GPU technology for optimal performance. -- Scalable Clusters: Available in configurations ranging from 16 to 2048 GPUs. - - -**Developer API:** - -Together AI offers a comprehensive API for easy integration: - - -**Integration:** - -- SDKs: Available for multiple programming languages. -- Comprehensive Documentation: Detailed guides and support for seamless implementation. - -**Use Cases:** - -- Business Solutions: Enhance operational efficiency and decision-making. -- Research: Facilitate academic and scientific research with advanced AI tools. -- Content Creation: Automate and optimize content production processes. - -**Use Cases for Together AI:** - -Together AI supports a wide range of applications across various sectors: - -**Business Solutions:** - -Leverage AI to improve business operations, enhance customer experiences, and drive innovation. - -**Research:** - -Utilize advanced AI tools to support academic and scientific research. - -**Content Creation:** - -Enhance content creation with high-quality AI-generated text, images, and more. - -**Impact on AI Development:** - -Together AI is transforming AI development by providing tools that enhance productivity and innovation. By offering scalable and cost-effective solutions, developers can focus on creating advanced AI applications without worrying about infrastructure constraints. - -**Innovation and Research:** - -Together AI is committed to continuous innovation and research in AI technology. Their team of experts focuses on advancing the capabilities of AI models and exploring new applications to stay at the forefront of the industry. - -**AI Safety and Ethics:** - -Ensuring the ethical use of AI is a core principle at Together AI. They implement robust safeguards to prevent misuse of their technology and are actively involved in promoting responsible AI development. Protecting user data and maintaining transparency in AI operations are central to their mission. - -**Integrations and Compatibility:** - -Together AI’s API allows seamless integration with various platforms and applications. This ensures that users can incorporate Together AI’s capabilities into their existing systems effortlessly, enhancing functionality and improving user experience. - -*/} - -Together AI provides hosted inference for a broad catalog of models. In Vapi, you configure Together AI as the language-model provider and pass a model ID available to your account. - -You can use Together AI through Vapi's default integration, or use your own Together AI account by connecting it in [Integrations](/providers/integrations). +Before using Together AI, connect your account on the [Integrations](https://dashboard.vapi.ai/settings/integrations) page. ## Language model -Set `model.provider` to `together-ai`. For `model.model`, use any model ID available to your Together AI account. +Set `model.provider` to `together-ai`. Set `model.model` to the exact model ID from the [Together AI serverless model catalog](https://docs.together.ai/docs/serverless/models) that your connected account can access. ```bash curl -X PATCH "https://api.vapi.ai/assistant/ASSISTANT_ID" \ -H "Authorization: Bearer $VAPI_API_KEY" \ -H "Content-Type: application/json" \ -d '{ - "model": { "provider": "together-ai", "model": "YOUR_MODEL" } + "model": { + "provider": "together-ai", + "model": "YOUR_TOGETHER_AI_MODEL_ID" + } }' ``` -For additional API configuration options, review the [`TogetherAIModel` fields](/api-reference/assistants/create#request.body.model.TogetherAIModel) in the Create Assistant API reference. +For additional configuration options, review the [`TogetherAIModel` fields](/api-reference/assistants/create#request.body.model.TogetherAIModel) in the Create Assistant API reference. ## Related