{ "@context": "https://schema.org", "@id": "https://aggr.aymericbeaumet.com/items/huggingface-co/2026-08-06-baseten-on-hugging-face-inference-providers-fire/#webpage", "@type": [ "WebPage", "ArchiveComponent" ], "articleBody": "[![banner image](https://huggingface.co/blog/assets/inference-providers/welcome-baseten.png)](https://huggingface.co/blog/assets/inference-providers/welcome-baseten.png)\n\nWe're thrilled to share that **Baseten** is now a supported Inference Provider on the Hugging Face Hub!\n\nBaseten joins our growing ecosystem, enhancing the breadth and capabilities of serverless inference directly on the Hub's model pages. Inference Providers are also seamlessly integrated into our client SDKs (for both JS and Python), making it super easy to use a wide variety of models with your preferred providers.\n\n[Baseten](https://baseten.com) is an AI infrastructure platform that covers serverless AI, training and more. With a catalog of many frontier models, Baseten makes it easy for developers to integrate a wide range of AI capabilities into their applications with minimal setup.\n\nBaseten supports a broad spectrum of model types - from LLMs to text-to-speech and more. As part of this initial integration, Baseten is launching support for **conversational and text-generation tasks** on Hugging Face, enabling access to popular open-weight LLMs such as [Kimi K3](https://huggingface.co/moonshotai/Kimi-K3?inference_provider=baseten), latest [DeepSeek V4 Flash](https://huggingface.co/deepseek-ai/DeepSeek-V4-Flash-0731?inference_provider=baseten), [GLM-5.2](https://huggingface.co/zai-org/GLM-5.2?inference_provider=baseten), and many more. **Support for additional tasks** will roll out soon!\n\nSee the full list of models supported by Baseten [here](https://huggingface.co/models?inference_provider=baseten&sort=trending).\n\nFollow Baseten on Hugging Face: [https://huggingface.co/baseten](https://huggingface.co/baseten).\n\n## How it works\n\n### In the website UI\n\n1. In your user account settings, you are able to:\n\n- Set your own API keys for the providers you've signed up with. If no custom key is set, your requests will be routed through HF.\n- Order providers by preference. This applies to the widget and code snippets in the model pages.\n\n![Inference Providers](https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/inference-providers/inference-providers-baseten.png)\n\n2. As mentioned, there are two modes when calling Inference Providers:\n\n- Custom key (calls go directly to the inference provider, using your own API key of the corresponding inference provider)\n- Routed by HF (in that case, you don't need a token from the provider, and the charges are applied directly to your HF account rather than the provider's account)\n\n![Inference Providers](https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/inference-providers/explainer.png)\n\n3. Model pages showcase third-party inference providers (the ones that are compatible with the current model, sorted by user preference)\n\n![Inference Providers](https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/inference-providers/model-widget-v3.png)\n\n### From the client SDKs\n\nBaseten is available through the Hugging Face SDKs - `huggingface_hub` (>= 1.26.1) for Python and `@huggingface/inference` for JavaScript.\n\nThe following examples show how to use the latest [DeepSeek V4 Flash](https://huggingface.co/blog/deepseek-ai/DeepSeek-V4-Flash-0731) through Baseten. Use a [Hugging Face token](https://huggingface.co/settings/tokens) to authenticate - the request will be routed to Baseten automatically.\n\n#### From your favorite Agent Harness\n\nHugging Face Inference Providers are integrated in most Agent Harnesses - including Pi, OpenCode, Hermes Agents, OpenClaw, and more. This means you can plug baseten-hosted models straight into your favorite tools without any extra glue code. Browse the full list of integrations [here](https://huggingface.co/docs/inference-providers/en/integrations/index).\n\n#### from Python\n\n```python\nimport os\nfrom openai import OpenAI\n\nclient = OpenAI(\n base_url=\"https://router.huggingface.co/v1\",\n api_key=os.environ[\"HF_TOKEN\"],\n)\n\ncompletion = client.chat.completions.create(\n model=\"deepseek-ai/DeepSeek-V4-Flash-0731:baseten\",\n messages=[\n {\n \"role\": \"user\",\n \"content\": \"Write a Python function that returns the nth Fibonacci number using memoization.\"\n }\n ],\n)\n\nprint(completion.choices[0].message)\n```\n\n#### from JS\n\n```js\nimport { OpenAI } from \"openai\";\n\nconst client = new OpenAI({\n baseURL: \"https://router.huggingface.co/v1\",\n apiKey: process.env.HF_TOKEN,\n});\n\nconst chatCompletion = await client.chat.completions.create({\n model: \"deepseek-ai/DeepSeek-V4-Flash-0731:baseten\",\n messages: [\n {\n role: \"user\",\n content: \"Write a Python function that returns the nth Fibonacci number using memoization.\",\n },\n ],\n});\n\nconsole.log(chatCompletion.choices[0].message);\n```\n\n## Billing\n\nFor direct requests, i.e. when you use the key from an inference provider, you are billed by the corresponding provider. For instance, if you use a baseten API key you're billed on your baseten account.\n\nFor routed requests, i.e. when you authenticate via the Hugging Face Hub, you'll only pay the standard provider API rates. There's no additional markup from us; we just pass through the provider costs directly. (In the future, we may establish revenue-sharing agreements with our provider partners.)\n\n**Important Note** ‼️ PRO users get $2 worth of Inference credits every month. You can use them across providers. 🔥\n\nSubscribe to the [Hugging Face PRO plan](https://hf.co/subscribe/pro) to get access to Inference credits, ZeroGPU, Spaces Dev Mode, 20x higher limits, and more.\n\nWe also provide free inference with a small quota for our signed-in free users, but please upgrade to PRO if you can!\n\n## Feedback and next steps\n\nWe would love to get your feedback! Share your thoughts and/or comments here: [https://huggingface.co/spaces/huggingface/HuggingDiscussions/discussions/49](https://huggingface.co/spaces/huggingface/HuggingDiscussions/discussions/49)\n", "authors": [], "captured_at": "2026-10-19T01:26:53.998049939+00:00", "category": "ai", "content_html": "

\"banner

\n

We're thrilled to share that Baseten is now a supported Inference Provider on the Hugging Face Hub!

\n

Baseten joins our growing ecosystem, enhancing the breadth and capabilities of serverless inference directly on the Hub's model pages. Inference Providers are also seamlessly integrated into our client SDKs (for both JS and Python), making it super easy to use a wide variety of models with your preferred providers.

\n

Baseten is an AI infrastructure platform that covers serverless AI, training and more. With a catalog of many frontier models, Baseten makes it easy for developers to integrate a wide range of AI capabilities into their applications with minimal setup.

\n

Baseten supports a broad spectrum of model types - from LLMs to text-to-speech and more. As part of this initial integration, Baseten is launching support for conversational and text-generation tasks on Hugging Face, enabling access to popular open-weight LLMs such as Kimi K3, latest DeepSeek V4 Flash, GLM-5.2, and many more. Support for additional tasks will roll out soon!

\n

See the full list of models supported by Baseten here.

\n

Follow Baseten on Hugging Face: https://huggingface.co/baseten.

\n

How it works

\n

In the website UI

\n
    \n
  1. In your user account settings, you are able to:
    2. \n
\n\n

\"Inference

\n
    \n
  1. As mentioned, there are two modes when calling Inference Providers:
    2. \n
\n\n

\"Inference

\n
    \n
  1. Model pages showcase third-party inference providers (the ones that are compatible with the current model, sorted by user preference)
    2. \n
\n

\"Inference

\n

From the client SDKs

\n

Baseten is available through the Hugging Face SDKs - huggingface_hub (>= 1.26.1) for Python and @huggingface/inference for JavaScript.

\n

The following examples show how to use the latest DeepSeek V4 Flash through Baseten. Use a Hugging Face token to authenticate - the request will be routed to Baseten automatically.

\n

From your favorite Agent Harness

\n

Hugging Face Inference Providers are integrated in most Agent Harnesses - including Pi, OpenCode, Hermes Agents, OpenClaw, and more. This means you can plug baseten-hosted models straight into your favorite tools without any extra glue code. Browse the full list of integrations here.

\n

from Python

\n
import os\nfrom openai import OpenAI\n\nclient = OpenAI(\n    base_url="https://router.huggingface.co/v1",\n    api_key=os.environ["HF_TOKEN"],\n)\n\ncompletion = client.chat.completions.create(\n    model="deepseek-ai/DeepSeek-V4-Flash-0731:baseten",\n    messages=[\n        {\n            "role": "user",\n            "content": "Write a Python function that returns the nth Fibonacci number using memoization."\n        }\n    ],\n)\n\nprint(completion.choices[0].message)\n
\n

from JS

\n
import { OpenAI } from "openai";\n\nconst client = new OpenAI({\n    baseURL: "https://router.huggingface.co/v1",\n    apiKey: process.env.HF_TOKEN,\n});\n\nconst chatCompletion = await client.chat.completions.create({\n    model: "deepseek-ai/DeepSeek-V4-Flash-0731:baseten",\n    messages: [\n        {\n            role: "user",\n            content: "Write a Python function that returns the nth Fibonacci number using memoization.",\n        },\n    ],\n});\n\nconsole.log(chatCompletion.choices[0].message);\n
\n

Billing

\n

For direct requests, i.e. when you use the key from an inference provider, you are billed by the corresponding provider. For instance, if you use a baseten API key you're billed on your baseten account.

\n

For routed requests, i.e. when you authenticate via the Hugging Face Hub, you'll only pay the standard provider API rates. There's no additional markup from us; we just pass through the provider costs directly. (In the future, we may establish revenue-sharing agreements with our provider partners.)

\n

Important Note ‼️ PRO users get $2 worth of Inference credits every month. You can use them across providers. 🔥

\n

Subscribe to the Hugging Face PRO plan to get access to Inference credits, ZeroGPU, Spaces Dev Mode, 20x higher limits, and more.

\n

We also provide free inference with a small quota for our signed-in free users, but please upgrade to PRO if you can!

\n

Feedback and next steps

\n

We would love to get your feedback! Share your thoughts and/or comments here: https://huggingface.co/spaces/huggingface/HuggingDiscussions/discussions/49

\n", "content_markdown": "[![banner image](https://huggingface.co/blog/assets/inference-providers/welcome-baseten.png)](https://huggingface.co/blog/assets/inference-providers/welcome-baseten.png)\n\nWe're thrilled to share that **Baseten** is now a supported Inference Provider on the Hugging Face Hub!\n\nBaseten joins our growing ecosystem, enhancing the breadth and capabilities of serverless inference directly on the Hub's model pages. Inference Providers are also seamlessly integrated into our client SDKs (for both JS and Python), making it super easy to use a wide variety of models with your preferred providers.\n\n[Baseten](https://baseten.com) is an AI infrastructure platform that covers serverless AI, training and more. With a catalog of many frontier models, Baseten makes it easy for developers to integrate a wide range of AI capabilities into their applications with minimal setup.\n\nBaseten supports a broad spectrum of model types - from LLMs to text-to-speech and more. As part of this initial integration, Baseten is launching support for **conversational and text-generation tasks** on Hugging Face, enabling access to popular open-weight LLMs such as [Kimi K3](https://huggingface.co/moonshotai/Kimi-K3?inference_provider=baseten), latest [DeepSeek V4 Flash](https://huggingface.co/deepseek-ai/DeepSeek-V4-Flash-0731?inference_provider=baseten), [GLM-5.2](https://huggingface.co/zai-org/GLM-5.2?inference_provider=baseten), and many more. **Support for additional tasks** will roll out soon!\n\nSee the full list of models supported by Baseten [here](https://huggingface.co/models?inference_provider=baseten&sort=trending).\n\nFollow Baseten on Hugging Face: [https://huggingface.co/baseten](https://huggingface.co/baseten).\n\n## How it works\n\n### In the website UI\n\n1. In your user account settings, you are able to:\n\n- Set your own API keys for the providers you've signed up with. If no custom key is set, your requests will be routed through HF.\n- Order providers by preference. This applies to the widget and code snippets in the model pages.\n\n![Inference Providers](https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/inference-providers/inference-providers-baseten.png)\n\n2. As mentioned, there are two modes when calling Inference Providers:\n\n- Custom key (calls go directly to the inference provider, using your own API key of the corresponding inference provider)\n- Routed by HF (in that case, you don't need a token from the provider, and the charges are applied directly to your HF account rather than the provider's account)\n\n![Inference Providers](https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/inference-providers/explainer.png)\n\n3. Model pages showcase third-party inference providers (the ones that are compatible with the current model, sorted by user preference)\n\n![Inference Providers](https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/inference-providers/model-widget-v3.png)\n\n### From the client SDKs\n\nBaseten is available through the Hugging Face SDKs - `huggingface_hub` (>= 1.26.1) for Python and `@huggingface/inference` for JavaScript.\n\nThe following examples show how to use the latest [DeepSeek V4 Flash](https://huggingface.co/blog/deepseek-ai/DeepSeek-V4-Flash-0731) through Baseten. Use a [Hugging Face token](https://huggingface.co/settings/tokens) to authenticate - the request will be routed to Baseten automatically.\n\n#### From your favorite Agent Harness\n\nHugging Face Inference Providers are integrated in most Agent Harnesses - including Pi, OpenCode, Hermes Agents, OpenClaw, and more. This means you can plug baseten-hosted models straight into your favorite tools without any extra glue code. Browse the full list of integrations [here](https://huggingface.co/docs/inference-providers/en/integrations/index).\n\n#### from Python\n\n```python\nimport os\nfrom openai import OpenAI\n\nclient = OpenAI(\n base_url=\"https://router.huggingface.co/v1\",\n api_key=os.environ[\"HF_TOKEN\"],\n)\n\ncompletion = client.chat.completions.create(\n model=\"deepseek-ai/DeepSeek-V4-Flash-0731:baseten\",\n messages=[\n {\n \"role\": \"user\",\n \"content\": \"Write a Python function that returns the nth Fibonacci number using memoization.\"\n }\n ],\n)\n\nprint(completion.choices[0].message)\n```\n\n#### from JS\n\n```js\nimport { OpenAI } from \"openai\";\n\nconst client = new OpenAI({\n baseURL: \"https://router.huggingface.co/v1\",\n apiKey: process.env.HF_TOKEN,\n});\n\nconst chatCompletion = await client.chat.completions.create({\n model: \"deepseek-ai/DeepSeek-V4-Flash-0731:baseten\",\n messages: [\n {\n role: \"user\",\n content: \"Write a Python function that returns the nth Fibonacci number using memoization.\",\n },\n ],\n});\n\nconsole.log(chatCompletion.choices[0].message);\n```\n\n## Billing\n\nFor direct requests, i.e. when you use the key from an inference provider, you are billed by the corresponding provider. For instance, if you use a baseten API key you're billed on your baseten account.\n\nFor routed requests, i.e. when you authenticate via the Hugging Face Hub, you'll only pay the standard provider API rates. There's no additional markup from us; we just pass through the provider costs directly. (In the future, we may establish revenue-sharing agreements with our provider partners.)\n\n**Important Note** ‼️ PRO users get $2 worth of Inference credits every month. You can use them across providers. 🔥\n\nSubscribe to the [Hugging Face PRO plan](https://hf.co/subscribe/pro) to get access to Inference credits, ZeroGPU, Spaces Dev Mode, 20x higher limits, and more.\n\nWe also provide free inference with a small quota for our signed-in free users, but please upgrade to PRO if you can!\n\n## Feedback and next steps\n\nWe would love to get your feedback! Share your thoughts and/or comments here: [https://huggingface.co/spaces/huggingface/HuggingDiscussions/discussions/49](https://huggingface.co/spaces/huggingface/HuggingDiscussions/discussions/49)\n", "dateCreated": "2026-10-19T01:26:53.998049939+00:00", "date_created": "2026-08-06T00:00:00+00:00", "date_modified": "2026-08-06T00:00:00+00:00", "date_published": "2026-08-06T00:00:00+00:00", "description": "We're thrilled to share that Baseten is now a supported Inference Provider on the Hugging Face Hub! Baseten joins our growing ecosystem, enhancing the breadth and capabilities of serverless inference directly on the Hub's model pages.…", "external_url": "https://huggingface.co/blog/baseten", "git": { "commit": "ebb0941c5c06a2ab2377342d607535262a3e969e", "path": "items/huggingface-co/2026/08/2026-08-06-baseten-on-hugging-face-inference-providers-fire.md", "permalink": "https://github.com/aymericbeaumet/aggr-instance/blob/ebb0941c5c06a2ab2377342d607535262a3e969e/items/huggingface-co/2026/08/2026-08-06-baseten-on-hugging-face-inference-providers-fire.md" }, "id": "urn:aggr:item:752b53d0dca8de6d8eea24bb443eaa42f67bd1a2", "isBasedOn": { "@id": "https://huggingface.co/blog/baseten" }, "mainEntity": { "@id": "https://huggingface.co/blog/baseten", "@type": "CreativeWork", "archivedAt": { "@id": "https://aggr.aymericbeaumet.com/items/huggingface-co/2026-08-06-baseten-on-hugging-face-inference-providers-fire/#webpage" }, "dateModified": "2026-08-06T00:00:00+00:00", "datePublished": "2026-08-06T00:00:00+00:00", "headline": "Baseten on Hugging Face Inference Providers", "image": { "@type": "ImageObject", "caption": "banner image", "height": 90, "url": "https://huggingface.co/blog/assets/inference-providers/welcome-baseten.png", "width": 160 }, "timeRequired": "PT4M", "url": "https://huggingface.co/blog/baseten", "wordCount": 686 }, "name": "Archived snapshot: Baseten on Hugging Face Inference Providers", "preview": { "alt": "banner image", "color": null, "height": 90, "placeholder": { "data_url": "data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAAEAAAABCAQAAAC1HAwCAAAAC0lEQVR42mNk+A8AAQUBAScY42YAAAAASUVORK5CYII=", "hash": "" }, "url": "https://huggingface.co/blog/assets/inference-providers/welcome-baseten.png", "width": 160 }, "reading_minutes": 4, "replicated_at": null, "source": "huggingface-co", "source_name": "Hugging Face - Blog", "summary": null, "tags": [], "temporalCoverage": "2026-10-19T01:26:53.998049939+00:00", "title": "Baseten on Hugging Face Inference Providers", "url": "https://aggr.aymericbeaumet.com/items/huggingface-co/2026-08-06-baseten-on-hugging-face-inference-providers-fire/", "word_count": 686 }