Baseten Release Notes

Reflection's Beam is now available through Baseten Model APIs as reflection/Beam-1.0. It supports a 1M-token context window, tool calling, and always-on reasoning. Set reasoning_effort from minimal to max to control the reasoning budget.

curl https://inference.baseten.co/v1/chat/completions \
-H "Authorization: Bearer $BASETEN_API_KEY" \
-H "Content-Type: application/json" \
-d '{
  "model": "reflection/Beam-1.0",
  "messages": [{"role": "user", "content": "Can cars fly yet?"}],
  "reasoning_effort": "minimal",
  "max_tokens": 1024
}'

For multi-turn conversations, preserve reasoning_content from prior assistant turns.

For more information, see our docs.

Meta Muse Spark Open and NVIDIA Nemotron 3.5 Super VL are now available through Baseten Model APIs. Send requests through the OpenAI-compatible endpoint with your Baseten API key.

Muse Spark Open

Muse Spark Open accepts text, image, audio, and video inputs and generates text responses. Use it to reason over images, recordings, and video in your application.

curl https://inference.baseten.co/v1/chat/completions \
-H "Content-Type: application/json" \
-H "Authorization: Bearer $BASETEN_API_KEY" \
-d '{
"model": "meta-models/muse-spark-open",
"messages": [{"role": "user", "content": "Implement a Python function that groups events by user ID."}]
}'

Nemotron 3.5 Super VL

Nemotron 3.5 Super VL accepts text and image inputs through Model APIs, with a context window of up to 1,048,576 tokens.

Nemotron 3.5 Super VL is also available for managed LoRA fine-tuning with the Loops SDK. Train with the BF16 or NVFP4 model using a context window of up to 262,144 tokens.

For more information, see the Model API docs and Loops supported models.

Baseten now supports restricting a deployment’s outbound network traffic to an allow list of IP ranges and domains. Add egress_restrictions under runtime in your Truss config to lock down a sensitive model without affecting any other deployment in your organization.

runtime:
  egress_restrictions:
    ip_allow_list:
      - 203.0.113.10/32
    fqdn_allow_list:
      - "*.baseten.co"
      - huggingface.co

Contact us to enable egress restrictions for your organization. For more information, see our docs.

DeepSeek V4.1 Flash Fast is now available through Baseten Model APIs. It serves the same 552B-parameter multimodal model as DeepSeek V4.1 Flash at full precision, on dedicated Fast capacity for higher sustained throughput, and is purpose-built for long-running agentic coding sessions. It has a 1M-token context window, vision, tool calling, and reasoning on by default.

Send requests to deepseek-ai/DeepSeek-V4.1-Flash-Fast through our OpenAI-compatible endpoint with your Baseten API key:

curl https://inference.baseten.co/v1/chat/completions \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer $BASETEN_API_KEY" \
  -d '{"model": "deepseek-ai/DeepSeek-V4.1-Flash-Fast", "messages": [{"role": "user", "content": "Read the failing test, find the bug, and send me the patch."}], "reasoning_effort": "high"}'

For more information, see our docs.

You can now rename a model from the terminal with baseten model rename. The model keeps its ID, endpoints, and deployments, so only the name in config.yaml needs updating.

Version 1.1.0 also adds baseten volume sync, in pre-release. Volume syncs can copy a Hugging Face, S3, GCS, Azure, R2, or CoreWeave source into a volume as a durable background job. Authentication with stored keys is supported across providers, and short-lived OIDC is supported to AWS (for S3) and GCP (for GCS). Pass --wait to block until the sync finishes; pressing Ctrl+C stops waiting without cancelling the sync.

We've also updated support for volume listings: baseten volume stat, and baseten volume versions now show when volumes, tags, and versions expire. baseten volume push and baseten volume pull report total transfer time, and concurrent pushes to the same volume fail with a clear message instead of a raw conflict error.

brew upgrade baseten
baseten model rename --model-id <model-id> --new-name my-model-v2
baseten volume sync start --source hf://<organization>/<repository> --dest bdn:<namespace>/<volume>:<tag> --wait

For more information, see our docs.

Starting Thursday, October 1 at 15:00 UTC, newly created Baseten API keys will add a b10_ prefix, making them easier to identify in code, logs, and secret scanners.

Existing keys will continue to work unchanged. The prefix applies only to newly created keys, and no action or key rotation is required.

b10_abcd1234.ABCDEFGHIJKLMNOPQRSTUVWXYZabcdef

If your tooling validates, parses, redacts, or scans API keys based on their current format or length, please update it before October 1.

For more information, see our docs.

GLM 4.7, Kimi K2.7, Kimi K2.6, Inkling, Inkling Small, and DeepSeek v4 Pro will be deprecated at 5pm PT September 25th.

At that time the model IDs will become inactive and return an error for all requests. As open source models advance rapidly, we prioritize serving the highest quality models and deprecate models when stronger alternatives are available.

We recommend the following models as alternatives, all of which offer superior intelligence for each specific use case. Just swap in the new Model ID(s) prior to the deprecation date.

Training jobs can now use OIDC or AWS AssumeRole during setup to pull private container images and download model weights or training data without storing long-lived cloud credentials in Baseten.

OIDC supports Amazon ECR and S3, Google Artifact Registry and Container Registry, and Google Cloud Storage. Training OIDC tokens let you scope access to your Baseten organization, team, training project, or individual job.

For AWS resources, you can use AWS AssumeRole without registering an OIDC provider. Baseten assumes an IAM role in your account using your organization's unique external ID. AWS AssumeRole supports private images in Amazon ECR and weights or data in Amazon S3.

For setup instructions, see OIDC authentication, AWS AssumeRole, private training images, and weights and data authentication.

DeepSeek V4.1 Flash is now available through Baseten Model APIs. The 552B-parameter multimodal successor to DeepSeek V4 Flash 0731, it is purpose-built for agentic, coding workflows, and has reasoning and tool calling built in.

Send requests to deepseek-ai/DeepSeek-V4.1-Flash through our OpenAI-compatible endpoint with your Baseten API key:

curl https://inference.baseten.co/v1/chat/completions \
-H "Content-Type: application/json" \
-H "Authorization: Bearer $BASETEN_API_KEY" \
-d '{
"model": "deepseek-ai/DeepSeek-V4.1-Flash",
"messages": [
{"role": "user", "content": "Explain the Navier Stokes smoothness problem."}
],
"reasoning_effort": "high"
}'

For more information, see our docs.