Together AI Release Notes

Together CLI v2.33.2

Version 2.33.2 of the Together CLI improves error reporting and upload feedback:

Endpoint, fine-tuning, and model commands now print the API’s error message when a request fails, rather than a generic failure notice. The same goes for a missing API key or command argument.

tg evals create and tg batches submit now show a progress bar while uploading files, matching tg files upload.

tg fine-tuning list-events no longer fails on jobs with more than 20 events.

The --scale-to-zero-window flag has been removed from tg beta endpoints deploy and tg beta endpoints update.

See the CLI reference.

Preemptible compute for GPU clusters

Preemptible compute is now in public preview for Kubernetes GPU clusters. Alongside standard nodes, you can set a preemptible GPU target, and Together provisions toward it as spare capacity becomes available, at a flat discounted rate relative to on-demand.

What’s new:

• Preemptible GPU targets: Set num_preemptible_gpus at cluster create or update from the console, CLI, or API. Together automatically provisions replacements toward the target after nodes are reclaimed.
• Five-minute drain window: Reclaimed nodes are cordoned and emit a TogetherPreemptionNotified Kubernetes event, and pods receive SIGTERM with up to 300 seconds of grace to checkpoint and exit.
• Sub-hourly billing: Usage is metered every one to two minutes, so you pay only for the time a node is live.

See Preemptible compute for the preemption contract, scheduling guidance, and checkpoint examples.

New releases

Improvements

Deprecations

Billing usage API (beta)

GET /billing/usage returns organization-wide usage and cost line items, filterable by month. The endpoint is in beta and enabled per organization.

File upload progress in the CLI and Python SDK

tg files upload and tg files check now show a progress bar in interactive terminals. The Python SDK accepts an optional progress_callback on client.files.upload() that receives upload progress events.

See the files CLI reference and Data preparation.

Slurm cluster kubeconfig for project members

Project members can now download the cluster kubeconfig for Slurm clusters from the cluster details page, matching Kubernetes cluster behavior.

See Download cluster kubeconfig.

Legacy API key regeneration

Legacy API keys can now be regenerated by any admin or editor of the default project. Legacy keys appear in the project’s API keys table with a Deprecated badge.

See Legacy API keys.

Model deprecations

The following models have been deprecated and are no longer available on serverless:

nvidia/Nemotron-3-ultra-550b-a55b.

pearl-ai/gemma-4-31b-it.

deepseek-ai/DeepSeek-V4-Pro. Use deepseek-ai/DeepSeek-V4-Pro-0813 instead.

moonshotai/Kimi-K2.7-Code.

All of these models except pearl-ai/g...

New releases

Batch jobs in the CLI

The Together CLI now includes a tg batches command group for batch inference:

tg batches submit uploads a local JSONL file (or takes an existing file ID) and creates a job against chat.completions, audio.transcriptions, or audio.translations.

tg batches list, retrieve, and cancel manage the job lifecycle, with ls and get as aliases.

tg batches download streams results to stdout, or writes the output and error files to disk with --output.

See the batches CLI reference.

New serverless models

The following models are now available on serverless:

zai-org/GLM-5.3-Flash: 1,000,000 context length, FP8 quantization, function calling and structured outputs. Pricing: $0.15 input / $0.50 output / $0.03 cached input (per 1M tokens).

Improvements

Fine-tuning quality improvements

Training quality has improved for fine-tuning on the following models:

Qwen/Qwen3.5-0.8B.

Qwen/Qwen3.5-2B.

Qwen/Qwen3.5-4B.

Qwen/Qwen3.5-9B.

Qwen/Qwen3.5-27B.

Qwen/Qwen3.5-35B-A3B.

Qwen/Qwen3.5-35B-A3B-Base.

Qwen/Qwen3.5-122B-A10B.

Qwen/Qwen3.5-397B-A17B.

Qwen/Qwen3.6-27B.

Qwen/Qwen3.6-35B-A3B.

nvidia/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-BF16.

nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16.

Other models are unchanged. No actions or setting changes are required to get the improvement. To pick it up on a model you’ve already tuned, start a new job with the same data and settings. A job you run after this release will not reproduce the loss curve of an earlier run on the same data and settings.

New releases

Fully automatic confirmation policy for node auto repair

Auto node repair can now close the loop end to end. Under the new Fully automatic confirmation policy, health checks detect the fault, the system generates a repair recommendation, and auto repair executes it without waiting for approval. Clusters continue to use Approve before repair by default.

What’s new:

• Confirmation policy toggle: Choose between Approve before repair and Fully automatic under Auto-remediation policy on the Repairs tab.
• Per-fault scoping: Under Fully automatic, use Repair actions to check which fault groups (Migrate to new host, Reprovision, VM reboot) run unattended. Destructive repairs can stay gated on approval while transient ones clear on their own.
• Job interruption controls: Wait for idle, Grace period, Maximum wait, and Do not interrupt running jobs let the wait policy protect in-flight training and inference work in place of a review step.
• Audit trail: Automatically approved repairs record Auto-Approved in the repair’s Reviewed by field, alongside the alert evidence that triggered them.

See Confirmation policy for details.

New releases

ACH bank transfers generally available

ACH bank transfers are now available to all customers, not just those with an enterprise contract. Link a U.S. bank account with instant verification from your billing settings, set it as your default payment method, and purchase credits directly from your bank account. Credits are deposited after the ACH payment clears (usually 1–3 business days). Auto-recharge still requires a card as the default payment method.

See Payment methods & invoices.

Deprecations

Model deprecations

The following models have been deprecated and are no longer available on serverless:
black-forest-labs/FLUX.1-schnell.
Qwen/Qwen2.5-7B.
moonshotai/Kimi-K2.6.

See Deprecations for migration options.

New releases

New models

Projects now support three visibility levels. An open project lets any organization member discover and join it. A closed project is discoverable, but joining requires an admin to grant access. A private project is visible only to existing collaborators and organization admins. Choose a level when you create a project, or change it at any time from Project Settings.

See Project visibility.

New serverless models

The following models are now available on serverless:
deepseek-ai/DeepSeek-V4-Pro-0813: 1,048,576 context length, NVFP4 quantization. Pricing: $1.32 input / $3.96 output / $0.13 cached input (per 1M tokens).

Multi-project resource scoping

Multi-project is now enabled for every organization. Clusters, fine-tuned models, endpoints, evaluations, files, and API keys are fully scoped to projects. The early-access limitations on project isolation no longer apply.

See Projects.