Mistral Common Updates & Release Notes

What's Changed

• Add comment and coverage guidelines to AGENTS.md by @juliendenize in #278
• Allow overriding auto-detected plain thinking support in chat template generation by @juliendenize in #285
• Rename LICENCE to LICENSE by @juliendenize in #286
• Set reference audio filename for speech multipart uploads by @Mr-Neutr0n in #284
• Keep at least one pixel per axis when resizing an image by @arthi-arumugam-git in #289
• Reject AudioConfig where audio_length_per_tok floors to zero by @shoemoney in #292
• Deprecate Tokenized.text in favor of tokenizer.decode by @juliendenize in #282
• fix(tokenizer): validate ImageConfig fields to prevent ZeroDivisionError by @shoemoney in #294
• Update uv tooling to 0.12.6 by @juliendenize in #297
• Parallelize unit and integration test suites by @juliendenize in #298
• Reject null tool call IDs before encoding by @juliendenize in #293
• Deprecate direct continue_final_message on ChatCompletionRequest by @juliendenize in #303
• Improve typing at dynamic tokenizer boundaries by @juliendenize in #296
• Align tokenizer type contracts by @juliendenize in #299
• docs: fix typo in experimental usage guide by @ManoharPaturi in #306
• Add contribution guidelines and templates by @juliendenize in #314
• Simplify issue creation by @juliendenize in #315
• Switch documentation from MkDocs to Zensical by @juliendenize in #318
• Fix docs deploy: replace non-existent zensical gh-deploy with actions-gh-pages by @juliendenize in #319
• Fix actions-gh-pages ref to real v4 commit SHA by @juliendenize in #320
• Improve docstrings across the codebase by @juliendenize in #317
• Add agnostic validation mode by @juliendenize in #295
• Raise InvalidToolCallError on malformed v2-v7 tool call outputs by @Chocolatine75 in #310
• Raise InvalidMessageStructureException for invalid continue_final_message by @juliendenize in #325
• fix(image): preserve float32 dtype and avoid float64 promotion in normalize (#316) by @andriiorap in #321
• Allow null assistant content in OpenAI requests by @shubhangi013 in #327
• Fix image URL loading crashes and add a download timeout by @BarneyChambers in #308
• Add test-compat label workflow: vLLM + Transformers compat tests on CPU by @juliendenize in #334
• Release 1.12.0 by @juliendenize in #326

New Contributors

• @Mr-Neutr0n made their first contribution in #284
• @arthi-arumugam-git made their first contribution in #289
• @shoemoney made their first contribution in #292
• @ManoharPaturi made their first contribution in #306
• @Chocolatine75 made their first contribution in #310
• @andriiorap made their first contribution in #321
• @shubhangi013 made their first contribution in #327
• @BarneyChambers made their first contribution in #308

Full Changelog: v1.11.7...v1.12.0

What's Changed

• Update AGENTS.md structure and add explicit keyword args rule by @juliendenize in #270
• Validate special_token_policy strings when decoding by @sarathfrancis90 in #273
• Add auto-detecting chat template generation from tokenizer file by @juliendenize in #272
• Reject thinking chunks in tool messages by @juliendenize in #275
• Emit all render_content macro args explicitly by @juliendenize in #274
• Fix documentation drift from code by @juliendenize in #276
• Bump version to 1.11.7 by @juliendenize in #277

Full Changelog: v1.11.6...v1.11.7

What's Changed

• Raise ValueError instead of ValidationError in audio chunk validators by @sarathfrancis90 in #255
• Reject AudioConfig with sampling_rate < frame_rate instead of a later ZeroDivisionError by @CharlesCNorton in #253
• Decode normal tokens under SpecialTokenPolicy.RAISE in SentencePiece by @sarathfrancis90 in #256
• Auto-select grammar variant from tokenizer by @juliendenize in #260
• Fix seed field not bridged in SpeechRequest OpenAI conversion by @winklemad in #262
• Restore deprecated reasoning parameter in select_jinja_template by @juliendenize in #266
• Bump version to 1.11.6 by @juliendenize in #267

New Contributors

• @winklemad made their first contribution in #262

Full Changelog: v1.11.5...v1.11.6

What's Changed

• Add chat templates integration by @juliendenize in #163
• Deprecate RawAudio in favor of str | bytes by @juliendenize in #227
• Generalize normalizer aggregation with dual separators by @juliendenize in #235
• Consolidate multimodal ContentChunk support for all message roles by @juliendenize in #241
• Fix AudioChunk.to_openai() serialization for raw audio bytes and prefixed base64 audio strings. by @haoruilee in #245
• Resolve tokenizer from local cache in offline mode by @sarathfrancis90 in #249
• Remove to_openai and from_openai from InstructRequest by @juliendenize in #251
• Bump version to 1.11.4 by @juliendenize in #252

New Contributors

• @haoruilee made their first contribution in #245
• @sarathfrancis90 made their first contribution in #249

Full Changelog: v1.11.3...v1.11.4

What's Changed

• Raise multiple format of reasoning for from_openai by @juliendenize in #224
• Preserve zero OpenAI seed in chat request conversion by @pragnyanramtha in #226
• Pin uv required-version and bump pre-commit hook by @juliendenize in #228
• Add to_openai reasoning format for AssistantMessage by @juliendenize in #223
• fix(tokenizer): point users at from_hf_hub on unknown model (#229) by @NishchayMahor in #231
• Fix: forward continue_final_message in tekken normalizers (V7/V15) by @matdou in #233
• Version 1.11.3 by @juliendenize in #239

New Contributors

• @pragnyanramtha made their first contribution in #226
• @NishchayMahor made their first contribution in #231
• @matdou made their first contribution in #233

Full Changelog: v1.11.2...v1.11.3

What's Changed

• Allow System Prompt with Audio for v13 by @juliendenize in #184
• test_audio: Replace live network calls in test_from_url with mocked HTTP responses by @framsouza in #188
• fix: typo in serve command help text by @framsouza in #189
• Add Python 3.14 support by @juliendenize in #195
• test: mock remaining network call in test_encode_invalid_audio_url_chunk by @abdelhadi703 in #192
• [Speech Request] Add speech request by @patrickvonplaten in #196
• Add strict function calling support by @juliendenize in #197
• Add v15 by @juliendenize in #199
• Version 1.10.0 by @juliendenize in #200

New Contributors

• @framsouza made their first contribution in #188
• @abdelhadi703 made their first contribution in #192

Full Changelog: v1.9.1...v1.10.0

Mistral-Common can now process streaming requests

import numpy as np
from mistral_common.audio import Audio
from mistral_common.protocol.instruct.chunk import RawAudio
from mistral_common.protocol.transcription.request import StreamingMode, TranscriptionRequest
from mistral_common.tokens.tokenizers.mistral import MistralTokenizer

# 1. Load the tokenizer with audio support
tokenizer = MistralTokenizer.from_hf_hub("mistralai/Voxtral-Mini-4B-Realtime-2602")
# 2. Create sample audio data (or load from a file)
sampling_rate = 16_000
duration_s = 2.0
audio_array = np.random.uniform(-1, 1, size=int(duration_s * sampling_rate)).astype(np.float32)
audio = Audio(audio_array=audio_array, sampling_rate=sampling_rate, format="wav")
# 3. Create the streaming transcription request
request = TranscriptionRequest(
    audio=RawAudio(data=audio.to_base64("wav"), format="wav"),
    streaming=StreamingMode.ONLINE,  # or StreamingMode.OFFLINE
    language=None,
)
# 4. Encode the request
tokenized = tokenizer.encode_transcription(request)
# 5. Access the results
print(f"Tokens: {tokenized.tokens}")
print(f"Number of tokens: {len(tokenized.tokens)}")
print(f"Number of audio segments: {len(tokenized.audios)}")

See https://huggingface.co/mistralai/Voxtral-Mini-4B-Realtime-2602 for more info.

What's Changed

• Add new token logic asrstr by @patrickvonplaten in #172
• [Backward comp] Still need the _control_tokens for vLLM by @patrickvonplaten in #173
• Release 1.8.8 by @juliendenize in #174
• [Audio] Update padding by @patrickvonplaten in #175
• [Audio] Improve padding for streaming by @patrickvonplaten in #177
• Add audio_encoder to Tokenizer V13 by @amosyou in #180
• Release v1.9.0 - Audio streaming by @patrickvonplaten in #179
• Fix image tests with downloads by @juliendenize in #181
• Enhance accessibility by @juliendenize in #176

New Contributors

• @amosyou made their first contribution in #180

Full Changelog: v1.8.7...v1.9.0