Mistral Common Updates & Release Notes

What's Changed

• Add chat templates integration by @juliendenize in #163
• Deprecate RawAudio in favor of str | bytes by @juliendenize in #227
• Generalize normalizer aggregation with dual separators by @juliendenize in #235
• Consolidate multimodal ContentChunk support for all message roles by @juliendenize in #241
• Fix AudioChunk.to_openai() serialization for raw audio bytes and prefixed base64 audio strings. by @haoruilee in #245
• Resolve tokenizer from local cache in offline mode by @sarathfrancis90 in #249
• Remove to_openai and from_openai from InstructRequest by @juliendenize in #251
• Bump version to 1.11.4 by @juliendenize in #252

New Contributors

• @haoruilee made their first contribution in #245
• @sarathfrancis90 made their first contribution in #249

Full Changelog: v1.11.3...v1.11.4

What's Changed

• Raise multiple format of reasoning for from_openai by @juliendenize in #224
• Preserve zero OpenAI seed in chat request conversion by @pragnyanramtha in #226
• Pin uv required-version and bump pre-commit hook by @juliendenize in #228
• Add to_openai reasoning format for AssistantMessage by @juliendenize in #223
• fix(tokenizer): point users at from_hf_hub on unknown model (#229) by @NishchayMahor in #231
• Fix: forward continue_final_message in tekken normalizers (V7/V15) by @matdou in #233
• Version 1.11.3 by @juliendenize in #239

New Contributors

• @pragnyanramtha made their first contribution in #226
• @NishchayMahor made their first contribution in #231
• @matdou made their first contribution in #233

Full Changelog: v1.11.2...v1.11.3

What's Changed

• Allow System Prompt with Audio for v13 by @juliendenize in #184
• test_audio: Replace live network calls in test_from_url with mocked HTTP responses by @framsouza in #188
• fix: typo in serve command help text by @framsouza in #189
• Add Python 3.14 support by @juliendenize in #195
• test: mock remaining network call in test_encode_invalid_audio_url_chunk by @abdelhadi703 in #192
• [Speech Request] Add speech request by @patrickvonplaten in #196
• Add strict function calling support by @juliendenize in #197
• Add v15 by @juliendenize in #199
• Version 1.10.0 by @juliendenize in #200

New Contributors

• @framsouza made their first contribution in #188
• @abdelhadi703 made their first contribution in #192

Full Changelog: v1.9.1...v1.10.0

Mistral-Common can now process streaming requests

import numpy as np
from mistral_common.audio import Audio
from mistral_common.protocol.instruct.chunk import RawAudio
from mistral_common.protocol.transcription.request import StreamingMode, TranscriptionRequest
from mistral_common.tokens.tokenizers.mistral import MistralTokenizer

# 1. Load the tokenizer with audio support
tokenizer = MistralTokenizer.from_hf_hub("mistralai/Voxtral-Mini-4B-Realtime-2602")
# 2. Create sample audio data (or load from a file)
sampling_rate = 16_000
duration_s = 2.0
audio_array = np.random.uniform(-1, 1, size=int(duration_s * sampling_rate)).astype(np.float32)
audio = Audio(audio_array=audio_array, sampling_rate=sampling_rate, format="wav")
# 3. Create the streaming transcription request
request = TranscriptionRequest(
    audio=RawAudio(data=audio.to_base64("wav"), format="wav"),
    streaming=StreamingMode.ONLINE,  # or StreamingMode.OFFLINE
    language=None,
)
# 4. Encode the request
tokenized = tokenizer.encode_transcription(request)
# 5. Access the results
print(f"Tokens: {tokenized.tokens}")
print(f"Number of tokens: {len(tokenized.tokens)}")
print(f"Number of audio segments: {len(tokenized.audios)}")

See https://huggingface.co/mistralai/Voxtral-Mini-4B-Realtime-2602 for more info.

What's Changed

• Add new token logic asrstr by @patrickvonplaten in #172
• [Backward comp] Still need the _control_tokens for vLLM by @patrickvonplaten in #173
• Release 1.8.8 by @juliendenize in #174
• [Audio] Update padding by @patrickvonplaten in #175
• [Audio] Improve padding for streaming by @patrickvonplaten in #177
• Add audio_encoder to Tokenizer V13 by @amosyou in #180
• Release v1.9.0 - Audio streaming by @patrickvonplaten in #179
• Fix image tests with downloads by @juliendenize in #181
• Enhance accessibility by @juliendenize in #176

New Contributors

• @amosyou made their first contribution in #180

Full Changelog: v1.8.7...v1.9.0

Release notes

• Remove deprecated imports in docs. by @juliendenize in #138
• Add normalizer and validator utils by @juliendenize in #140
• Refactor private aggregate messages for InstructRequestNormalizer by @juliendenize in #141
• test: improve unit test for is_opencv_installed by @PrasanaaV in #143
• Optimize spm decode function by @juliendenize in #144
• Add get_one_valid_tokenizer_file by @juliendenize in #142
• Remove Python 3.9 support by @juliendenize in #145
• Correctly pass revision and token to hf_api by @juliendenize in #149
• Fix assertion in test_convert_text_chunk and tool_call by @patrickvonplaten in #152
• Pins GH actions by @arcanis in #160
• Add usage restrictions regarding third-party rights. by @juliendenize in #161
• Improve tekken logging message for vocabulary by @juliendenize in #162
• Set version 1.8.6 by @juliendenize in #151

New Contributors

• @PrasanaaV made their first contribution in #143
• @arcanis made their first contribution in #160

Full Changelog

v1.8.5...v1.8.6

What's Changed

• Make model field optional in TranscriptionRequest by @juliendenize in #128
• Remove all responses and embedding requests. Add transcription docs. by @juliendenize in #133
• Add chunk file by @juliendenize in #129
• allow message content to be empty string by @mingfang in #135
• Add test empty content for AssistantMessage v7 by @juliendenize in #136
• v1.8.5 by @juliendenize in #137

New Contributors

• @mingfang made their first contribution in #135

Full Changelog: v1.8.4...v1.8.5