OpenVINO™ toolkit: An open source AI toolkit that makes it easier to write once, deploy anywhere.

What's New in Version 2025.4

OpenVINO™ 2025.4 takes your AI deployments to the next level with new features and performance enhancements. In this release, you’ll see continuous improvements for large language models (LLMs), optimized runtimes for Intel® hardware, and expanded capabilities for efficient AI deployment across edge, cloud, and local environments. Explore the latest updates and unlock new possibilities for your AI projects..

Release Notes

View System Requirements

Latest Features

Easier model access and conversion
We’ve made model conversion easier.

Topic	Details
New Model Support	On CPUs & GPUs: Qwen3-Embedding-0.6B, Qwen3-Reranker-0.6B, Mistral-Small-24B-Instruct-2501 On NPUs: Gemma-3-4b-it and Qwen2.5-VL-3B-Instruct Preview: Mixture of Experts (MoE) models optimized for CPUs and GPUs, validated for Qwen3-30B-A3B GenAI pipeline integrations: Qwen3-Embedding-0.6B and Qwen3-Reranker-0.6B for enhanced retrieval/ranking and Qwen2.5VL-7B for video pipeline

GenAI and LLM enhancements

We've expanded model support and accelerated inference.

Topic	Details
GPU Plug-in Support	GPU plugin updates include improved performance with prefix caching for chat history scenarios and enhanced LLM accuracy with dynamic quantization support for INT8.
GenAI Enhancements	Accelerated multi-token generation for GenAI, leveraging optimized GPU kernels to deliver faster inference, smarter KV-cache reuse, and scalable LLM performance. Encrypted blob format support added for secure model deployment with OpenVINO™ GenAI. Model weights and artifacts are stored and transmitted in an encrypted format, reducing risks of IP theft during deployment. Developers can deploy with minimal code changes using OpenVINO GenAI pipelines.

Topic

Details

GPU Plug-in Support

GPU plugin updates include improved performance with prefix caching for chat history scenarios and enhanced LLM accuracy with dynamic quantization support for INT8.

GenAI Enhancements

Accelerated multi-token generation for GenAI, leveraging optimized GPU kernels to deliver faster inference, smarter KV-cache reuse, and scalable LLM performance.
Encrypted blob format support added for secure model deployment with OpenVINO™ GenAI. Model weights and artifacts are stored and transmitted in an encrypted format, reducing risks of IP theft during deployment. Developers can deploy with minimal code changes using OpenVINO GenAI pipelines.

More portability and performance

Develop once, deploy anywhere. OpenVINO enables developers to run AI at the edge, in the cloud, or locally.

Topic	Details
Windows ML* Support	Gold support for Windows ML* enables developers to deploy AI models and applications effortlessly across CPUs, GPUs, and NPUs on AI PCs powered by Intel® Core™ Ultra processors.
Intel® Hardware Support	Announcing support for Intel® Core™ Ultra Processor Series 3 The improved Nvidia Triton Server integration with OpenVINO backend now enables developers to utilize Intel GPUs or NPUs for deployment. NPU deployment is simplified through batch support, which automatically reshapes models to batch size = 1 for compatibility with older driver versions. This enables seamless model execution across all Intel® Core™ Ultra processors regardless of driver version.
Model Server Updates	OpenVINO Model Server (OVMS) and OpenVINO™ GenAI now extend support for Agentic AI scenarios with new features such as output parsing, improved chat templates for reliable multi-turn interactions, and preview functionality for the Qwen3-30B-A3B model. OVMS also introduces a preview for audio endpoints.
NNCF Updates	The Neural Network Compression Framework (NNCF) ONNX backend now supports INT8 static post-training quantization (PTQ) and INT8/INT4 weight-only compression to ensure accuracy parity with OpenVINO IR format models. SmoothQuant algorithm support was added for INT8 quantization.

Sign Up for Exclusive News, Tips & Releases

Be among the first to learn about everything new with the Intel® Distribution of OpenVINO™ toolkit. By signing up, you get early access product updates and releases, exclusive invitations to webinars and events, training and tutorial resources, and other breaking news.