A newer version of this document is available. Customers should click here to go to the newest version.
Visible to Intel only — GUID: GUID-64E7886F-33F6-49D9-9629-9050AEE9957F
Visible to Intel only — GUID: GUID-64E7886F-33F6-49D9-9629-9050AEE9957F
Microarchitecture Exploration Analysis for Hardware Issues
Use the Microarchitecture Exploration analysis (formerly known as General Exploration) to triage hardware usage issues in your application.
Once you have used Hotspots analysis to determine hotspots in your code, run the Microarchitecture Exploration analysis to understand how efficiently your code is passing through the core pipeline. During Microarchitecture Exploration analysis, VTune Profiler collects a complete list of events for analyzing a typical client application. It calculates a set of predefined ratios used for the metrics and facilitates identifying hardware-level performance problems.
Intel® VTune™ Profiler is a new renamed version of the Intel® VTune™ Amplifier.
How It Works
The Microarchitecture Exploration analysis strategy varies by microarchitecture. For modern microarchitectures starting with Intel microarchitecture code name Ivy Bridge, the Microarchitecture Exploration analysis is based on the Top-Down Microarchitecture Analysis Method using the Top-Down Characterization methodology, which is a hierarchical organization of event-based metrics that identifies the dominant performance bottlenecks in an application.
Superscalar processors can be conceptually divided into the front-end, where instructions are fetched and decoded into the operations that constitute them, and the back-end, where the required computation is performed. Each cycle, the front-end generates up to four of these operations. It places them into pipeline slots that then move through the back-end. Thus, for a given execution duration in clock cycles, it is easy to determine the maximum number of pipeline slots containing useful work that can be retired in that duration. The actual number of retired pipeline slots containing useful work, though, rarely equals this maximum. This can be due to several factors: some pipeline slots cannot be filled with useful work, either because the front-end could not fetch or decode instructions in time (Front-end bound execution) or because the back-end was not prepared to accept more operations of a certain kind (Back-end bound execution). Moreover, even pipeline slots that do contain useful work may not retire due to bad speculation. Front-end bound execution may be due to a large code working set, poor code layout, or microcode assists. Back-end bound execution may be due to long-latency operations or other contention for execution resources. Bad speculation is most frequently due to branch misprediction.
Each cycle, each core can fill up to four of its pipeline slots with useful operations. Therefore, for some time interval, it is possible to determine the maximum number of pipeline slots that could have been filled in and issued during that time interval. This analysis performs this estimate and breaks up all pipeline slots into four categories:
Pipeline slots containing useful work that issued and retired (Retired)
Pipeline slots containing useful work that issued and cancelled (Bad speculation)
Pipeline slots that could not be filled with useful work due to problems in the front-end (Front-end Bound)
Pipeline slots that could not be filled with useful work due to a backup in the back-end (Back-end Bound)
To use Microarchitecture Exploration analysis, first determine which top-level category dominates for hotspots of interest. You can then dive into the dominating category by expanding its column. There, you can find many issues that may contribute to that category.
For a detailed tuning methodology behind the Microarchitecture Exploration analysis and some of the complexities associated with this analysis, see Understanding How General Exploration Works in Intel® VTune™ Profiler.
For architecture-specific Tuning Guides, visit https://software.intel.com/en-us/articles/processor-specific-performance-analysis-papers.
Configure and Run Analysis
To configure options for the Microarchitecture Exploration analysis:
Prerequisites: Create a project and specify an analysis target.
Click the
(standalone GUI)/
(Visual Studio IDE) Configure Analysis button on the Intel® VTune™ Profiler toolbar. The Configure Analysis window opens.
From HOW pane, click the
Browse button and select Microarchitecture Exploration. Configure the following options:
CPU sampling interval, ms spin box
Specify an interval (in milliseconds) between CPU samples.
Possible values - 1-1000.
The default value is 1 ms.
Extend granularity for the top-level metrics selection area
By default, VTune Profiler collects data required to compute top-level metrics (Front-End Bound, Bad Speculation, Memory Bound, Core Bound, and Retiring) and all their sub-metrics.
You may limit the data collection by selecting particular top-level metrics. In this case, the VTune Profiler extends the level of granularity and collects additional sub-metrics only for the selected top-level metrics. For example, if you select the Memory Bound top-level metric, the VTune Profiler collects additional data and provides Memory Bound sub-metrics (such as DRAM Bound, Store Bound, and so on), which helps narrow down the analysis to particular microarchitecture levels.
Limiting the amount of data collected simultaneously may also improve profiling accuracy due to less multiplexing. This may be particularly helpful for short-running application or applications with short phases.
Analyze memory bandwidth check box
Collect the data required to compute memory bandwidth.
The option is disabled by default.
Evaluate max DRAM bandwidth check box
Evaluate maximum achievable local DRAM bandwidth before the collection starts. This data is used to scale bandwidth metrics on the timeline and calculate thresholds.
The option is enabled by default.
Collection mode drop-down menu
Choose the Detailed sampling-based collection mode (default) to view a data breakdown per function and other hotspots. Use the Summary counting-based mode for an overview of the whole profiling run. This mode has a lower collection overhead and faster post-processing time.
Details button
Expand/collapse a section listing the default non-editable settings used for this analysis type. If you want to modify or enable additional settings for the analysis, you need to create a custom configuration by copying an existing predefined configuration. VTune Profiler creates an editable copy of this analysis type configuration.
NOTE:For detailed information on events collected for Microarchitecture Exploration on a particular microarchitecture, refer to the Intel Processor Event Reference.
You may generate the command line for this configuration using the
Command Line button at the bottom.
Click the
Start button to run the analysis.
View Data
To analyze the collected data, use the default Microarchitecture Exploration viewpoint that provides a high-level performance overview based on the Top-Down Microarchitecture Analysis Method. To easier understand where you could focus your optimization efforts and which part of the microarchitecture pipeline introduces inefficiencies, start with the Microarchitecture Pipe.