Before attempting to install or run SYSmark 2012, verify that the test system meets the recommended minimum system configuration for running the benchmark.
CPU: 1.8 GHz dual core processor
RAM: 2 GB
HDD/SSD: 50 GB of free space on the primary drive
Operating System: Microsoft® Windows Vista® 64-bit or Microsoft® Windows 7® 64-bit
Resolution: 1024x768
Graphics: DirectX 9 compatible
Image configuration
For best results, SYSmark 2012 should be installed to a clean instance of a supported operating system, with updated hardware drivers. See the
Applications section for a list of application software installed by the benchmark. A list of image configuration guidelines is provided below. Note that SYSmark 2012 now includes an integrated configuration tool that will disable these items. See the
Usage section for more details
Administrative rights: An account with administrative privileges is required to install and
run SYSmark 2012.
User Account Control: Disable UAC on the test system.
Uninstall known conflicting software: Pre-existing software installations may conflict with
the software installed by SYSmark 2012.
Require password on wake up: Disable this option under the advanced power management
properties for the profile being used for the test.
Screen saver: Disable screen saver.
Windows Defender: Disable Windows Defender.
Firewalls: Disable any firewall software.
Windows Update: Disable Windows update.
Anti-virus software: Uninstall AV software.
SYSmark® 2012 installation
To install SYSmark 2012, insert DVD 1 from the installation media set into the test system's optical drive. Launch SYSmark2012_Setup.exe and follow the prompts to install the benchmark software. If User Account control has not been turned off please right click the SYSmark2012_Setup.exe file and choose 'Run as Administrator' from the context menu.
Figure 1: SYSmark 2012 installer window.
A serial number is provided with the benchmark purchase. Record the serial number for safe keeping, as it will be required for installation.
Figure 2: Enter your provided SYSmark 2012 serial number to proceed with installation.
Figure 3 shows the default full installation of the benchmark. All core components, all scenarios and the results browser will be installed.
Figure 3: Default full install of SYSmark 2012
The installer also supports custom installation options as shown in Figure 4. Uncheck the components you do not wish to install. The SYSmark® 2012 component is required when installing any benchmark scenario. Scenarios not installed will not be available for selection when running the benchmark. Note: To obtain an overall system performance score and FDR valid for publication at
www.bapco.com/support/fdrs all scenarios must be completed.
Figure 4: Uncheck the components for custom installation.
Upon successful completion of installation, SYSmark 2012 will display a window as shown in Figure 5 below
Figure 5: Installation of SYSmark 2012 has completed successfully.
SYSmark 2012 may also be installed through the command line. Replace xxxxx-xxxxx-xxxxx-xxxxx-xxxxx with your provided serial number. The following command line switches are available:
- /S - silent install, no GUI
- /SN=<serial number> - install with supplied serial number
- /SerialNumber=<serial number> - install with supplied serial number
- Both /SN and /SerialNumber are case insensitive
Example
To install SYSmark 2012 from the command line, open a command prompt, change to the directory where the SYSmark2012_Setup.exe file is located and issue the following command.
C:\>start /wait SYSmark2012_Setup.exe /S /SN=xxxxx-xxxxx-xxxxx-xxxxx-xxxxx
Installer exit codes
When complete, the installer will return an exit code (stored in
%ERRORLEVEL%). See below for the exit codes and their meanings:
- 0 - Success
- 3010 - Success, reboot required
- 1 - Installation abort by user
- 2 - General installation problem
- 3 - Missing or invalid serial number
- 4 - The following applications must be uninstalled before installing SYSmark 2012
- 5 - SYSmark 2012 (64-bit) can only be installed on 64 bit machines
- 6 - SYSmark 2012 installer is already running
- 7 - Installer must be run from the top level installer: SYSmark2012_Setup.exe
- 8 - Disc 2 version does not match the version in Disc 1
- 9 - Application installation missing. Invalid installation. Please uninstall and reinstall SYSmark 2012
- 10 - Installation directory must be less than 145 characters.
- 11 - Installer cannot find Disc2 media
Usage
The SYSmark 2012 interface may be launched by
- Double clicking the SYSmark 2012 desktop icon
- Navigating to
C:\Program Files (x86)\BAPCo\Sysmark2012\bin\ directory in Windows Explorer and double clicking the SYSmark 2012.exe file
- From the Start menu: Start>All Programs>BAPCo and clicking the SYSmark 2012 menu icon
Important: If User Account Control has not been previously disabled, right click the icon and choose 'Run as administrator'. UAC can then be disabled using the integrated configuration tool. More information on the integrated configuration tool is available in the
Automated Configuration section below
The benchmark interface window will open as illustrated in Figure 6:
Figure 6: SYSmark 2012 interface shown with default scenario and iteration selections. Notice that the conditioning run is not selected by default.
Launch benchmark project from GUI
- Project name: Type the desired project name in the 'Project name' field. Spaces and underscores are permitted. Special characters such as (*,$,@,) are not supported in project names
- Scenarios: Default value: selected if installed. Scenarios not installed at install time are not available for selection in the GUI. Note: All six scenarios must be installed and selected for execution at project run time to produce an overall score and FDR valid for publication
- Iterations: Default value: 3. The user may adjust this value as required
- Conditioning run: Default value: not selected. Selecting the conditioning executes one iteration of the selected scenarios prior to executing the rest of the project to aid in stabilizing the system for repeatable results. The project FDR will indicate whether the conditioning run was executed. However, if executed, the conditioning run will not be included in the final scores for the project.
- Click the 'Run Benchmark' button to kick off the project
Automated Configuration
New for SYSmark 2012 , BAPCo has integrated a system configuration tool into the benchmark GUI to better assist users with configuring the system prior to executing the benchmark. This new integrated function is accessed by clicking on the 'Configuration' button, as indicated by the red arrow in the Figure 7 below.
Figure 7: SYSmark 2012 configuration button
The configuration tool window will display the options available for configuring the test system, as pictured in Figure 8 below. Note that Figure 8 displays the options that appear under Windows 7. Windows Vista supports a different set of options. Additional details are provided below.
Figure 8: SYSmark 2012 configuration options
System Configuration Tool Items List
The following is a list of configuration options with their priorities that can be applied using the System Configuration tool. The settings below apply to both Windows 7 and Windows Vista, unless otherwise noted.
Required
Make configuration changes that are required for the benchmark to run. These items are checked by default.
Recommended
Make configuration changes that are recommended in order to obtain repeatable scores. Recommended items are checked by default. Recommended items may be disabled by unchecking the corresponding box.
Optional
Make configuration changes that are typically not needed to obtain repeatable scores, but which may be needed in some rare cases. Optional items are not checked by default.
Create BAPCo Power Scheme - Recommended
Creates a new power scheme named "BAPCo SYSmark 2012" based on the system's currently active power scheme. If applied, all subsequent power profile configuration changes will be applied to the newly created power scheme. If this option is not checked, all power profile configuration changes will be applied to the currently active power scheme.
Set Power Plan Type To "High Performance" - Recommended
Sets the "Power Plan Type" option (sometimes referred to as "Power Plan Personality") of the active power scheme to "High Performance". This setting tags the active power plan with an overall personality that favors performance over energy savings. Drivers and applications may query this setting to determine their respective performance vs energy savings behavior.
This option may be used whether or not the "Create BAPCo Power Scheme" option is checked. If "Create BAPCo Power Scheme" is unchecked, "Set Power Plan Type" will be applied to the currently active power scheme.
Disable User Account Control (UAC) - Required
Disables User Account Control to prevent Administrator elevation prompts from appearing during benchmark runs. The system must be rebooted to apply this change.
Disable Windows Update - Required
Stops and disables the Windows Update service. Prevents the Windows Update service from starting and/or checking for updates during benchmark runs.
Disable Sleep and Hibernate - Required
Prevents the system from going to sleep or hibernate and disables the "Require password on wake" setting.
Disable Low Battery Action - Required
Prevents the system from shutting down or posting a warning when the battery reaches the low level.
Disable Network Proxies - Required
Disables proxy server configuration for Internet connection settings.
Disable Windows Firewall - Recommended
Stops and disables the Windows Firewall service. Prevents blocking of application functions during the benchmark run.
Disable Windows Sidebar/Gadgets - Recommended
Windows 7: Turns off Gadgets.
Windows Vista: Turns off the Vista Sidebar, and prevents Sidebar from starting at log in.
Disable Windows Pop-ups - Recommended
Disables all pop up notifications (Balloon tips) in the systray
Disable Incoming Remote Desktop Connections - Recommended
Denies remote desktop connection requests from remote systems.
Disable Windows Error reporting - Recommended
Prevents Windows Error reporting tool from presenting error reporting windows.
Disable Screen Saver and Monitor Timeout - Recommended
Turns off the screen saver. Disables display timeout in the power profile for both AC and DC options.
Set CPU High Performance - Recommended
Windows 7: Sets the minimum and maximum value for CPU performance state to 100% to prevent CPU throttling on both AC and DC power.
Set CPU High Performance (Vista) - Recommended
Windows Vista:
Sets CPU power C-state to High Performance for AC and DC power.
Sets CPU power P-state to High Performance for AC and DC power.
Sets the minimum and maximum value for CPU state to 100% to prevent CPU throttling on both AC and DC power.
Disable Desktop Slide Show - Recommended
Windows 7: Prevents the desktop background from changing.
Disable Disk Defrag - Recommended
Disables the Defrag scheduled task.
Disable Hard Disk Timeout - Optional
Prevents the hard disk from going to sleep
Disable Windows Defender - Optional
Windows 7 and Vista: Stops and disables the Windows Defender Service.
Windows Vista: Disables starting of Windows Defender application at log in.
Disable System Restore - Optional
Prevents System Restore from attempting to create restore points.
Ignore Laptop Lid Close - Optional
Prevent closing of Laptop lid from suspending the system.
Set Maximum Display Brightness - Optional
Windows 7: Sets display brightness to 100%. Sets dimmed display brightness to 100%. Sets "Dim Display After" value to "Never".
Windows Vista: Sets display brightness to 100%.
Set High Performance Indexing - Optional
Windows Vista: Sets Vista search and indexing power saving mode to high performance.
Launch System Configuration Tool from command line
The System Configuration Tool may be launched from the command line. Using the paramters below.
| -p or --profile="ProfileName" |
Specifies the configuration profile to apply. Profile names are case sensitive, and must be listed in the SystemConfig.xml file. The default profile is: SYSmark 2012 |
| -h or --help |
Displays the help dialog |
Example command line
"C:\Program Files (x86)\BAPCo\Sysmark2012\bin\System Configuration.exe" -p="SYSmark 2012"
Launching a benchmark project from command line
SYSmark 2012 also supports execution from the command line. Supported command line parameters are provided in the list below. The SYSmark 2012 GUI will launch if there are syntax errors in the command line text.
| -p or --project |
Specifies the name of the project. This option determines if the GUI is presented to the user, or if the benchmark runs silently. If this option is supplied, it is assumed that the GUI should not appear. |
| -i or --iterations |
Specifies the number of iterations to run. This must be greater than 0. The default is 3. |
| -r or --retries |
Specifies the number of retries when a script error occurs. The default is 5. |
| -w or --retrywait |
Specifies the amount of time in seconds to wait before a retry. The default is 120 seconds. |
| -s or --scenarios |
Specifies a comma separated list of scenario (groups) that should be run. The default is to run all scenarios that are selected in the aggregation template. This will normally be: OP, MC, WD, FA, 3D and SM. |
| -c or --conditioning |
Turns on system conditioning run. The default is off. |
| -h or --help |
Displays the help screen. |
| -a or --ipaddress |
Specifies the IP address of the system under test. If this specified, the benchmark will run in client/server mode, otherwise it will assume standalone mode. The default is standalone mode. |
| -v or --verbose |
Turns on verbose mode. The default is off. |
Example command line
"C:\Program Files (x86)\BAPCo\Sysmark2012\bin\SYSmark 2012.exe" -p test_project -i 4 -s OP,MC,FA
This subsection describes the behavior SYSmark 2012 during the execution of a benchmark run.
Heads Up Display (HUD)
The Heads Up Display appears in the upper right corner of the desktop and provides information about the currently running project.
Figure 9: BAPCo Heads Up Display.
Process idle tasks
Prior to executing benchmark workloads, the SYSmark 2012 workload manager will pause for 120 seconds to allow the system to stabilize. When the 120 seconds has elapsed, the workload manager will issue the process idle tasks command. When the idle tasks queue is cleared, the benchmark workload will begin. Note: Process idle tasks completion time can vary from system to system.
Keyboard/mouse input blocking
Once workload execution begins, the workload manager will the lock system to prevent accidental input from the mouse or keyboard from disrupting the workload automation. The workload manager will continue to execute the selected scenarios for the current project, and will display the results at the successful conclusion of the run. Refer to the Stopping a run in progress section below for additional information on keyboard and mouse input blocking.
Error handling
By default, when SYSmark 2012 encounters an error during the execution of a project, the workload manager will log the error and then present the user with the retry dialog, as pictured in Figure 10 below.
Figure 10: SYSmark 2012 retry dialog
Unless otherwise configured on the command line with
-r or --retries, SYSmark 2012 will attempt to retry a scenario up to five times. The default timeout between an error and scenario retry is 120 seconds.
This value can be changed on the command line using
-r or --retrywait. If the scenario cannot be successfully completed before the retry threshold is reached, the workload manager will halt execution and display the error message in the results browser.
SYSmark 2012 allows further control of error handling timeouts through the BENCHMARK_TIMEOUT_MULT environment variable. This variable can be configured to increase the amount of time a benchmark script waits before throwing an error and either attempting a retry or halting the run. The default value for BENCHMARK_TIMEOUT_MULT is 1.0. Increasing the value to 2.0 doubles the error handling timeout, 3.0 triples the timeout, and so on.
Stopping a run in progress
If it becomes necessary to stop a benchmark run in progress, follow these steps: