This document describes the rules governing publication of results derived from running the BAPCo® MobileMark® 2007 benchmark. Any licensee who wishes to publish such results is obliged to adhere to all rules and regulations described in this document or other documents provided by BAPCo related to execution and reporting of MobileMark 2007 benchmark results.
BAPCo reserves the right to change the rules outlined in this document at any time. Licensees are encouraged to consult the BAPCo website at www.bapco.com for the latest information regarding execution and publication rules. For more information please consult the Software License Agreement.All MobileMark 2007 benchmarks must be run using the provided MobileMark 2007 software program. The MobileMark 2007 program generates log files that include all pertinent run-time data. It also includes a section of the GUI that generates the final benchmark results for the system under test. All results published may be taken only from a complete and correct execution of MobileMark 2007 benchmarks under the control of the MobileMark 2007 program. All tests must be performed without modification to any part of the MobileMark 2007 software program. The collective set of hardware and software used in generation of an official MobileMark 2007 result must be available to the public as defined by BAPCo availability criteria. Any derivative runs which seek to illustrate further potential, must be anchored by at least one conforming reference run. The following specific rules apply:
Operating System: The operating system used to generate official results must be an official, release-quality, publicly obtainable release from the original software vendor. BETA and interim development releases of the operating system are not supported. Whereas it is highly recommended to use operating system releases listed on BAPCo website, licensees are free to publish results generated from official MobileMark 2007 runs executed on publicly available release-quality operating systems only (available from the original vendor). Upgrades of specific drivers that are released and maintained by vendors other than the operating system vendor (e.g. graphics drivers, disk drivers, motherboard setting files, multimedia drivers, codecs) are allowed provided they are publicly available release-quality drivers from actual original vendors of such drivers. Licensees may also use operating system service packs provided they are publicly available, release quality and available from the original vendor. Licensees should also consult license agreements from individual software vendors to ensure compliance with any vendor benchmark restrictions.
Performance-Enhancing Utilities: Use of performance-enhancing utilities or techniques is allowed provided that the utility or technique is publicly available release-quality software from the original vendor. The utility needs to be documented and such techniques should not compromise the integrity of the system under test or the benchmark. This documentation must be fully disclosed when publishing results and included with additional notation accompanying any Full Disclosure Report submitted to BAPCo. BAPCo shall reserve the right to review the usage of such tools or techniques and invalidate published results if need be. BAPCo does not provide support for performance-enhancing utilities.
Hardware: The system hardware used to generate official MobileMark 2007 results must be publicly available at the time of publication or within 60 days thereafter. The system must be purchasable as a complete platform from an Original Equipment Manufacturer within 60 days of publication. Alternatively, licensees may report results for systems which may not be available from an OEM but whose individual components are publicly available and purchasable from various vendors at the time of publication or within 60 days thereafter. Note that the 60-day grace period does not apply to system software. All software used must be publicly available, of release-quality, and available from the original software vendor at the time of submission.
Display brightness: The user perceived display brightness must stay constant throughout the course of the benchmark. The display brightness should be measured for a white screen while on battery and must be set at the lowest possible setting greater than or equal to 60 nits. The display brightness based upon the display brightness of a white screen must not drop lower than the initial setting during the test. Thus all features capable of lowering the brightness of a white screen must be disabled (examples of these features are panels that lower brightness as the battery discharges and ambient light sensors). It is required that the nit level be disclosed when publishing results and included with additional notation accompanying any Full Disclosure Report submitted to BAPCo. If a luminance meter is not available it is not possible to submit an FDR (note that a luminance meter is a device which measures nits, and is not the same as a light meter, which measures lux).
Refresh rate: The screen refresh rate on the panel should be set to a minimum of 60 Hertz using the OS level control panels. Features capable of lowering the refresh rate must be disabled.
Audio: Headphones or speakers provide an outlet for the audio load and must remain connected during the DVD module. The audio is to be adjusted so that it is comfortably audible through the headphones or speakers. Some noise cancelling headphones may carry a battery-life overhead and for this reason BAPCo does not recommend their use during MobileMark 2007 testing.Battery conditioning: To improve repeatability and consistency of results, batteries should be conditioned prior to running MobileMark 2007 and submitting FDRs.
Network settings: On the productivity module, it is suggested that unused interfaces, including Bluetooth, Wifi, and WWAN, are disabled but all settings must be declared in FDR submission.MobileMark 2007 contains several, separate tests which may be disclosed. These tests are Office Productivity, Reader, DVD playback, and Wireless server. Concurrent reporting of all tests is not required (e.g., the results for DVD may be submitted without submitting the Office Productivity results).
Any Licensee may publish results but only those results obtained through a Full Disclosure Report. Licensees may either publish performance results relating to MobileMark 2007 in a medium of their choice and/or by submitting results for publication on www.bapco.com.
It is considered ‘best practice’ to submit all Full Disclosure Reports generated by MobileMark 2007 with BAPCo prior to publication (see ‘Submitting an FDR’ below).
Licensees that do not file Full Disclosure Reports must make available to BAPCo upon its request, any published Full Disclosure Report within five business days. Full Disclosure Report records not submitted to BAPCo must be kept and maintained by the licensee until BAPCo retires the benchmark (see www.bapco.com for list of retired benchmarks). BAPCo reserves the right to revoke the license granted to licensees who fails to adhere to these terms.
At a minimum all licensees are strongly encouraged to submit at least one FDR per ‘platform’ as to benefit the community of BAPCo users, who regularly use published FDR data from BAPCo’s website for comparative and analytical purposes.The submitted FDRs are processed by BAPCo and classified as:
Released: the results are released for publication as filed Rejected: the results are rejected for publication as filed
The Released classification is in no way a validation or an endorsement of the results by BAPCo. BAPCo will perform frequent audits of submitted FDRs and reserves the right to revoke the license granted to licensees who have not adhered to the regulations described in this or any other MobileMark documents.
In the case where a report which has been submitted or been requested is returned to the licensee “Rejected”, the licensee must immediately cease and/or publish a retraction of the rejected results until the matter is clarified.
Any publication of results must be accompanied by, at a minimum, the complete notebook name, model number, physical screen size, native panel resolution plus any changes between the configuration of the stated notebook name and the configuration of the system tested (also see Publication of Results on Non-OEM Platforms below).
The term "MobileMark" is a trademark of the Business Applications Performance Corporation (BAPCo) and may only be used in conjunction with performance and/or battery life metrics generated by the MobileMark software program. Any other performance and/or battery life characterizations may be made but must be derived from the performance metrics and/or battery life generated by the MobileMark program. The terms "MobileMark" and "MobileMark 2007" may not be used as the performance and/or battery life metrics describing such characterizations. BAPCo Benchmark Disclaimer: Business Applications Performance Corporation (BAPCo) is a non-profit, member organization of companies in the computing industry. Its mission is to create benchmark products that compare performance and/or battery life among computer systems, with particular view to business applications, as fairly and impartially as possible, in the light of the latest developments in technology and trends in usage. BAPCo products result from collaborative balancing and integration of technical input from participating members and experts, and reflect their professional judgment. We believe that BAPCo benchmarks are relevant and impartial measures for comparing general system performance and/or battery life on widely used business applications. BAPCo recognizes, however, that performance and/or battery life measures intrinsically involve subjective values, preferences, and priorities, which vary from user to user. BAPCo does not claim or warrant that the balances of system values, preferences, and priorities reflected in its benchmark products will coincide with those of any particular user.
Licensees may publish results on competitor systems as long as the performance results for the competitor have been published previously at www.bapco.com. In the case where competitor performance results are not available, the competitor will be notified by BAPCo and given fifteen working days to provide a counter-FDR for its own system or challenge the submitted FDRs (results). The submitted results may not be published until the fifteen-day waiting period has expired and all matters with respect to any counter-FDRs have been resolved by BAPCo. In the absence of a response from the competitor after fifteen days, the original publishing licensee may begin publication. Industry publications may publish results for making competitive comparisons without being subject to the above procedure. Publications are, however, subject to all other regulations set forth in this document.
* All brand and product names are trademarks or registered trademarks of their respective holders.