From Markus Levy
President

EEMBC BenchPress
September 2015

BenchPress

Topics

  • Elektronik Analyzes Ultra-Low Power Microcontroller Claims
  • Tom’s Hardware Describes Mobile Device Benchmarking Process
  • Update on ULPBench Results: Atmel and STMicro
  • IoT Benchmark Project Moves Forward
  • ScaleMark: EEMBC’s Benchmark Suite for Cloud and Scale-out Servers Enters Beta Stage
  • Linaro Connect
  • Linley Processor Conference
  • Renesas DevCon
  • Light Reading’s Next Generation Network Components
  • ARM TechCon
  • Free Benchmark Downloads

Elektronik Analyzes Ultra-Low Power Microcontroller Claims

Dr. Claus Kühnel (Director Head of Embedded Systems at QIAGEN Instruments AG) and Frank Riemenschneider (editor-in-chief of Design & Elektronik) tested the claims of the ‘ultra-low power marketing messages’ of every well-known MCU vendor. This exercise was performed within Elektronik as an Elektronik-Projekte, a unique set of articles with deep technical focus. With the support of each vendor, Claus and Frank configured the microcontroller boards, built the EEMBC ULPBench software, and utilized EEMBC EnergyMonitor to make measurements. Their results were originally published in Elektronik 16/2015, starting on page 26 on August, 11th. Available to read in several languages:

Tom’s Hardware Describes Mobile Device Benchmarking Process

In this article, Tom’s Hardware Editor, Matt Humrick, explains their strict testing procedures used to obtain accurate benchmark data on smartphones and tablets. This article is definitely one of the more elaborate explanations of benchmarking procedures I’ve ever seen. Furthermore, it’s cool that EEMBC’s AndEBench-Pro is a key component of this testing. Read more

More articles (including AndEBench-Pro) from Tom’s Hardware:

Update on ULPBench Results

Recently published EEMBC certified results for the following microcontrollers:

Atmel SAML21J18A-UES RevA - DC1506 – The ULPBench score for the Atmel|SMART Cortex-M0+ based SAM L21 was certified with a score of 185.50. This is aligned with what was reported by Atmel in their own measurements, showing the robustness of the ULPBench EnergyMonitor and setting a new high score for certified ULPBench results. The SAM L21 is Flash based and uses an Atmel-developed ultra-low power process in combination with power islands, caches, and efficient regulators. Having a benchmark that allows you to compare power consumption across CPU cores and memory technologies is unique to ULPBench and a great yardstick for developers in the early stages of device evaluation.

STMicroelectronics STM32L476RG – The certification, yielding a score of 153, was performed on the identical microcontroller+board that STMicro used when they independently submitted the ULPBench result of 123.5. Why do these two results differ by 23%? The compiler. With the former, ST used the IAR C/C++ compiler for ARM (v6.60.1.5097), while the latter utilized ARMCC (5.04.0.49). Stating the obvious – with ULPBench, the compiler choice will affect the benchmark’s active mode component.

IoT Benchmark Project Moves Forward

In May, EEMBC announced its new IoT working group focused on benchmarks to allow application developers to quickly and equitably compare the efficiency of systems targeted at IoT edge nodes. The initial benchmark profiles will focus on microcontrollers, low-power Bluetooth and ZigBee devices, modules, and software stacks. The working group chairs (Mark Wallis of STMicro and Brent Wilson of Silicon Labs) encourage all interested parties to join this working group to help determine the details of this IoT benchmark and ensure the benchmarks are representative of all possible scenarios. Contact Markus Levy.

Additional articles on the subject:

ScaleMark: EEMBC’s Benchmark Suite for Cloud and Scale-out Servers Enters Beta Stage

EEMBC Beta version of its new cloud and scale-out server benchmark suite, ScaleMark, is almost ready. It focuses on web caching and media streaming. This suite addresses the needs of ODMS, OEMS, and cloud and big-data users who deploy their applications in large distributed computer centers made up of clusters of servers. The industry has lacked a reliable, repeatable, portable, and architecture-neutral method to evaluate the latency and throughput of SoCs and associated servers for real-world cloud and big-data applications running at data centers – that all changes with ScaleMark. Interested in becoming a Beta tester (no charge) for ScaleMark? Contact Markus Levy

Linaro Connect

September 23rd is the LEG ARM Server Ecosystem Day at Linaro Connect. Markus Levy (EEMBC) and Bryan China (Cavium) will present “Understanding Performance Results for Servers in the Data Center.”

Linley Processor Conference

The Linley Group will hold its annual processor conference on October 6-7 in Santa Clara, CA. EEMBC is exhibiting, so stop by and check out our benchmark updates.

Renesas DevCon

The biennial Renesas DevConOn will be held in Orange County from October 12-15. EEMBC will be exhibiting and demoing its EnergyMonitor and ULPBench and discussing its upcoming IoT benchmark. EEMBC president, Markus Levy, also joins an illustrious panel of speakers for the topic of IoT security.

Light Reading’s Next Generation Network Components

Join Light Reading on November 5 in Santa Clara for a day of presentations and demonstration of Next Generation Network Components. EEMBC will be there with a tabletop exhibit.
EEMBC members – contact Markus Levy to obtain your special discount code.

ARM TechCon

Bryan Chin (Cavium) and Markus Levy will co-present “How (Not) to Generate Misleading Performance Results for ARM Servers“ at the ARM TechCon, taking place November 10-12 at the Santa Clara Convention Center.

Free Benchmark Downloads

  • Free CoreMark®-Pro download. CoreMark-Pro includes testing support for multicore technology, a combination of integer and floating-point workloads, and data sets for stressing larger memory subsystems.
  • Trial version of BrowsingBench.
  • Download AndEBench-Pro 2015 for free from Google Play™ and the Amazon™ Appstore for Android. As with all EEMBC benchmarks, the transparent availability of source code for AndEBench-Pro ensures that the benchmark is structurally sound and serves the industry’s demanding needs. Professional reviewers can contact EEMBC directly to obtain their specific version of AndEBench-Pro 2015 enabling them to change benchmarking parameters and gain access to even more detailed scoring information that is not disclosed with the standard benchmark.

If you do not wish to receive e-mail from EEMBC, you can un-subscribe. EEMBC sends no more than one e-mail per month to registered users at www.eembc.org. Continuing your subscription ensures you'll be notified when new scores and other important announcements are available.