Industry-Standard Benchmarks for Embedded Systems
EEMBC, an industry alliance, develops benchmarks to help system designers select the optimal processors and understand the performance and energy characteristics of their systems. EEMBC has benchmark suites targeting mobile devices (for phones and tablets), networking, ultra-low power microcontrollers, the Internet of Things (IoT), digital media, automotive, and other application areas. EEMBC also has benchmarks for general-purpose performance analysis including CoreMark, MultiBench (multicore), and FPMark (floating-point).
Introduction

This SecureMark benchmark suite will test and analyze various security profiles that should be implemented in IoT devices. Following EEMBC's long-standing tradition, we will provide application developers with accurate, reliable information and tools that allow them to quickly and equitably compare the efficiency of system solutions targeted at IoT end-point applications. The SecureMark benchmark will be based on popular profiles targeting different application areas.

Securing the IoT

In the present and foreseeable future, application developers will produce billions of IoT devices. Securing these devices has become a huge challenge, as IoT applications face many threats and defeating these requires an end-to-end, systems approach. Security involves hardware and software, algorithm and protocol, life-cycle and process challenges. And while security has become, or should be, a priority of application developers, they are typically concerned that implementing security functions within their IoT devices will hurt performance and lower battery life. Therefore, a critical goal of the EEMBC SecureMark benchmark will be to quantify the latency and energy impact of implementing security to allow developers to select the optimal combination of microcontroller, hardware, and/or software security products for their application.

Key Characteristics of the EEMBC SecureMark-TLS Benchmark
  • SecuremMark-TLS analyzes the costs associated with implementing TLS on an edge device using a common IoT cyphersuite comprised of ECC, SHA256, ECDSA, and AES128
  • Provides an industry-created and standardized tool for application developers to analyze security implementations
  • Includes multiple configuration profiles to represent the most popular IoT functions
  • Measures performance and energy
  • Tests the combination of microcontroller, hardware and/or software security products, and compiler options (size vs. speed tradeoffs)
Working Group Status
  • We are in beta-test, where members evaluate the release candidate software on their platforms. We are testing for compatibility and ensuring the workload has been properly balanced.
  • Estimated completion time for this phase is Q2 2018.
  • Join the EEMBC SecureMark benchmark working group to a) help determine the exact details of this IoT benchmark; b) ensure the benchmarks are representative of all possible scenarios; c) ensure that you don’t have a competitive disadvantage. Email EEMBC for more information.

Chairperson

  • Mike Borza, Synopsys
  • Ruud Derwig, Synopsys

Options for using EEMBC® Benchmark Software

  1. License one or more benchmark suites
  2. Join the EEMBC Board of Directors
  3. Join application-focused EEMBC subcommittee(s)

Request information on becoming a member or licensing benchmark software

Benefits of licensing and membership are summarized in the table below.

Benefit Licensee Board or Member
Access to benchmarks
X
X
Use benchmarks to test processor/system products
X
X
Ability to tune your system for best performance
X
X
Influence selection and design of next generation benchmarks
X
X
Ability to publish or disclose your scores
X
X
Free certifications
-
X
Early access to next-generation benchmarks
-
X
Recognition as a supporting member of an industry-standard organization
-
X
Use certified scores in marketing and advertising promotions
-
X
Network with other industry leaders from partner and competitor companies
-
X