Skip to content

reproduce-mlperf-octoml-tinyml-results

Automatically generated README for this automation recipe: reproduce-mlperf-octoml-tinyml-results

Category: Reproduce MLPerf benchmarks

License: Apache 2.0

  • Notes from the authors, contributors and users: README-extra

  • CM meta description for this script: _cm.json

  • Output cached? True

Reuse this script in your project

Install MLCommons CM automation meta-framework

Pull CM repository with this automation recipe (CM script)

cm pull repo mlcommons@cm4mlops

cmr "reproduce tiny results mlperf octoml mlcommons" --help

Run this script

Run this script via CLI
cm run script --tags=reproduce,tiny,results,mlperf,octoml,mlcommons[,variations] [--input_flags]
Run this script via CLI (alternative)
cmr "reproduce tiny results mlperf octoml mlcommons [variations]" [--input_flags]
Run this script from Python
import cmind

r = cmind.access({'action':'run'
              'automation':'script',
              'tags':'reproduce,tiny,results,mlperf,octoml,mlcommons'
              'out':'con',
              ...
              (other input keys for this script)
              ...
             })

if r['return']>0:
    print (r['error'])
Run this script via Docker (beta)
cm docker script "reproduce tiny results mlperf octoml mlcommons[variations]" [--input_flags]

Variations

  • No group (any combination of variations can be selected)

    Click here to expand this section.

    • _NRF
      • ENV variables:
        • CM_TINY_BOARD: NRF5340DK
    • _NUCLEO
      • ENV variables:
        • CM_TINY_BOARD: NUCLEO_L4R5ZI
    • _ad
      • ENV variables:
        • CM_TINY_MODEL: ad
    • _cmsis_nn
      • ENV variables:
        • CM_MICROTVM_VARIANT: microtvm_cmsis_nn
    • _ic
      • ENV variables:
        • CM_TINY_MODEL: ic
    • _kws
      • ENV variables:
        • CM_TINY_MODEL: kws
    • _native
      • ENV variables:
        • CM_MICROTVM_VARIANT: microtvm_native
    • _vww
      • ENV variables:
        • CM_TINY_MODEL: vww

Script flags mapped to environment

  • --flash=value → CM_FLASH_BOARD=value
  • --recreate_binary=value → CM_RECREATE_BINARY=value

Versions

Default version: r1.0

  • r1.0

Native script being run

No run file exists for Windows

Script output

cmr "reproduce tiny results mlperf octoml mlcommons [variations]" [--input_flags] -j