Skip to content

get-dataset-imagenet-val

Automatically generated README for this automation recipe: get-dataset-imagenet-val

Category: AI/ML datasets

License: Apache 2.0

  • Notes from the authors, contributors and users: README-extra

  • CM meta description for this script: _cm.json

  • Output cached? True

Reuse this script in your project

Install MLCommons CM automation meta-framework

Pull CM repository with this automation recipe (CM script)

cm pull repo mlcommons@cm4mlops

cmr "get val validation dataset imagenet ILSVRC image-classification original" --help

Run this script

Run this script via CLI
cm run script --tags=get,val,validation,dataset,imagenet,ILSVRC,image-classification,original[,variations] [--input_flags]
Run this script via CLI (alternative)
cmr "get val validation dataset imagenet ILSVRC image-classification original [variations]" [--input_flags]
Run this script from Python
import cmind

r = cmind.access({'action':'run'
              'automation':'script',
              'tags':'get,val,validation,dataset,imagenet,ILSVRC,image-classification,original'
              'out':'con',
              ...
              (other input keys for this script)
              ...
             })

if r['return']>0:
    print (r['error'])
Run this script via Docker (beta)
cm docker script "get val validation dataset imagenet ILSVRC image-classification original[variations]" [--input_flags]

Variations

  • No group (any combination of variations can be selected)

    Click here to expand this section.

    • _2012-500
    • _2012-full
    • _run-during-docker-build

  • Group "count"

    Click here to expand this section.

    • _full
      • ENV variables:
        • CM_DATASET_SIZE: 50000
        • CM_IMAGENET_FULL: yes
        • CM_DAE_FILENAME: ILSVRC2012_img_val.tar
        • CM_DAE_DOWNLOADED_CHECKSUM: 29b22e2961454d5413ddabcf34fc5622
    • _size.#
      • ENV variables:
        • CM_DATASET_SIZE: #
    • _size.500 (default)
      • ENV variables:
        • CM_DATASET_SIZE: 500
        • CM_DAE_FILENAME: ILSVRC2012_img_val_500.tar
        • CM_DAE_URL: http://cKnowledge.org/ai/data/ILSVRC2012_img_val_500.tar

  • Group "dataset-version"

    Click here to expand this section.

    • _2012 (default)
      • ENV variables:
        • CM_DATASET_VER: 2012
Default variations

_2012,_size.500

Script flags mapped to environment

  • --imagenet_path=value → IMAGENET_PATH=value
  • --torrent=value → CM_DATASET_IMAGENET_VAL_TORRENT_PATH=value

Native script being run

No run file exists for Linux/macOS

Script output

cmr "get val validation dataset imagenet ILSVRC image-classification original [variations]" [--input_flags] -j