Skip to content

Build transformers from sources

Automatically generated README for this automation recipe: install-transformers-from-src

Category: Compiler automation

License: Apache 2.0

  • CM meta description for this script: _cm.json
  • Output cached? True

Reuse this script in your project

Install MLCommons CM automation meta-framework

Pull CM repository with this automation recipe (CM script)

cm pull repo mlcommons@cm4mlops

cmr "install src from.src transformers src-transformers" --help

Run this script

Run this script via CLI
cm run script --tags=install,src,from.src,transformers,src-transformers[,variations]
Run this script via CLI (alternative)
cmr "install src from.src transformers src-transformers [variations]"
Run this script from Python
import cmind

r = cmind.access({'action':'run'
              'automation':'script',
              'tags':'install,src,from.src,transformers,src-transformers'
              'out':'con',
              ...
              (other input keys for this script)
              ...
             })

if r['return']>0:
    print (r['error'])
Run this script via Docker (beta)
cm docker script "install src from.src transformers src-transformers[variations]"

Variations

  • No group (any combination of variations can be selected)

    Click here to expand this section.

    • _branch.#
      • ENV variables:
        • CM_GIT_CHECKOUT: #
    • _for-intel-mlperf-inference-v3.1-bert
      • ENV variables:
        • CM_CONDA_ENV: yes
    • _sha.#
      • ENV variables:
        • CM_GIT_CHECKOUT_SHA: #
    • _tag.#
      • ENV variables:
        • CM_GIT_CHECKOUT_TAG: #

  • Group "repo"

    Click here to expand this section.

    • _repo.#
      • ENV variables:
        • CM_GIT_URL: #
    • _repo.https://github.com/pytorch/pytorch (default)
      • ENV variables:
        • CM_GIT_URL: https://github.com/huggingface/transformers
Default variations

_repo.https://github.com/pytorch/pytorch

Native script being run

No run file exists for Windows

Script output

cmr "install src from.src transformers src-transformers [variations]"  -j