Skip to main content

Credentials path and management address

The credentials_path and mgmt_address parameters are set by default in /opt/cerebras/config and typically do not require explicit specification. An example configuration in /opt/cerebras/config might look like this:

Python paths and mount directories

When running jobs, it’s crucial to include paths required by dataloaders and any external Python packages, as well as the location of the Cerebras Model Zoo. Consider this directory structure as an example:
If input workers need to access the “my_dataset” directory and require Python modules from the Model Zoo, “package_x”, and “package_y”, you would specify the command like this:
If some paths have a common parent folder, you only need to specify the parent in the --mount_dirs or --python_paths arguments. For instance, if the Model Zoo is at /cb/home/user/modelzoo and data is at /cb/home/user/data, you only need to specify --mount_dirs /cb/home.
You can also set defaults for mount_dirs and python_paths in a YAML file and export it as an environment variable to streamline command line usage:
With this environment variable set, you won’t need to specify --mount_dirs and --python_paths when running a Cerebras Model Zoo job, unless you’re adding additional paths.