Warning
This page was translated from the original Japanese version by PLaMo Translate. The Japanese version is authoritative; the English translation may contain inaccuracies.
PFCP Tutorial: Using MN-Core with PyTorch
This document explains how to use MN-Core through the Machine Learning Software Development Kit (MLSDK).
What is MLSDK?
MLSDK is a software development environment that includes compilers, runtime software stacks, and documentation to enable the use of MN-Core with PyTorch. While its name includes “Machine Learning” (ML), it can be equally used for developing high-performance computing software in domains beyond machine learning.
Setting Up Your Environment
To configure your environment, use the “Workspace” feature to create an interactive development environment on your cluster.
- Navigate to the Workspace page in the portal and click the Create New button.
- Fill out the form and click the Create button.
| Field Name | Value |
|---|---|
| Namespace | Select your organization’s root namespace |
| Workspace Name | Enter any desired name |
| Owner | Individually isolated |
| Preset | default |
| Priority Class | (unspecified) (uses dedicated nodes) For shared nodes, select shared-best-effort |
| CPU | 7000m |
| Memory | 125Gi |
| MN-Core 2 | 1 |
Note
Add Persistent Storage
Any file modifications made to paths without mounted persistent storage will be lost and not persisted. To ensure your changes are preserved, allocate new storage from “Add Persistent Storage,” mount it to a path like
/data, and save your files there.
Accessing Your Environment
Access your development environment (JupyterLab) by clicking the link in the URL column of your created workspace.
Note
Creating workspaces may take some time.
If creation doesn’t complete after a reasonable period, check that the values entered in the form were correct. Try creating it again.
Open a terminal by clicking the “Launcher → Other / Terminal” button in JupyterLab.
In the terminal, run the following command to verify the MN-Core 2 devices connected to your environment (the output will vary depending on the allocated devices):
$ gpfn3-smi list
0: mnc2p28s0
If you don’t see any output, double-check your workspace configuration for any errors.
Starting the MLSDK Tutorial
Refer to the MLSDK documentation to begin the tutorial. The MLSDK tutorial documentation is also included in the container image, so you can use that version as well.
$ cat /opt/pfn/pfcomp/codegen/MLSDK/README.md
Deleting Your Environment
After you no longer need your environment, delete it from the portal page.
- Access the Workspace page in the portal.
- Click Delete from the ⋯ button for the workspace you wish to remove.