#
1. Preparing for Fine-tuning
Preparing the PyTorch script execution environment on the MoAI Platform is similar to doing so on a typical GPU server.
For a smooth tutorial experience, the following specifications are recommended:
CPU: 16 cores or more
Memory: 256GB or more
MAF version: 24.5.0
Storage: 55GB or more
Please verify that your environment meets these requirements before starting the tutorial.
#
Checking PyTorch Installation
After connecting to the container via SSH, run the following command to check if PyTorch is installed in the current conda environment:
$ conda list torch
...
# Name Version Build Channel
torch 1.13.1+cu116.moreh24.5.0 pypi_0 pypi
...
The version name includes both the PyTorch version and the MoAI version required to execute it.
In the example above, it indicates that PyTorch version 1.13.1+cu116 is running with MoAI version 24.5.0 installed.
If you encounter a conda: command not found
message, or if the torch package is not listed, or if the torch package exists but does not include "moreh" in the version name, please follow the instructions in the Prepare Fine-tuning on MoAI Platform to create a conda environment.
If the moreh version is not 24.5.0 but a different version, please execute the following code.
$ update-moreh --target 24.5.0
Currently installed: 24.3.0
Possible upgrading version: 24.5.0
Do you want to upgrade? (y/n, default:n)
y
#
Verifying PyTorch Installation
Run the following command to ensure that the torch package is imported correctly and the MoAI Accelerator is recognized.
$ python
Python 3.8.18 (default)
[GCC 11.2.0] :: Anaconda, Inc. on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import torch
...
>>> torch.cuda.device_count()
1
>>> torch.cuda.get_device_name()
[info] Requesting resources for MoAI Accelerator from the server...
[info] Initializing the worker daemon for MoAI Accelerator
[info] [1/1] Connecting to resources on the server (192.168.110.00:24158)...
[info] Establishing links to the resources...
[info] MoAI Accelerator is ready to use.
'MoAI Accelerator'
>>> quit()
#
Download the Training Script
Execute the following command to download the PyTorch script for training from the GitHub repository.
In this tutorial, we will be using the train_baichuan2_13b.py
script located inside the tutorial
directory.
$ sudo apt-get install git
$ git clone https://github.com/moreh-dev/quickstart.git
$ cd quickstart
~/quickstart$ ls tutorial
... train_baichuan2.py ...
#
Install Required Python Packages
Execute the following command to install third-party Python packages required for script execution:
$ pip install -r requirements/requirements_baichuan.txt