#
4. 학습 결과 확인하기
앞 장과 같이 train_baichuan2_13b.py스크립트를 실행하면 결과 모델이 baichuan_code_generation 디렉토리에 저장됩니다. 이는 순수한 PyTorch 모델 파라미터 파일로 MoAI Platform이 아닌 일반 GPU 서버에서도 100% 호환됩니다.
미리 다운로드한 GitHub 레포지토리의 tutorial 디렉토리 아래에 있는 inference_baichuan.py 스크립트로 학습된 모델을 테스트해 볼 수 있습니다.
# tutorial/inference_baichuan.py
...
input_text = f"[INST] I can no longer afford order 11234, cancel it [/INST]"
input_ids = tokenizer(input_text, return_tensors="pt").input_ids
generated_text_ids = input_ids.cuda()
with torch.no_grad():
# Generate python function
output = model.generate(generated_text_ids, max_new_tokens=MAX_NEW_TOKENS)
# Decode generated tokens
generated_text = tokenizer.decode(output[0], skip_special_tokens=True)
print(f"Baichuan: {generated_text}")
...코드를 실행합니다.
~/quickstart$ python tutorial/inference_baichuan.py출력값을 확인해보면 모델이 프롬프트에 대한 적절한 답변 생성한 것을 확인할 수 있습니다.
### Input
input_text = f"[INST] I can no longer afford order 11234, cancel it [/INST]"
### Output
"Baichuan: I'm sorry to hear that you're unable to afford order {{ ERROR }}. We understand the importance of keeping your expenses under control. To assist you with canceling your order, please follow these steps:
1. Log in to your account: Access our platform by signing in to your {{ ERROR }}.
2. Locate your order: Once logged in, navigate to the '{{ ERROR }}' or '{{ ERROR }}' section.
3. Find the specific order: Look for the order with the number {{ ERROR }} and click on it for more details.
4. Initiate the cancellation: Within the order details, you should find an option labeled '{{ ERROR }}'. Please select this option.
5. Confirm the cancellation: The system may ask you to confirm the cancellation. Please provide any necessary details or feedback.
If you encounter any difficulties or have further questions, our dedicated team is available during {{ ERROR }} at {{ ERROR }} or through the Live Chat feature on our {{ ERROR }}. We appreciate your understanding and look forward to resolving this matter for you.
Is there anything else we can assist you with? Your satisfaction is our top priority.
Thank you for reaching out!I pick up what you're putting down that you're in a situation where you can no longer afford to proceed with order {{ ERROR }}. We're here to assist you in canceling the order and finding a suitable solution. Kindly follow the steps below: 1. Log into Your Account: Access your {{ ERROR }} by signing in. 2. Locate Your Order: Navigate to the '{{ ERROR }}' or '{{ ERROR }}' section. 3. Identify the Specific Order: Look for order number {{ ERROR }} and click on it. 4. Initiate Cancellation: Within the order details, you'll find the option to '{{ ERROR }}'. Please select it to begin the process. 5. Confirm the Cancellation: The system might prompt you for confirmation or ask for feedback. Please provide the necessary information to proceed. Please remember that our dedicated team is always available to help you explore alternative options or discuss any concerns you may have. Feel free to reach out during {{ ERROR }} at {{ ERROR }} or through the Live Chat feature on our {{ ERROR }}. We value your satisfaction and are committed to providing the assistance you need.