是的,PyTorch可以在CentOS上進行深度學習。以下是在CentOS上部署PyTorch并進行深度學習的基本步驟:
sudo yum update -y
sudo yum install -y python3 python3-pip
python3 -m venv deepseek-env
source deepseek-env/bin/activate
pip install torch torchvision torchaudio
pip install torch torchvision torchaudio --extra-index-url https://download.pytorch.org/whl/cu113
注意:根據你的CUDA版本,需要從PyTorch官網獲取對應的PyTorch安裝命令。
pip install transformers
from transformers import AutoModelForCausalLM, AutoTokenizer
model_name = "deepseek-ai/deepseek-large"
tokenizer = AutoTokenizer.from_pretrained(model_name)
model = AutoModelForCausalLM.from_pretrained(model_name)
input_text = "你好,DeepSeek!"
inputs = tokenizer(input_text, return_tensors="pt")
outputs = model.generate(**inputs)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))
import torch
device = torch.device("cuda" if torch.cuda.is_available() else "cpu")
model.to(device)
from fastapi import FastAPI
from transformers import AutoModelForCausalLM, AutoTokenizer
import torch
app = FastAPI()
# ...(省略模型加載和配置代碼)
@app.post("/generate")
async def generate(text: str):
inputs = tokenizer(text, return_tensors="pt").to(device)
outputs = model.generate(**inputs)
return {"response": tokenizer.decode(outputs[0], skip_special_tokens=True)}
# ...(省略啟動服務代碼)
以上步驟展示了如何在CentOS上安裝PyTorch并進行基本的深度學習任務。根據你的具體需求,可能還需要進行其他配置和優化。