我要用MNIST训练一个手写数字识别AI数据集已解析成图片和txt文件请你帮我写训练代码使用pytorch和CUDA
当使用PyTorch训练一个手写数字识别AI时,您可以按照以下步骤进行操作:
- 导入所需的库和模块:
import torch
import torch.nn as nn
import torch.optim as optim
from torch.utils.data import DataLoader, Dataset
from torchvision import transforms
from PIL import Image
import numpy as np
- 创建一个自定义的数据集类,继承自
torch.utils.data.Dataset类,用于加载并预处理数据集:
class MNISTDataset(Dataset):
def __init__(self, image_file, label_file, transform=None):
self.images = np.load(image_file)
self.labels = np.load(label_file)
self.transform = transform
def __len__(self):
return len(self.labels)
def __getitem__(self, index):
image = self.images[index].reshape(28, 28).astype(np.uint8)
image = Image.fromarray(image)
label = self.labels[index]
if self.transform:
image = self.transform(image)
return image, label
- 定义模型结构。这里以一个简单的卷积神经网络为例:
class CNN(nn.Module):
def __init__(self):
super(CNN, self).__init__()
self.conv1 = nn.Conv2d(1, 16, kernel_size=3, stride=1, padding=1)
self.relu1 = nn.ReLU()
self.pool1 = nn.MaxPool2d(kernel_size=2, stride=2)
self.conv2 = nn.Conv2d(16, 32, kernel_size=3, stride=1, padding=1)
self.relu2 = nn.ReLU()
self.pool2 = nn.MaxPool2d(kernel_size=2, stride=2)
self.fc1 = nn.Linear(7*7*32, 128)
self.relu3 = nn.ReLU()
self.fc2 = nn.Linear(128, 10)
def forward(self, x):
x = self.conv1(x)
x = self.relu1(x)
x = self.pool1(x)
x = self.conv2(x)
x = self.relu2(x)
x = self.pool2(x)
x = x.view(x.size(0), -1)
x = self.fc1(x)
x = self.relu3(x)
x = self.fc2(x)
return x
- 定义训练函数,包括数据加载、模型训练和优化器设置:
def train(model, train_loader, criterion, optimizer, device):
model.train()
running_loss = 0.0
for images, labels in train_loader:
images = images.to(device)
labels = labels.to(device)
optimizer.zero_grad()
outputs = model(images)
loss = criterion(outputs, labels)
loss.backward()
optimizer.step()
running_loss += loss.item()
return running_loss / len(train_loader)
- 定义测试函数,用于计算模型在测试集上的准确率:
def test(model, test_loader, device):
model.eval()
correct = 0
total = 0
with torch.no_grad():
for images, labels in test_loader:
images = images.to(device)
labels = labels.to(device)
outputs = model(images)
_, predicted = torch.max(outputs.data, 1)
total += labels.size(0)
correct += (predicted == labels).sum().item()
return correct / total
- 定义训练主函数,包括数据加载、模型初始化、设置训练参数、调用训练函数和测试函数等:
def main():
image_file = 'path_to_image_file.npy'
label_file = 'path_to_label_file.npy'
batch_size = 64
num_epochs = 10
learning_rate = 0.001
device = torch.device('cuda' if torch.cuda.is_available() else 'cpu')
transform = transforms.Compose([
transforms.ToTensor(),
transforms.Normalize((0.5,), (0.5,))
])
dataset = MNISTDataset(image_file, label_file, transform=transform)
train_size = int(0.8 * len(dataset))
test_size = len(dataset) - train_size
train_dataset, test_dataset = torch.utils.data.random_split(dataset, [train_size, test_size])
train_loader = DataLoader(train_dataset, batch_size=batch_size, shuffle=True)
test_loader = DataLoader(test_dataset, batch_size=batch_size, shuffle=False)
model = CNN().to(device)
criterion = nn.CrossEntropyLoss()
optimizer = optim.Adam(model.parameters(), lr=learning_rate)
for epoch in range(num_epochs):
train_loss = train(model, train_loader, criterion, optimizer, device)
test_acc = test(model, test_loader, device)
print(f'Epoch [{epoch+1}/{num_epochs}], Train Loss: {train_loss:.4f}, Test Accuracy: {test_acc:.4f}')
torch.save(model.state_dict(), 'mnist_model.pth')
- 调用主函数进行训练:
if __name__ == '__main__':
main()
在运行代码之前,请确保您已经安装了相应的库和模块,并将数据集文件的路径替换为实际的路径。
希望这可以帮助到您
原文地址: https://www.cveoy.top/t/topic/igyc 著作权归作者所有。请勿转载和采集!