- Deep Learning with PyTorch
- Vishnu Subramanian
- 328字
- 2021-06-24 19:16:29
Loading data into PyTorch tensors
The PyTorch torchvision.datasets package provides a utility class called ImageFolder that can be used to load images along with their associated labels when data is presented in the aforementioned format. It is a common practice to perform the following preprocessing steps:
- Resize all the images to the same size. Most of the deep learning architectures expect the images to be of the same size.
- Normalize the dataset with the mean and standard deviation of the dataset.
- Convert the image dataset to a PyTorch tensor.
PyTorch makes a lot of these preprocessing steps easier by providing a lot of utility functions in the transforms module. For our example, let's apply three transformations:
- Scale to a 256 x 256 image size
- Convert to a PyTorch tensor
- Normalize the data (we will talk about how we arrived at the mean and standard deviation in Chapter 5, Deep Learning for Computer Vision)
The following code demonstrates how transformation can be applied and images are loaded using the ImageFolder class:
simple_transform=transforms.Compose([transforms.Scale((224,224)),
transforms.ToTensor(),
transforms.Normalize([0.485, 0.456, 0.406], [0.229, 0.224, 0.225])])
train = ImageFolder('dogsandcats/train/',simple_transform)
valid = ImageFolder('dogsandcats/valid/',simple_transform)
The train object holds all the images and associated labels for the dataset. It contains two important attributes: one that gives a mapping between classes and the associated index used in the dataset and another one that gives a list of classes:
- train.class_to_idx - {'cat': 0, 'dog': 1}
- train.classes - ['cat', 'dog']
It is often a best practice to visualize the data loaded into tensors. To visualize the tensors, we have to reshape the tensors and denormalize the values. The following function does that for us:
def imshow(inp):
"""Imshow for Tensor."""
inp = inp.numpy().transpose((1, 2, 0))
mean = np.array([0.485, 0.456, 0.406])
std = np.array([0.229, 0.224, 0.225])
inp = std * inp + mean
inp = np.clip(inp, 0, 1)
plt.imshow(inp)
Now, we can pass our tensor to the preceding imshow function, which converts it into an image:
imshow(train[50][0])
The preceding code generates the following output:

- Windows phone 7.5 application development with F#
- 電腦維護與故障排除傻瓜書(Windows 10適用)
- Deep Learning with PyTorch
- 基于ARM的嵌入式系統和物聯網開發
- 電腦組裝、維護、維修全能一本通(全彩版)
- Unity 5.x Game Development Blueprints
- 數字邏輯(第3版)
- Mastering Adobe Photoshop Elements
- Spring Cloud微服務架構實戰
- Machine Learning with Go Quick Start Guide
- 單片機開發與典型工程項目實例詳解
- Hands-On Artificial Intelligence for Banking
- FL Studio Cookbook
- USB應用開發寶典
- 快·易·通:2天學會電腦組裝·系統安裝·日常維護與故障排除