官术网_书友最值得收藏!

Loading data into PyTorch tensors

The PyTorch torchvision.datasets package provides a utility class called ImageFolder that can be used to load images along with their associated labels when data is presented in the aforementioned format. It is a common practice to perform the following preprocessing steps:

  1. Resize all the images to the same size. Most of the deep learning architectures expect the images to be of the same size.
  2. Normalize the dataset with the mean and standard deviation of the dataset.
  3. Convert the image dataset to a PyTorch tensor.

PyTorch makes a lot of these preprocessing steps easier by providing a lot of utility functions in the transforms module. For our example, let's apply three transformations:

  • Scale to a 256 x 256 image size
  • Convert to a PyTorch tensor
  • Normalize the data (we will talk about how we arrived at the mean and standard deviation in Chapter 5, Deep Learning for Computer Vision)

The following code demonstrates how transformation can be applied and images are loaded using the ImageFolder class:

simple_transform=transforms.Compose([transforms.Scale((224,224)),
transforms.ToTensor(),
transforms.Normalize([0.485, 0.456, 0.406], [0.229, 0.224, 0.225])])
train = ImageFolder('dogsandcats/train/',simple_transform)
valid = ImageFolder('dogsandcats/valid/',simple_transform)

The train object holds all the images and associated labels for the dataset. It contains two important attributes: one that gives a mapping between classes and the associated index used in the dataset and another one that gives a list of classes:

  • train.class_to_idx - {'cat': 0, 'dog': 1}
  • train.classes - ['cat', 'dog']

It is often a best practice to visualize the data loaded into tensors. To visualize the tensors, we have to reshape the tensors and denormalize the values. The following function does that for us:

def imshow(inp):
"""Imshow for Tensor."""
inp = inp.numpy().transpose((1, 2, 0))
mean = np.array([0.485, 0.456, 0.406])
std = np.array([0.229, 0.224, 0.225])
inp = std * inp + mean
inp = np.clip(inp, 0, 1)
plt.imshow(inp)

Now, we can pass our tensor to the preceding imshow function, which converts it into an image:

imshow(train[50][0])

The preceding code generates the following output:

主站蜘蛛池模板: 玛纳斯县| 疏勒县| 沁阳市| 河间市| 西和县| 隆回县| 平舆县| 阿坝县| 铜梁县| 华容县| 新乡县| 绥棱县| 莱西市| 宜昌市| 阿城市| 明溪县| 新巴尔虎左旗| 淮阳县| 微山县| 仁寿县| 涟源市| 彭泽县| 江孜县| 盘山县| 东城区| 巴中市| 南汇区| 山阴县| 体育| 保山市| 家居| 罗源县| 资溪县| 常德市| 武川县| 永吉县| 英山县| 连州市| 交城县| 和顺县| 维西|