官术网_书友最值得收藏!

Loading data into PyTorch tensors

The PyTorch torchvision.datasets package provides a utility class called ImageFolder that can be used to load images along with their associated labels when data is presented in the aforementioned format. It is a common practice to perform the following preprocessing steps:

  1. Resize all the images to the same size. Most of the deep learning architectures expect the images to be of the same size.
  2. Normalize the dataset with the mean and standard deviation of the dataset.
  3. Convert the image dataset to a PyTorch tensor.

PyTorch makes a lot of these preprocessing steps easier by providing a lot of utility functions in the transforms module. For our example, let's apply three transformations:

  • Scale to a 256 x 256 image size
  • Convert to a PyTorch tensor
  • Normalize the data (we will talk about how we arrived at the mean and standard deviation in Chapter 5, Deep Learning for Computer Vision)

The following code demonstrates how transformation can be applied and images are loaded using the ImageFolder class:

simple_transform=transforms.Compose([transforms.Scale((224,224)),
transforms.ToTensor(),
transforms.Normalize([0.485, 0.456, 0.406], [0.229, 0.224, 0.225])])
train = ImageFolder('dogsandcats/train/',simple_transform)
valid = ImageFolder('dogsandcats/valid/',simple_transform)

The train object holds all the images and associated labels for the dataset. It contains two important attributes: one that gives a mapping between classes and the associated index used in the dataset and another one that gives a list of classes:

  • train.class_to_idx - {'cat': 0, 'dog': 1}
  • train.classes - ['cat', 'dog']

It is often a best practice to visualize the data loaded into tensors. To visualize the tensors, we have to reshape the tensors and denormalize the values. The following function does that for us:

def imshow(inp):
"""Imshow for Tensor."""
inp = inp.numpy().transpose((1, 2, 0))
mean = np.array([0.485, 0.456, 0.406])
std = np.array([0.229, 0.224, 0.225])
inp = std * inp + mean
inp = np.clip(inp, 0, 1)
plt.imshow(inp)

Now, we can pass our tensor to the preceding imshow function, which converts it into an image:

imshow(train[50][0])

The preceding code generates the following output:

主站蜘蛛池模板: 凉山| 万年县| 尉犁县| 衡东县| 金寨县| 商都县| 天长市| 临江市| 康定县| 新宁县| 海安县| 澳门| 鹤壁市| 晋宁县| 垫江县| 鄂托克旗| 清远市| 万山特区| 高邑县| 乌兰察布市| 琼海市| 雷州市| 黄陵县| 科技| 宽城| 佳木斯市| 南宁市| 梁河县| 阿克苏市| 曲阳县| 神池县| 海晏县| 台江县| 石渠县| 旺苍县| 和林格尔县| 溧水县| 盐源县| 弋阳县| 武功县| 高尔夫|