- Deep Learning with PyTorch
- Vishnu Subramanian
- 273字
- 2021-06-24 19:16:27
Deep dive into the building blocks of neural networks
As we learned in the previous chapter, training a deep learning algorithm requires the following steps:
- Building a data pipeline
- Building a network architecture
- Evaluating the architecture using a loss function
- Optimizing the network architecture weights using an optimization algorithm
In the previous chapter, the network was composed of a simple linear model built using PyTorch numerical operations. Though building a neural architecture for a toy problem using numerical operations is easier, it quickly becomes complicated when we try to build architectures required to solve complex problems in different areas, such as computer vision and natural language processing (NLP). Most of the deep learning frameworks, such as PyTorch, TensorFlow, and Apache MXNet, provide higher-level functionalities that abstract a lot of this complexity. These higher-level functionalities are called layers across the deep learning frameworks. They accept input data, apply transformations like the ones we have seen in the previous chapter, and output the data. To solve real-world problems, deep learning architectures constitute of a number of layers ranging from 1 to 150, or sometimes more than that. Abstracting the low-level operations and training deep learning algorithms would look like the following diagram:

Summarizing the previous diagram, any deep learning training involves getting data, building an architecture that in general is getting a bunch of layers together, evaluating the accuracy of the model using a loss function, and then optimizing the algorithm by optimizing the weights of our network. Before looking at solving some of the real-world problems, we will come to understand higher-level abstractions provided by PyTorch for building layers, loss functions, and optimizers.
- Cortex-M3 + μC/OS-II嵌入式系統開發入門與應用
- 網絡服務器配置與管理(第3版)
- Python GUI Programming:A Complete Reference Guide
- 基于Proteus和Keil的C51程序設計項目教程(第2版):理論、仿真、實踐相融合
- 計算機應用與維護基礎教程
- 嵌入式系統設計教程
- 筆記本電腦維修不是事兒(第2版)
- 微型計算機系統原理及應用:國產龍芯處理器的軟件和硬件集成(基礎篇)
- 筆記本電腦維修實踐教程
- 電腦橫機使用與維修
- Arduino項目開發:智能生活
- 微服務實戰(Dubbox +Spring Boot+Docker)
- 筆記本電腦的結構、原理與維修
- 電腦主板維修技術
- Service Mesh微服務架構設計