官术网_书友最值得收藏!

Implementing the Weather Application

The first application in this book is going to be a web scraping application that will scrape weather forecast information from https://weather.com and present it in a terminal. We will add some options that can be passed as arguments to the application, such as:

  • The temperature unit (Celsius or Fahrenheit)
  • The area where you can get the weather forecast
  • Output options where the user of our application can choose between the current forecast, a five-day forecast, a ten-day forecast, and the weekend
  • Ways to complement the output with extra information such as wind and humidity

Apart from the aforementioned arguments, this application will be designed to be extendable, which means that we can create parsers for different websites to get a weather forecast, and these parsers will be available as argument options.

In this chapter, you will learn how to:

  • Use object-oriented programming concepts in Python applications
  • Scrape data from websites using the BeautifulSoup package
  • Receive command line arguments
  • Utilize the inspect module
  • Load Python modules dynamically
  • Use Python comprehensions
  • Use Selenium to request a webpage and inspect its DOM elements

Before we get started, it is important to say that when developing web scraping applications, you should keep in mind that these types of applications are susceptible to changes. If the developers of the site that you are getting data from change a CSS class name, or the structure of the HTML DOM, the application will stop working. Also, if the URL of the site we are getting the data from changes, the application will not be able to send requests. 

主站蜘蛛池模板: 长丰县| 神池县| 姜堰市| 丰都县| 邛崃市| 五河县| 隆昌县| 石城县| 丰原市| 平利县| 张家川| 四川省| 兰坪| 淳化县| 芒康县| 巩义市| 青海省| 宾川县| 新沂市| 马鞍山市| 昌图县| 海淀区| 浦城县| 英吉沙县| 云霄县| 喜德县| 都安| 北辰区| 蒙城县| 天峨县| 镇安县| 阆中市| 凤凰县| 沐川县| 自治县| 竹山县| 罗源县| 时尚| 翼城县| 柳河县| 阿克|