- Python Web Scraping Cookbook
- Michael Heydt
- 262字
- 2021-06-30 18:44:07
Getting ready
You will need to have access to a MySQL database. You can install one locally installed, in the cloud, within a container. I am using a locally installed MySQL server and have the root password set to mypassword. You will also need to install the MySQL python library. You can do this with pip install mysql-connector-python.
- The first thing to do is to connect to the database using the mysql command at the terminal:
# mysql -uroot -pmypassword
mysql: [Warning] Using a password on the command line interface can be insecure.
Welcome to the MySQL monitor. Commands end with ; or \g.
Your MySQL connection id is 4
Server version: 5.7.19 MySQL Community Server (GPL)
Copyright (c) 2000, 2017, Oracle and/or its affiliates. All rights reserved.
Oracle is a registered trademark of Oracle Corporation and/or its
affiliates. Other names may be trademarks of their respective
owners.
Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.
mysql>
- Now we can create a database that will be used to store our scraped information:
mysql> create database scraping;
Query OK, 1 row affected (0.00 sec)
- Now use the new database:
mysql> use scraping;
Database changed
- And create a Planets table in the database to store our data:
mysql> CREATE TABLE `scraping`.`planets` (
`id` INT NOT NULL AUTO_INCREMENT,
`name` VARCHAR(45) NOT NULL,
`mass` FLOAT NOT NULL,
`radius` FLOAT NOT NULL,
`description` VARCHAR(5000) NULL,
PRIMARY KEY (`id`));
Query OK, 0 rows affected (0.02 sec)
Now we are ready to scrape data and put it into the MySQL database.
推薦閱讀
- 網絡云百問百答
- RCNP實驗指南:構建高級的路由互聯網絡(BARI)
- 從區(qū)塊鏈到Web3:構建未來互聯網生態(tài)
- 5G承載網網絡規(guī)劃與組網設計
- 互聯網基礎資源技術與應用發(fā)展態(tài)勢(2021—2023)
- Go Web Scraping Quick Start Guide
- 通信簡史:從信鴿到6G+
- 計算機網絡工程實用教程(第2版)
- Getting Started with Grunt:The JavaScript Task Runner
- Building RESTful Web services with Go
- 城域網與廣域網(第2版)
- WordPress Web Application Development
- Unity Artificial Intelligence Programming
- jQuery Mobile Web Development Essentials
- 5G+區(qū)塊鏈