Project overview

In this chapter, we'll look at how to build a program that loads a JSON file and an XML file into three databases: a SQLite database, a PostgreSQL database, and a Redis key-value store. To avoid hardwiring the names and positions of the files and the database credentials into the program, we are going to load them from a TOML configuration file.

The final project is named transformer, but we'll explain this through several preliminary small projects:

• toml_dynamic and toml_static: These read a TOML file in two different ways.
• json_dynamic and json_static: These read a JSON file in two different ways.
• xml_example: This reads an XML file.
• sqlite_example: This creates two tables in a SQLite database, inserts records into them, and queries them.
• postgresql_example: This creates two tables in a PostgreSQL database, inserts records into them, and queries them.
• redis_example: This adds some data to a key-value store and queries it.