Introduction to managing big data

The intent of big data management is to figure out what kind of infrastructure support you would require for the data. For example, does your environment need to retain multiple replicas of the data? Do you need to do statistical computation with the data? Once these operational requirements have been determined, you'll be able to choose the right system that will let you perform these operations. The big data management answers the following questions:

• How do we ingest or consume the data?
• Where and how do we store it?
• How can we ensure as well as enforce data quality?
• What operations do we perform on the data?
• How can these operations be efficient?
• How do we manage data scalability, variety, velocity, and access?
• How can we enforce security and privacy at each stage of data modeling?

We will go into the details of big data management, and we will be discussing the details of data management as well as their vendors in the next chapter, Chapter 2, Data Modeling and Management Platforms.