Table of Contents
- Summary
- Understanding the new class of applications
- New applications supporting new business models
- Requirements for new technology underpinnings
- Volume, velocity and variety of data
- Data volume
- Data velocity
- Data variety
- Real-time, massively scalable and closed-loop characteristics of applications
- Massively scalable
- Closing the loop
- Approaches to scalability
- Emerging NoSQL databases
- Cassandra
- Alternatives to Cassandra
- Oracle NoSQL
- HBase
- Sustainable versus nonsustainable differentiators
- Driving better decisions into online applications
- A note on the distinction between Cassandra and DataStax Enterprise
- Key takeaways
- Technology considerations
- Appendix A: understanding the assumptions in NoSQL databases as a class of systems relative to SQL databases
- About George Gilbert
- About GigaOm
- Copyright
1. Summary
The explosive growth in the volume, velocity, variety and complexity of data has challenged both traditional enterprise application vendors as well as companies built around online applications. In response, new applications have emerged, ones that are real-time, massively scalable and have closed-loop analytics. Needless to say, these applications require very different technology underpinnings than what came before.
Traditional applications had a common platform that captured business transactions. The software pipeline extracted, cleansed and loaded the information into a data warehouse. The data warehouse reorganized the data primarily to answer questions that were known in advance. Tying the answers back into better decisions in the form of transactions was mostly an offline, human activity.
The emerging class of applications requires new functionality that closes the loop between incoming transactions and the analytics that drive action on those transactions. Closing the loop between decisions and actions can take two forms: Analytics can run directly on the transactional database in real time or in closely integrated but offline tasks running on Hadoop. Hadoop typically supports data scientists who take in data that’s far more raw and unrefined than the type found in a traditional enterprise data warehouse. The raw data makes it easier to find new patterns that define new analytic rules to insert back into the online database.
This paper is targeted at technology-aware business executives, IT generalists and those who recognize that many emerging applications need new data-management foundations. The paper surveys this class of applications and its technology underpinnings relative to more-traditional offerings from several high-level perspectives: the characteristics of the data, the distinctiveness of the new class of applications, and the emerging database technologies — labeled NoSQL, for lack of a better term — that support them. Although the NoSQL label has been applied to many databases, this paper will focus on the class of systems with a rich data model typified by Cassandra. Other databases in this class include HBase, DynamoDB and Oracle NoSQL.