Utilizing Spark as the Analytical Core to an Open Source HTAP Relational Database on HBaseSplice Machine utilizes Spark on Yarn as the analytical execution architecture for our open source HTAP relational database. This talk will walk through how a dual engine architecture can exist where Spark supports analytical queries and large database maintenance operations (HBase Compactions, Index Maintenance, imports) while an operational relational architecture mirrors the analytical architecture. The presenters will demonstrate how to maintain ACID properties during both real-time and spark analytical read/write operations.
The talk will explain how advanced RDBMS topics like constraints, foreign keys, triggers, and secondary indexes can still occur using Spark’s dataset interface and what use cases are enabled by fusing ACID properties with large scale elastic compute.
John Leach is the co-founder of Splice Machine, a relational database using Spark and HBase. Prior to Splice Machine, John founded a boutique consulting firm servicing fortune 500 companies who were early adopters of distributing computing technologies prior to Splice Machine. John is actively involved in Washington University's Elliot Society and is Organizer Emeritus for the Saint Louis Hadoop Users Group.