Nitin Raj Soundararajan is a technical consultant focusing on advanced data analytics, data engineering, cloud scale analytics and data science to solve real business problems in multiple domains. Nitin Raj holds an undergraduate degree in Computer Science and Engineering from Anna University and holds Microsoft Certified Solution Expert in Business Intelligence. He enjoys speaking at academic and industry conferences to share his knowledge and passion. His industry specializations include the Energy & Utilities, Technology, Healthcare and Food Processing. Nitin’s passion is using technology to drive efficiencies, and digitally transform organisations.
Delta Lake, an open-source innovations which brings new capabilities for transactions, version control and indexing your data lakes. We uncover how Delta Lake benefits and why it matters to you. Through this session, we showcase some of its benefits and how they can improve your modern data engineering pipelines. Delta lake provides snapshot isolation which helps concurrent read/write operations and enables efficient insert, update, deletes, and rollback capabilities. It allows background file optimization through compaction and z-order partitioning achieving better performance improvements. In this presentation, we will learn the Delta Lake benefits and how it solves common data lake challenges, and most importantly new Delta Time Travel capability.