Nagaraj Sengodan is a Senior Manager at HCL’s Data and Analytics group, focusing on Data engineering and data science capability. His current work involves building modern data warehouse in cloud and enable data as a service. He worked on data-intensive systems and generate actionable insights. In His recent project, he implemented unified data platform using Databrick delta to combine batch and realtime data stream. He earned his Computer Science Master’s degree from Alagappa University and Microsoft certified Solution Expert in Data and business intelligence track. He involved in many early adoption programs with Microsoft such as Data factory v2, Data lake gen 2, SQL vNext, etc.
Delta Lake, an open-source innovations which brings new capabilities for transactions, version control and indexing your data lakes. We uncover how Delta Lake benefits and why it matters to you. Through this session, we showcase some of its benefits and how they can improve your modern data engineering pipelines. Delta lake provides snapshot isolation which helps concurrent read/write operations and enables efficient insert, update, deletes, and rollback capabilities. It allows background file optimization through compaction and z-order partitioning achieving better performance improvements. In this presentation, we will learn the Delta Lake benefits and how it solves common data lake challenges, and most importantly new Delta Time Travel capability.