Nitin Raj Soundararajan is a technical consultant on artificial intelligence, big data and analytics, where he focuses on the deployment of AI and ML solutions to solve real business problems in multiple domain. Nitin Raj holds an undergraduate degree in Computer Science and Engineering. He enjoys speaking at academic and industry conferences to share his knowledge and passion for AI, machine learning, and big data analytics. He is working in providing artificial intelligence and big data analytics solutions to utility and energy sector.
Delta Lake, an open-source innovations which brings new capabilities for transactions, version control and indexing your data lakes. We uncover how Delta Lake benefits and why it matters to you. Through this session, we showcase some of its benefits and how they can improve your modern data engineering pipelines. Delta lake provides snapshot isolation which helps concurrent read/write operations and enables efficient insert, update, deletes, and rollback capabilities. It allows background file optimization through compaction and z-order partitioning achieving better performance improvements. In this presentation, we will learn the Delta Lake benefits and how it solves common data lake challenges, and most importantly new Delta Time Travel capability.