Apache Spark vs Apache Spark: An On-Prem Comparison of Databricks and Open-Source Spark

Download Slides

Booz Allen is at the forefront of cyber innovation and sometimes that means applying AI in an on-prem environment because of data sensitivity. As many of our clients want to apply data science in operations, the team at Booz Allen had to find appropriate solutions. Booz Allen’s innovative Cyber AI team will take you through an on-prem implementation of Databricks Runtime Environment compared to Open Source Spark, how we were able to get 10x performance gains on real-world cyber workloads and some of the difficulties of setting up an on-prem, air-gapped solution for data analytics.


 
Try Databricks
« back
About Justin Hoffman

Booz Allen Hamilton

Justin Hoffman is a Senior Lead Data Scientist at Booz Allen Hamilton. He has over 8 years of experience in the analytics field developing custom solutions and 13 years of experience in the US Army. Mr. Hoffman currently leads an internal R&D project for Booz Allen in the field of applied Artificial Intelligence for Cybersecurity. He holds a B.S. in Mechanical Engineering from UTSA, multiple certifications, and recently completed 3 journal papers in Deep Learning applied to the fields of steganography and GANs. In addition, Mr. Hoffman currently has 1 patent in Biomedical Analytics for an electrolytic biosensor and 2.