Data Science with Azure Databricks at Clifford Chance
Guest blog by Mirko Bernardoni (Fiume Ltd) and Lulu Wan (Clifford Chance) With headquarters in London, Clifford Chance is a member of the "Magic Circle" of law firms and is one of the ten largest law firms in the world measured both by number of lawyers and revenue. As a global law firm, we support...
10 Minutes from pandas to Koalas on Apache Spark
This is a guest community post from Haejoon Lee, a software engineer at Mobigen in South Korea and a Koalas contributor. pandas is a great tool to analyze small datasets on a single machine. When the need for bigger datasets arises, users often choose PySpark. However, the converting code from pandas to PySpark is not...
Data Exfiltration Protection with Azure Databricks
In the previous blog, we discussed how to securely access Azure Data Services from Azure Databricks using Virtual Network Service Endpoints or Private Link. Given a baseline of those best practices, in this article we walkthrough detailed steps on how to harden your Azure Databricks deployment from a network security perspective in order to prevent...
New Methods for Improving Supply Chain Demand Forecasting
Organizations Are Rapidly Embracing Fine-Grained Demand Forecasting Retailers and Consumer Goods manufacturers are increasingly seeking improvements to their supply chain management in order to reduce costs, free up working capital and create a foundation for omnichannel innovation. Changes in consumer purchasing behavior are placing new strains on the supply chain. Developing a better understanding of...
Creating a Productive Work Environment from Home
Whether working from home is an old habit or the “new normal” for those adhering to COVID-19 protocols, we want to share Bricksters’ tips and tricks of how they create a productive and engaging work environment at home. Rebekah Uusitalo, Director, Talent Acquisition Operations and Programs (Toronto, ON) While many companies are shifting to a...
Trust but Verify with Databricks
As enterprises modernize their data infrastructure to make data-driven decisions, teams across the organization become consumers of that platform. The data workloads grow exponentially, where cloud data lake becomes the centralized storage for enterprise-wide functions and different tools & technologies are used to gain insights out of it. For cloud security teams, the addition of...
Spark + AI Summit’s Expanded Agenda Announced
Over the years, technical conferences tend to expand beyond their initial focus, adding new technologies, types of attendees, and a broader range of sessions and speakers. From its original focus on Apache Spark™, the Spark + AI Summit has extended its scope to include not only data engineering and infrastructure, but also machine learning automation...
Women’s HERstory Month at Databricks
As we celebrate Women’s HERstory Month this March, we reflect on the community that we’ve built within Databricks and throughout our careers. Our mission as Co-Leads of the Women of Databricks Employee Resource Group is to promote inclusion, career growth, leadership, mentorship, and networking. A strong support system is one of the keys to achieving...
Business Continuity at Databricks During COVID-19 Crisis
Dear valued customer, As COVID-19 continues to impact our daily lives, we are thinking about those affected as well as the practitioners who are delivering essential services to so many. As we adjust to a new reality, we want you to know that we have never lost focus on you and have a comprehensive plan...
Enabling Massive Data Transformation Across Your Organization
The top four companies by market cap today (MSFT, APPL, AMZN, GOOG) are all software companies, running their businesses on data. This is a radical departure from a decade ago. Enterprises in every segment are beginning to establish dominance through data. As a bank executive recently told me: “We’re not a finance company, we are...