Software Engineer - Databricks Product - Databricks

Software Engineer – Databricks Product

Mission

Databricks was founded by the original creators of Apache® Spark™ and provides a unified analytics platform that allows users to focus on extracting value from their data, while Databricks handles for them the challenging, data-agnostic, parts of analyzing Big Data, such as reliability, easily spin up clusters, code management in notebooks and schedule production jobs.

To achieve this, Databricks offers a cloud-hosted SaaS platform created around Apache Spark. This is where you come in. You should be a software engineer passionate about architecting, developing, deploying and operating the Databricks product. You will build and extend the Databricks cloud offering, which is based on a micro service architecture and includes: a cluster management platform (we use Kubernetes as well as our own management software), user signup and authentication, Spark job scheduling, notebook services, security features in our product such as access control, build infrastructure (we use Bazel), deployment and automation of networking setups, etc.

Outcomes

  • Develop and extend the Databricks product. This implies, among others, writing software in Scala, Python or Javascript and/or interacting with: cloud APIs (e.g., compute APIs, cloud formation, Terraform), with open source and third party APIs and software (e.g., Kubernetes) and with internal APIs.
  • Be responsible for full software development lifecycle – design, development, testing, operating in production
  • Architect solutions to achieve a high level of reliability, scalability and securityCommunicate effectively with other engineers in the same team, with other teams and with various other stakeholders such as product managers
  • Operate in an Agile development environment

Competencies

  • 4+ years of production level experience in one of: Java, Scala, JavaScript, C++ or Python
  • Experience in architecting, developing, deploying and operating large scale distributed systems
  • Experience with usability and user experience
  • Experience with cloud APIs (e.g., a public cloud such as AWS, Azure, GCP or an advanced private cloud such as Google, Facebook)
  • Experience working on a SaaS platform or with Service Oriented Architectures
  • Good knowledge of Linux OS
  • Experience with API development
  • Good knowledge of SQL (MySQL preferred)
  • Experience with software security and systems that handle sensitive data
  • Exposure to container technologies, such as Docker
  • Experience with Continuous Integration/Continuous Deployment frameworks

Benefits

  • Medical, dental, vision
  • 401k Retirement Plan
  • Unlimited Paid Time Off
  • Catered lunch (everyday), snacks, and drinks
  • Gym reimbursement
  • Employee referral bonus program
  • Awesome coworkers
  • Maternity and paternity plans

About Databricks

Databricks’ mission is to accelerate innovation for its customers by unifying Data Science, Engineering and Business. Founded by the original creators of Apache Spark™, Databricks provides a Unified Analytics Platform for data science teams to collaborate with data engineering and lines of business to build data products. Users achieve faster time-to-value with Databricks by creating analytic workflows that go from ETL and interactive exploration to production. The company also makes it easier for its users to focus on their data by providing a fully managed, scalable, and secure cloud infrastructure that reduces operational complexity and total cost of ownership. Databricks, venture-backed by Andreessen Horowitz, NEA and Battery Ventures, among others, has a global customer base that includes Viacom, Shell, and HP.  For more information, visit www.databricks.com.

APPLY