Qubole: Devops Engineer

Qubole is a simple, open, and secure Data Lake Platform for machine learning, streaming, and ad-hoc analytics. Our platform provides end-to-end services that reduce the time and effort required to run Data pipelines, Streaming Analytics, and Machine Learning workloads on any cloud. No other platform offers the openness and data workload flexibility of Qubole while lowering cloud data lake costs by over 50 per cent. Qubole customers process nearly an exabyte of data every month. Qubole investors include Charles River, Institutional Venture Partners, Lightspeed, Norwest, Harmony and Singtel Innov8.
We have a rapidly growing footprint on AWS, a fast growing customer base and up and coming services on GCE and Azure as well. We strongly believe in automating and codifying as much of our operational procedures as possible. Running this service securely, reliably and within budget is a hard problem. As a dedicated Production Operations Engineer/DevOps – you would be responsible for managing our deployment to achieve high marks in all these respects.
Qubole offers Big-Data-as-a-Service on leading clouds. Our product spans the full stack – all the way from rich browser based application, to complex middleware controlling analytic workloads and orchestrating cloud resources and back-end large scale data processing components.

What you’ll be doing

    • Develop/Improve tools to automate the deployment, administration, and monitoring of a large-scale web service on AWS cloud.
    • Work with development teams to harden, enhance, document, establish process and generally improve the operability and supportability of our systems.
    • Assist in the configuration/build-out of new deployments to facilitate our constant growth.
    • Work in and learn multiple public clouds including AWS, Google, and Azure.
    • Work with Kubernetes and large @ scale deployments with high uptime requirements.
    • Troubleshoot and resolve live production issues by analyzing logs from different sources.
    • Assist in the roll-out and deployment of new product features and installations to facilitate our rapid iteration and constant growth.
    • Develop software/processes for better utilization of underlying cloud resources.
    • Monitor and analyze reporting and dashboards to quickly identify issues and take corrective action when needed Work with Security Managers to establish and document security controls and procedures.

Must Have

    • Strong system administration background for Linux based systems
    • Systems experience in one or more public clouds prefer AWS or Google.
    • Operational expertise around deploying and managing one or more components like MySQL, Nginx, ElasticSearch, Java Applications, Ruby/Rails, Load Balancers, Graphana, RabibitMQ.
    • Comfortable with networking fundamentals like Firewalls, Subnetting, Route tables etc.
    • Experience working with config and deploy management tools like Ansibile, Chef or Puppet.
    • Python, Ruby experience, specifically for systems automation.
    • A minimum of 3 years of continuous US residency is required.  No H1-B visa transfers, sponsorship or any other kind of immigration assistance is being considered or offered.

Nice to Have

    • Excellent communication and strong application level troubleshooting and problem solving skills
    • Knowledge of most of these: data structures, relational and non-relational databases, networking, Linux internals, filesystems, web architecture, and related topics
Qubole is hitting that growth inflection point where we need talented people to help us scale up. Our company culture is special, and we are looking for people to join us who want to continue building a great company while going after the big data activation market.
Check us out on Glassdoor and LinkedIn
Learn more about us here, here, and here
Culture at Qubole
Trust and Autonomy: We absolutely pride ourselves on the lack of bureaucracy at work, and believe in delegating power and responsibility, aggressively to our employees.
Transparency and Teamwork: Complete transparency in all our thoughts and actions is integral to our genetic character, and it helps us to stick together and function effectively as a team.
Who Thrives: If you are a self-starter and thrive on complexity and independence and truly understand and live the tenets of humility, hunger and honesty and you will love Qubole.