Explosive demands of software QA / code analysis require flexible pipelines using Spark alongside other modern stack components. We will cover the evolution of toolsets initially managing hundreds of tests to our Spark-based workflow now capable of managing hundreds of thousands. Data lakes and decoupling compute and storage in the modern era will also be discussed.
Ryan Sayre is a technical lead covering unstructured data platforms for Pure Storage, Inc. He has held technical and leadership positions across the semiconductor, media and entertainment, supercomputing and healthcare industries. He advises as a technical strategist and frequently speaks on cyber-ethics and technology, and is a member and advisor at several innovation labs, hacker spaces, and startup accelerators.