Producing highly accurate Predictive Models in Social Data Mining can be a challenge. Feature Engineering using traditional methodologies can only take you so far. Finding that needle in a haystack requires creative thinking, large time investments and can require hundreds of iterations to achieve highly accurate results.
Today, Spark is used in production at Toyota Motor Sales USA to power the Toyota Customer 360 Insights Platform and Social Media Intelligence Center.
Through this presentation we will discuss how Toyota’s R&D Data Science Team came to choose Spark as their premiere engine for large-scale data processing and Machine Learning, the lessons learned, and the journey to deploying Spark in the Enterprise.