On June 21st 2022, we welcome Kyle De Freitas, Senior ML Engineer at Block who will be presenting an introduction to Apache Beam Pipelines and how they are implemented in the Cash App.
Description: At Cash App, Apache Beam is one of several tools for creating data pipelines for leveraging distributed computing for transforming data for ML applications. Cash App uses both the Java and Python SDK for developing pipelines. In this session, I will highlight how we use the Apache Beam python SDK to create data components used for both batch and streaming pipelines. I will also highlight our approach to leveraging several best practices for machine learning as we design, build, test and deploy our data pipelines using cloud services like Google DataFlow.