Orchestrate Machine Learning Pipelines with AWS Step Functions

Author(s): ????Mike Shakhomirov

Originally published on Towards AI.

Advanced-Data Engineering and ML Ops with Infrastructure as Code
Photo by Markus Winkler on Unsplash

This story explains how to create and orchestrate machine learning pipelines with AWS Step Functions and deploy them using Infrastructure as Code. This article is for data and ML Ops engineers who would want to deploy and update ML pipelines using CloudFormation templates. These templates and Gihub repository likn will be provided in this article.

We can use AWS Step Functions to trigger any other service, even including managed services from other vendors. It’s a powerful tool that allows us to orchestrate the flow of how data services should process and transform data. I will use… Read the full blog for free on Medium.

Join thousands of data leaders on the AI newsletter. Join over 80,000 subscribers and keep up to date with the latest developments in AI. From research to projects and ideas. If you are building an AI startup, an AI-related product, or a service, we invite you to consider becoming a sponsor.

Published via Towards AI