Name: Towards AI Legal Name: Towards AI, Inc. Description: Towards AI is the world's leading artificial intelligence (AI) and technology publication. Read by thought-leaders and decision-makers around the world. Phone Number: +1-650-246-9381 Email: pub@towardsai.net
228 Park Avenue South New York, NY 10003 United States
Website: Publisher: https://towardsai.net/#publisher Diversity Policy: https://towardsai.net/about Ethics Policy: https://towardsai.net/about Masthead: https://towardsai.net/about
Name: Towards AI Legal Name: Towards AI, Inc. Description: Towards AI is the world's leading artificial intelligence (AI) and technology publication. Founders: Roberto Iriondo, , Job Title: Co-founder and Advisor Works for: Towards AI, Inc. Follow Roberto: X, LinkedIn, GitHub, Google Scholar, Towards AI Profile, Medium, ML@CMU, FreeCodeCamp, Crunchbase, Bloomberg, Roberto Iriondo, Generative AI Lab, Generative AI Lab VeloxTrend Ultrarix Capital Partners Denis Piffaretti, Job Title: Co-founder Works for: Towards AI, Inc. Louie Peters, Job Title: Co-founder Works for: Towards AI, Inc. Louis-François Bouchard, Job Title: Co-founder Works for: Towards AI, Inc. Cover:
Towards AI Cover
Logo:
Towards AI Logo
Areas Served: Worldwide Alternate Name: Towards AI, Inc. Alternate Name: Towards AI Co. Alternate Name: towards ai Alternate Name: towardsai Alternate Name: towards.ai Alternate Name: tai Alternate Name: toward ai Alternate Name: toward.ai Alternate Name: Towards AI, Inc. Alternate Name: towardsai.net Alternate Name: pub.towardsai.net
5 stars – based on 497 reviews

Frequently Used, Contextual References

TODO: Remember to copy unique IDs whenever it needs used. i.e., URL: 304b2e42315e

Resources

Our 15 AI experts built the most comprehensive, practical, 90+ lesson courses to master AI Engineering - we have pathways for any experience at Towards AI Academy. Cohorts still open - use COHORT10 for 10% off.

Publication

ML-OPS Guide Series- 1
Latest

ML-OPS Guide Series- 1

Last Updated on September 2, 2021 by Editorial Team

Author(s): Rashmi Margani

Machine Learning

What it is, Why it matters, its importance, and more…

Intro: Let gets started with,

ML-OPS Guide Series- 1
Figure 1. Basic /Fundamental Elements for ML systems for ML-Ops. Adapted from Hidden Technical Debt in Machine Learning Systems.

What is MLops?

To put it in simple terms, MLOps or ML Ops is a set of practices that aims to deploy and maintain ML models in production reliably and efficiently from defining the scope(problem statement) of the project to monitoring even after deployment to make sure everything is working as expected to be.

Now the question may be about, how DevOps VS MLOps?

Figure 2 — Google’s 5 dimensions (DevOps VS MLOps)
Figure 2 — Google’s 5 dimensions (DevOps VS MLOps)

Why it is important & how to bring ML-Ops in practicality?

Importance of ML-Ops:

Over the last decade, we have witnessed the adoption of ML in everyday life applications. Not only for esoteric applications such as Dota or AlphaGo, but ML has also made its way to pretty standard applications such as machine translation, image processing, and voice recognition.

This adoption is powered by developments in infrastructure, especially in terms of the utilization of computation power. It has unlocked the potential of deep learning and ML.

Figure 3: sourced from OpenAI: https://openai.com/blog/ai-and-compute

As AI is rapidly expanding into new applications and industries, and research is making tremendous strides. Yet building successful projects is still difficult. The models fail to adapt to changes in the dynamics of the environment or changes in the data that describes the environment. So the need to establish effective practices and processes around designing, building, and deploying models is increased.

Hence MLOps play a major role in monitoring and performing periodic checks on the dependencies of the model, the usage, and the performance to ensure that it serves as expected. MLOps encourages that the model’s desired behaviours should be pre-recorded and used as a benchmark which when the model underperforms or spikes irregularly, necessary actions are taken.

Feasible steps to bring the ML-Ops in practicality,

> Keep monitoring the quality of your model in production so that it lets you detect the performance degradation, which is, in turn, a cue to retraining the model on new data.

> Use most recent data to capture evolving and emerging patterns.

> Try new implementation such as feature engineering, model architecture changes, hyperparameters to improve the Performace

Above mentioned three points require a lot of manual processes, to address these challenges ML-Ops helps to automate using CI/CD and CT.

Here,

CI refers to continuous integration: It is just no longer only about testing and validating code and components as in the case of DevOps but also testing and validating data, data schemas, and models for ML systems.

CD refers to continuous delivery: Not just about a single software package or a service, but an ML training pipeline that should automatically deploy another service such as a model prediction service within the existing ML system when there is a new business need.

CT refers to continuous training: It is a new property, unique to ML systems, that’s concerned with automatically retraining and serving the models.

More…

Figure 4: cloud.google.com

Going forward with ML-Ops Series will discuss in detail, the practicality of automating each Data science step for ML Systems such as Data Extraction, Data Analysis, Data Preparation, Model training, Model evaluation, Model validation, Model serving & Model monitoring using ML pipeline triggers. Various techniques and use cases to deal during a different phase of ML lifecycle and applicability of ML-ops which includes a diversity of robust automation(CI/CD) techniques for maintaining ML system.

Stay tune…


ML-OPS Guide Series- 1 was originally published in Towards AI on Medium, where people are continuing the conversation by highlighting and responding to this story.

Published via Towards AI


Take our 90+ lesson From Beginner to Advanced LLM Developer Certification: From choosing a project to deploying a working product this is the most comprehensive and practical LLM course out there!

Towards AI has published Building LLMs for Production—our 470+ page guide to mastering LLMs with practical projects and expert insights!


Discover Your Dream AI Career at Towards AI Jobs

Towards AI has built a jobs board tailored specifically to Machine Learning and Data Science Jobs and Skills. Our software searches for live AI jobs each hour, labels and categorises them and makes them easily searchable. Explore over 40,000 live jobs today with Towards AI Jobs!

Note: Content contains the views of the contributing authors and not Towards AI.