Name: Towards AI Legal Name: Towards AI, Inc. Description: Towards AI is the world's leading artificial intelligence (AI) and technology publication. Read by thought-leaders and decision-makers around the world. Phone Number: +1-650-246-9381 Email: [email protected]
228 Park Avenue South New York, NY 10003 United States
Website: Publisher: https://towardsai.net/#publisher Diversity Policy: https://towardsai.net/about Ethics Policy: https://towardsai.net/about Masthead: https://towardsai.net/about
Name: Towards AI Legal Name: Towards AI, Inc. Description: Towards AI is the world's leading artificial intelligence (AI) and technology publication. Founders: Roberto Iriondo, , Job Title: Co-founder and Advisor Works for: Towards AI, Inc. Follow Roberto: X, LinkedIn, GitHub, Google Scholar, Towards AI Profile, Medium, ML@CMU, FreeCodeCamp, Crunchbase, Bloomberg, Roberto Iriondo, Generative AI Lab, Generative AI Lab Denis Piffaretti, Job Title: Co-founder Works for: Towards AI, Inc. Louie Peters, Job Title: Co-founder Works for: Towards AI, Inc. Louis-François Bouchard, Job Title: Co-founder Works for: Towards AI, Inc. Cover:
Towards AI Cover
Logo:
Towards AI Logo
Areas Served: Worldwide Alternate Name: Towards AI, Inc. Alternate Name: Towards AI Co. Alternate Name: towards ai Alternate Name: towardsai Alternate Name: towards.ai Alternate Name: tai Alternate Name: toward ai Alternate Name: toward.ai Alternate Name: Towards AI, Inc. Alternate Name: towardsai.net Alternate Name: pub.towardsai.net
5 stars – based on 497 reviews

Frequently Used, Contextual References

TODO: Remember to copy unique IDs whenever it needs used. i.e., URL: 304b2e42315e

Resources

Take our 85+ lesson From Beginner to Advanced LLM Developer Certification: From choosing a project to deploying a working product this is the most comprehensive and practical LLM course out there!

Publication

ML-OPS Guide Series- 1
Latest

ML-OPS Guide Series- 1

Last Updated on September 2, 2021 by Editorial Team

Author(s): Rashmi Margani

Machine Learning

What it is, Why it matters, its importance, andΒ more…

Intro: Let gets startedΒ with,

Figure 1. Basic /Fundamental Elements for ML systems for ML-Ops. Adapted from Hidden Technical Debt in Machine LearningΒ Systems.

What isΒ MLops?

To put it in simple terms, MLOps or ML Ops is a set of practices that aims to deploy and maintain ML models in production reliably and efficiently from defining the scope(problem statement) of the project to monitoring even after deployment to make sure everything is working as expected toΒ be.

Now the question may be about, how DevOps VSΒ MLOps?

Figure 2β€Šβ€”β€ŠGoogle’s 5 dimensions (DevOps VS MLOps)
Figure 2β€Šβ€”β€ŠGoogle’s 5 dimensions (DevOps VSΒ MLOps)

Why it is important & how to bring ML-Ops in practicality?

Importance ofΒ ML-Ops:

Over the last decade, we have witnessed the adoption of ML in everyday life applications. Not only for esoteric applications such as Dota or AlphaGo, but ML has also made its way to pretty standard applications such as machine translation, image processing, and voice recognition.

This adoption is powered by developments in infrastructure, especially in terms of the utilization of computation power. It has unlocked the potential of deep learning andΒ ML.

Figure 3: sourced from OpenAI: https://openai.com/blog/ai-and-compute

As AI is rapidly expanding into new applications and industries, and research is making tremendous strides. Yet building successful projects is still difficult. The models fail to adapt to changes in the dynamics of the environment or changes in the data that describes the environment. So the need to establish effective practices and processes around designing, building, and deploying models is increased.

Hence MLOps play a major role in monitoring and performing periodic checks on the dependencies of the model, the usage, and the performance to ensure that it serves as expected. MLOps encourages that the model’s desired behaviours should be pre-recorded and used as a benchmark which when the model underperforms or spikes irregularly, necessary actions areΒ taken.

Feasible steps to bring the ML-Ops in practicality,

> Keep monitoring the quality of your model in production so that it lets you detect the performance degradation, which is, in turn, a cue to retraining the model on newΒ data.

> Use most recent data to capture evolving and emerging patterns.

> Try new implementation such as feature engineering, model architecture changes, hyperparameters to improve the Performace

Above mentioned three points require a lot of manual processes, to address these challenges ML-Ops helps to automate using CI/CD andΒ CT.

Here,

CI refers to continuous integration: It is just no longer only about testing and validating code and components as in the case of DevOps but also testing and validating data, data schemas, and models for MLΒ systems.

CD refers to continuous delivery: Not just about a single software package or a service, but an ML training pipeline that should automatically deploy another service such as a model prediction service within the existing ML system when there is a new businessΒ need.

CT refers to continuous training: It is a new property, unique to ML systems, that’s concerned with automatically retraining and serving theΒ models.

More…

Figure 4: cloud.google.com

Going forward with ML-Ops Series will discuss in detail, the practicality of automating each Data science step for ML Systems such as Data Extraction, Data Analysis, Data Preparation, Model training, Model evaluation, Model validation, Model serving & Model monitoring using ML pipeline triggers. Various techniques and use cases to deal during a different phase of ML lifecycle and applicability of ML-ops which includes a diversity of robust automation(CI/CD) techniques for maintaining MLΒ system.

Stay tune…


ML-OPS Guide Series- 1 was originally published in Towards AI on Medium, where people are continuing the conversation by highlighting and responding to this story.

Published via Towards AI

Feedback ↓