Generative AI on the Cheap

Author(s): Michael Banham

Originally published on Towards AI.

How to leverage Generative AI without breaking the bank

Getting started with Generative AI can be daunting. It’s hard to know where to begin, and there are plenty of options, each with its pros and cons. This brief article will highlight some of the paths you can take and also show you a quick and easy (and virtually free) approach to get you up and running with Generative AI in your applications.

Let’s face it, the Average Joe, or the Average Joe Company isn’t going to be developing AI, generative or otherwise, anytime soon. It’s just too expensive. By some accounts, each training run for ChatGPT 3 — the darling of Generative AI — costs roughly $5M for the GPUs (Graphics Processing Unit) alone, and some estimates are considerably higher. The total cost to train such models is believed to be more than $100M. And that’s not even including development and R&D costs and all the other things that go into running a company. (Curiously, I asked ChatGPT for an estimate and it declined to provide one.)

The real problem isn’t the underlying neural networks that provide the foundational technology. Those have been around for quite some time. It’s the mountains of training data needed to build an accurate model. The… Read the full blog for free on Medium.

Join thousands of data leaders on the AI newsletter. Join over 80,000 subscribers and keep up to date with the latest developments in AI. From research to projects and ideas. If you are building an AI startup, an AI-related product, or a service, we invite you to consider becoming a sponsor.

Published via Towards AI