Foundation Models: Scaling Large Language Models
Author(s): Luhui Hu Originally published on Towards AI. Inside generative AI and LLMs such as ChatGPT, GPT-4, Claude, Bard, LLaMA, ToolFormer, Google USM, PaLM, NeMo, Dolly, etc. Foundation β Tree of Life (Photo courtesy by author) The thrilling AI journey took off …
Scaling AI with Ray
Author(s): Luhui Hu Originally published on Towards AI. Ray is emerging in AI engineering and becomes essential to scale LLM and RL Photo by Eleni Bellou on Unsplash Spark is almost essential in data engineering. And Ray is emerging in AI engineering. …
Scaling AI with Ray
Author(s): Luhui Hu Originally published on Towards AI. Ray is emerging in AI engineering and becomes essential to scale LLM and RL Photo by Eleni Bellou on Unsplash Spark is almost essential in data engineering. And Ray is emerging in AI engineering. …
5 Pitfalls of the Modern Data Stack For Startups
Author(s): Luhui Hu Originally published on Towards AI. Practical lessons from and for startups using the modern data stack Photo by Buzz Andersen on Unsplash The modern data stack is cloud-native open data platforms and services. Today is the era of the …
All Types of ML Accelerators
Author(s): Luhui Hu Originally published on Towards AI. AI Engineering Comprehensive overview of machine learning accelerators from training to serving The past decade has been the era of deep learning. We are thrilled with unstopping milestones from AlphaGo to DELL-E 2 and …