Why QLoRA Changes the Game: A Quick Dive into Efficient Fine-Tuning with BERT
Author(s): Saif Ali Kheraj Originally published on Towards AI. Quantized Low-Rank Adaptation — anyone with a mid-range GPU and some curiosity can now fine-tune powerful models without burning through a budget or a power supply. In this article, we will break down …
Training Less, Achieving More: Unlocking Transformers with LoRA
Author(s): Saif Ali Kheraj Originally published on Towards AI. https://arxiv.org/pdf/2106.09685 In the era of large language models, Transformer is like the original brain of AI. But they come with a catch: Full fine tuning them is like …. Enter LoRA (Low-Rank Adaptation) …
Parameter-Efficient Finetuning (PEFT) and Adapter Modules in Transformers
Author(s): Saif Ali Kheraj Originally published on Towards AI. Fine-tuning large pre-trained models is an essential step in adapting them to specific tasks. However, traditional full fine-tuning requires updating all parameters, leading to high computational costs, increased memory usage, and a risk …
FactoryBERT: An AI That Understands Manufacturing
Author(s): Saif Ali Kheraj Originally published on Towards AI. This member-only story is on us. Upgrade to access all of Medium. https://www.freepik.com/free-photos-vectors/manufacturing-process Factories have their own way of talking. If you’ve ever been inside one, you might hear things like: “OEE is …
Data Diagnostics: Transforming & Reducing Data for Smarter Insights
Author(s): Saif Ali Kheraj Originally published on Towards AI. This member-only story is on us. Upgrade to access all of Medium. Ever looked at a dataset and wondered, Where do I even start? The answer lies in understanding its distribution. Before jumping …
Modern Analytics Framework — Industry Approach
Author(s): Saif Ali Kheraj Originally published on Towards AI. Analytics Methodologies, Frameworks, and Applications This member-only story is on us. Upgrade to access all of Medium. In this post, I am going to talk about analytics from an organization’s perspective, mixing in …
Solving Facility Location
Author(s): Saif Ali Kheraj Originally published on Towards AI. We will start with one important use case to solve a facility location problem. Suppose we have a service-based company named MMM that sells different products to customers across various regions. Every year, …