What is Deepmind’s retrieval-based transformer (RETRO) & how does it work?
Last Updated on January 5, 2022 by Editorial Team
Author(s): Mostafa Ibrahim
Originally published on Towards AI the World’s Leading AI and Technology News and Media Company. If you are building an AI-related product or service, we invite you to consider becoming an AI sponsor. At Towards AI, we help scale AI and technology startups. Let us help you unleash your technology to the masses.
Retro obtains comparable performance to GPT-3 and Jurassic-1 using 25x fewer parameters.
Join thousands of data leaders on the AI newsletter. It’s free, we don’t spam, and we never share your email address. Keep up to date with the latest work in AI. From research to projects and ideas. If you are building an AI startup, an AI-related product, or a service, we invite you to consider becoming a sponsor.
Published via Towards AI