Qdrant Plays Mario Kart 64

Author(s): Miguel Otero Pedrido

Originally published on Towards AI.

An Image Search application using Vector Databases

This member-only story is on us. Upgrade to access all of Medium.

Source: Image by Ravi Palwe on Unsplash

In this article, I’ll introduce you to an original application of image search. I’ve named it Qdrant Kart, and, as you might guess, it involves using a Vector Database (Qdrant) to play Mario Kart 64 — one of my all-time favorite games.

This application is built from several components, so to make it easier to follow, I’ve divided this article into the following sections:

Qdrant Kart ArchitectureData CollectionEmbedding GenerationInserting Embeddings into QdrantMupen64Plus integrationConclusion

If you’re still with me, chances are you’re intrigued by this project. To fuel your curiosity, let me show you a video of the application in action.

Before we begin, you’ll need to have the mupen64plus emulator installed as well as a Mario Kart 64 ROM

Time to get into the details! 👇

Qdrant Kart architecture (Source: Image by the author)

If you take a look at the diagram above, you’ll see the various steps involved in Qdrant Kart. The diagram is divided into two sections: the Batch section and the Realtime section.

Capture Screenshots and Joystick Data: Take multiple screenshots during 2 / 3 Mario Kart 64 races while simultaneously recording the joystick inputs.Generate Embeddings: Use a… Read the full blog for free on Medium.

Join thousands of data leaders on the AI newsletter. Join over 80,000 subscribers and keep up to date with the latest developments in AI. From research to projects and ideas. If you are building an AI startup, an AI-related product, or a service, we invite you to consider becoming a sponsor.

Published via Towards AI