Name: Towards AI Legal Name: Towards AI, Inc. Description: Towards AI is the world's leading artificial intelligence (AI) and technology publication. Read by thought-leaders and decision-makers around the world. Phone Number: +1-650-246-9381 Email: [email protected]
228 Park Avenue South New York, NY 10003 United States
Website: Publisher: https://towardsai.net/#publisher Diversity Policy: https://towardsai.net/about Ethics Policy: https://towardsai.net/about Masthead: https://towardsai.net/about
Name: Towards AI Legal Name: Towards AI, Inc. Description: Towards AI is the world's leading artificial intelligence (AI) and technology publication. Founders: Roberto Iriondo, , Job Title: Co-founder and Advisor Works for: Towards AI, Inc. Follow Roberto: X, LinkedIn, GitHub, Google Scholar, Towards AI Profile, Medium, ML@CMU, FreeCodeCamp, Crunchbase, Bloomberg, Roberto Iriondo, Generative AI Lab, Generative AI Lab Denis Piffaretti, Job Title: Co-founder Works for: Towards AI, Inc. Louie Peters, Job Title: Co-founder Works for: Towards AI, Inc. Louis-François Bouchard, Job Title: Co-founder Works for: Towards AI, Inc. Cover:
Towards AI Cover
Logo:
Towards AI Logo
Areas Served: Worldwide Alternate Name: Towards AI, Inc. Alternate Name: Towards AI Co. Alternate Name: towards ai Alternate Name: towardsai Alternate Name: towards.ai Alternate Name: tai Alternate Name: toward ai Alternate Name: toward.ai Alternate Name: Towards AI, Inc. Alternate Name: towardsai.net Alternate Name: pub.towardsai.net
5 stars – based on 497 reviews

Frequently Used, Contextual References

TODO: Remember to copy unique IDs whenever it needs used. i.e., URL: 304b2e42315e

Resources

Unlock the full potential of AI with Building LLMs for Productionβ€”our 470+ page guide to mastering LLMs with practical projects and expert insights!

Publication

The NLP Model Forge
Natural Language Processing

The NLP Model Forge

Last Updated on August 17, 2020 by Editorial Team

Author(s): Quantum Stat

Photo by Jesse Collins onΒ Unsplash

Natural Language Processing

Unlocking Inference for 1,400 NLPΒ Models

Streamlining an inference pipeline on the latest fine-tuned NLP model is a must for fast prototyping. However, with the plethora of diverse model architectures and NLP libraries to choose from, it can make prototyping a time-consuming task. As such, we’ve created The NLP Model Forge. A database/code generator for 1,400 fine-tuned models that were carefully curated from top NLP research companies such as Hugging Face, Facebook (ParlAI), DeepPavlov, andΒ AI2.

The Forge is your destination for generating inference code for your NLP model ofΒ choice.

The NLP Model Forge

What Does the ForgeΒ Contain?

The Forge contains code for pre-trained models that were fine-tuned across several tasks stemming from classic text classification all the way to text-to-speech and commonsense reasoning. It allows the developer to choose several models at once, of which, upon one click of a button, can generate code templates in a ready-to-run format to be pasted in a Colab notebook. The code blocks are formatted in batch and python programming scripts and are easy enough to get you jump-started on creating your own inference API!πŸ’₯

Current tasks available in theΒ Forge

  1. Sequence Classification | topic classification and sentiment analysis
  2. Text Generation
  3. Question Answering
  4. Token Classification | NER, and part ofΒ speech
  5. Summarization
  6. Natural Language Inference
  7. Conversational AI
  8. Machine Translation
  9. Text-to-Speech
  10. Commonsense Reasoning

One of the best features of the Forge (besides its diversity of architectures, languages, and libraries) is the metadata descriptions of each model. Different tasks require different metadata to help guide the developer on their model of choice. So for example, in machine translation, we’ve added source language and target language columns, for sequence/token classification/NLI weβ€˜ve added a β€œlabels” column to identify what labels the model has been trained toΒ infer.

Ok… So How Does ItΒ Work?

First, you select one or more models in the Forge home page. You do this by selecting the toggle button in the β€œload” column.

As you select your models, you will notice that the β€œGet Code” button begins to tally your model selections.

When you’re satisfied with what you’ve selected, click the β€œGet Code” button.

You have now generated code blocks to run inference on your models! And they’re programmatically labeled with relevant metadata to improve interpretation in the functionality of each model. The great part about the Forge is it already knows which imports and dependencies it requires depending on which library you selected. πŸ‘‡

πŸ’‘ inner monologue πŸ’‘

We also highlight the source language, the areas where to add text inputs and areas to fine-tune decoding parameters (if required). Look for theΒ emojis!

Now, at this stage, you can do one of several things. YouΒ can…

βœ” Edit the code right on the web page. (you can delete code blocks you don’t want or alter the code directly in the page at your discretion)

βœ” Hit the email button to send the code blocks to yourself or yourΒ friends.

βœ” Copy each code block to the clipboard and paste it on your localΒ machine.

But, the most powerful choice is to click that β€œColab” button. If you do this, two things will happen simultaneously:

βœ” All code blocks on the page will be copied to the clipboard.

βœ” A new Colab page willΒ open.

Now, all you have left to do is to press β€œcontrol/command + v” on the page, and all the code blocks get pasted in! You are now ready to run inference!

πŸ’‘ inner monologue πŸ’‘

Colab continues to be a powerful destination for prototyping ML models because you can leverage their free GPU in addition to having super fast download speeds for large data files. This comes in handy when models can be as large as 1G or greater and you don’t want to download themΒ locally.

Hope you enjoy going traveling thru the Forge! We hope this platform can help you not only understand variations in model architectures but to put you in control of the development of your own inference API.

We will continue to improve the platform to bring you the latest and most diverse models in the world. Stay tuned for more updates. If you have any questions/suggestions along the way, you can always email usΒ at:

info [at] quantumstat [dot]Β com

Cheers,

Ricky Costa | Quantum Stat | www.quantumstat.com

P.S. For updates, you can follow us on Twitter and on our newsletter on ourΒ website.


The NLP Model Forge was originally published in Towards AIβ€Šβ€”β€ŠMultidisciplinary Science Journal on Medium, where people are continuing the conversation by highlighting and responding to this story.

Published via Towards AI

Feedback ↓