A Robustly Optimized BERT Pretraining Approach
Author(s): Edward Ma Originally published on Towards AI. What is BERT? Top highlight BERT (Devlin et al., 2018) is a method of pre-training language representations, meaning that we train a general-purpose βlanguage understandingβ model on a large text corpus (like Wikipedia), and …
Two Ways to Learn Audio Embeddings
Author(s): Edward Ma Originally published on Towards AI. Speech2Vec with Skip-gram and CBOW Photo by Γlvaro Bernal on Unsplash Mel-frequency cepstral coefficients (MFCC), zero-crossing rate are some of classical feature for audio. It can be extracted via the library easily. However, it …
1000 Books Every CS Major Should Read
Author(s): Jag Singh Originally published on Towards AI. Most computer science and engineering majors have far too much reading on their plate to consider any outside reading of their own. If youβre not reading textbooks or documentation, then youβre probably reading Stack …
AI Schools β The Schools of the Future
Author(s): Ryan Lynch Originally published on Towards AI. The Schools of the Future, AI Schools U+007C Towards AI Technology is becoming a bigger part of our lives every day. Imagine driving to a new place without your sat-nav, ordering a takeaway without …
Text Mining in Python: Steps and Examples
Author(s): Dhilip Subramanian In todayβs scenario, one way of peopleβs success is identified by how they are communicating and sharing information with others. Thatβs where the concepts of language come into the picture. However, there are many languages in the world. Each …
Data Scientist Interview Process β A Personal Experience
Author(s): Benjamin Obi Tayo Ph.D. Originally published on Towards AI. Discussion about different stages of the interview process for a typical Data Scientist role Image Source: Forbes Are you a data scientist aspirant? Are you currently applying for data scientist positions? Do …
The Confusion Matrix for Classification
Author(s): Lawrence Alaso Krukrubo Originally published on Towards AI. Diving Into Confusion Matrix for Classification U+007C Towards AI Understanding Accuracy, Recall, Precision, ROC, AUC and F1-score Confused about The Confusion Matrix? The Confusion-matrix yields the most ideal suite of metrics for evaluating …
Beginnerβs Guide to Writing Data Science Blogs on Medium
Author(s): Benjamin Obi Tayo Ph.D. Originally published on Towards AI. Are you new on Medium? Are you interested in writing data science articles and publishing these on Medium? This article will discuss the stages involved in writing a good data science article …
Analysis of the Learning Rate in Gradient Descent Algorithm Using Python
Author(s): Jalal Mansoori Originally published on Towards AI. In this tutorial, youβll learn, implement, visualize the Performance of Gradient descent by trying different sets of learning rate values. Image by Author. Gradient Descent EquationWhat is Linear regression?What is Gradient Descent?Comparison between different …
Example 1: Extract a Table from PDF File Using Python
Author(s): Benjamin Obi Tayo Ph.D. Originally published on Towards AI. Demonstration of parsing PDF files using Python & R API Top highlight Data is key for any analysis in data science, be it inferential analysis, predictive analysis, or prescriptive analysis. The predictive …
Address Limitation of RNN in NLP Problems by Using Transformer-XL
Author(s): Edward Ma Originally published on Towards AI. Limitations of recurrent neural networks Photo by Joe Gardner on Unsplash Recurrent Neural Network (RNN) offers a way to learn a sequence of inputs. The drawback is that it is difficult to optimize due …
Prerequisites
Author(s): Thomas Kraehe Originally published on Towards AI. Top highlight Using Google Cloudβs Machine Learning as a Service U+007C Towards AI Analyzing the Mood of Chat Messages with Google Cloudβs Natural Language API With the help of NLP services like the Natural …
Machine Learning Model for Stochastic Processes
Author(s): Benjamin Obi Tayo Ph.D. Originally published on Towards AI. Abstract: Using the loan_timing.csv dataset provided, we built a simple model using the Monte Carlo simulation for predicting the fraction of loans that will default after the 3-year duration of the loan. …
Baby Steps to TensorFlow
Author(s): Lawrence Alaso Krukrubo Originally published on Towards AI. Tutorial on Creating a Simple TensorFlow Model U+007C Towards AI Training your first Tensorflow based Neural Network model for Celsius to Fahrenheit conversion TensorFlow is an open-source machine learning library for research and …
AI & Ethics β Where Do We Go From Here?
Author(s): Ryan Lynch Originally published on Towards AI. AI & Ethics, Into the Future U+007C Towards AI The topic of ethics comes up a lot when we talk about Artificial Intelligence. βHow do we teach an AI to make ethical decisions?β, βWho …