Getting the data

Author(s): Avishek Nag

Originally published on Towards AI.

Comparative study of different vector space models & text classification techniques like XGBoost and others

In this article, we will discuss different text classification techniques to solve the BBC new article categorization problem. We will also discuss different vector space models to represent text data.

We will be using Python, Sci-kit-learn, Gensim and the Xgboost library for solving this problem.

Data for this problem can be found from Kaggle. This dataset contains BBC news text and its category in a two-column CSV format. Let’s see what’s there

Figure 1

Looks like long texts are there. We will see this in later sections. Here, the problem is: if a ‘text’ is given, we have to predict its ‘category’. Definitely, it… Read the full blog for free on Medium.

Join thousands of data leaders on the AI newsletter. Join over 80,000 subscribers and keep up to date with the latest developments in AI. From research to projects and ideas. If you are building an AI startup, an AI-related product, or a service, we invite you to consider becoming a sponsor.

Published via Towards AI