Name: Towards AI Legal Name: Towards AI, Inc. Description: Towards AI is the world's leading artificial intelligence (AI) and technology publication. Read by thought-leaders and decision-makers around the world. Phone Number: +1-650-246-9381 Email: [email protected]
228 Park Avenue South New York, NY 10003 United States
Website: Publisher: https://towardsai.net/#publisher Diversity Policy: https://towardsai.net/about Ethics Policy: https://towardsai.net/about Masthead: https://towardsai.net/about
Name: Towards AI Legal Name: Towards AI, Inc. Description: Towards AI is the world's leading artificial intelligence (AI) and technology publication. Founders: Roberto Iriondo, , Job Title: Co-founder and Advisor Works for: Towards AI, Inc. Follow Roberto: X, LinkedIn, GitHub, Google Scholar, Towards AI Profile, Medium, ML@CMU, FreeCodeCamp, Crunchbase, Bloomberg, Roberto Iriondo, Generative AI Lab, Generative AI Lab Denis Piffaretti, Job Title: Co-founder Works for: Towards AI, Inc. Louie Peters, Job Title: Co-founder Works for: Towards AI, Inc. Louis-François Bouchard, Job Title: Co-founder Works for: Towards AI, Inc. Cover:
Towards AI Cover
Logo:
Towards AI Logo
Areas Served: Worldwide Alternate Name: Towards AI, Inc. Alternate Name: Towards AI Co. Alternate Name: towards ai Alternate Name: towardsai Alternate Name: towards.ai Alternate Name: tai Alternate Name: toward ai Alternate Name: toward.ai Alternate Name: Towards AI, Inc. Alternate Name: towardsai.net Alternate Name: pub.towardsai.net
5 stars – based on 497 reviews

Frequently Used, Contextual References

TODO: Remember to copy unique IDs whenever it needs used. i.e., URL: 304b2e42315e

Resources

Take our 85+ lesson From Beginner to Advanced LLM Developer Certification: From choosing a project to deploying a working product this is the most comprehensive and practical LLM course out there!

Publication

3 Ways to Render Pandas DataFrames
Latest

3 Ways to Render Pandas DataFrames

Last Updated on October 13, 2021 by Editorial Team

Author(s): Raja Dev

Data Science

A practical guide to instant documentation

Photo by Thought Catalog onΒ Unsplash

Systems read files but Humans read documents. The more stories we document, the more collaborative analysis wouldΒ be.

Dataframes are the key structures of analysis. They hold the critical data supporting key decision makings, at several stages, in the process of solving a problem. Often, decision-making involves multiple stakeholders who need to look at the data held in these dataΒ frames.

As a good data scientist and a programmer, we should not be bombarding the decision-making panel with the screens of our debugging environment. Instead, we should render the critical data in a way that is more intuitive for people to look at and understand.

This article is for experienced data scientists who prefer to explain their analysis as storytelling to business rather than a chain of buzzΒ words.

Rendering is as important in building a human interface to the application as Serialization in building a system interface. Pandas Dataframe supports the following three most popular languages of online & offline documentation.

  • HTML
  • LaTeX and
  • Markdown

The decision-making panel can see the data frame values translated to their native document environment, without requiring any environment shift.

Let’s go through an example and see how to render the data frame into each of these formats and how does the output looks like in their respective documentΒ viewers.

Initialize DataFrame

Import pandas and initialize data frame with exampleΒ values.

import pandas as pd
df = pd.DataFrame({
"Manufacturer":['Subaru', 'Mitsubishi', 'Mitsubishi', 'Suzuki','Nissan'],
"Model": ['Impreza','Lancer','Lancer','Ignis','Almera'],
"Color": ['blue','silver','white','red','black'],
"engine_capacity": [2,1.5,1.8,1.3,1.6],
"price": [10950,6950,576,3800,7850]})

[Dataset Referred: https://www.kaggle.com/lepchenkov/usedcarscatalog]

1. HTML Rendering

i) Run to_html() method of Dataframe.

htmlCode = df.to_html()

ii) The method generates the following HTMLΒ code

<table border="1" class="dataframe">
<thead>
<tr style="text-align: right;">
<th></th>
<th>Manufacturer</th>
<th>Model</th>
<th>Color</th>
<th>engine_capacity</th>
<th>price</th>
</tr>
</thead>
<tbody>
<tr>
<th>0</th>
<td>Subaru</td>
<td>Impreza</td>
<td>blue</td>
<td>2.0</td>
<td>10950</td>
</tr>
<tr>
<th>1</th>
<td>Mitsubishi</td>
<td>Lancer</td>
<td>silver</td>
<td>1.5</td>
<td>6950</td>
</tr>
<tr>
<th>2</th>
<td>Mitsubishi</td>
<td>Lancer</td>
<td>white</td>
<td>1.8</td>
<td>576</td>
</tr>
<tr>
<th>3</th>
<td>Suzuki</td>
<td>Ignis</td>
<td>red</td>
<td>1.3</td>
<td>3800</td>
</tr>
<tr>
<th>4</th>
<td>Nissan</td>
<td>Almera</td>
<td>black</td>
<td>1.6</td>
<td>7850</td>
</tr>
</tbody>
</table>

iii) Write this output to aΒ file.

file = open("output/df.html","w")
file.write(htmlCode)
file.close()

iv) Open output/df.html file in a webΒ browser.

Image byΒ Author

v) To make it more intuitive to the readers, you can further add style to the HTMLΒ table

styler = df.style
styler = styler.background_gradient()
htmlCodeWithStyle = styler.to_html()

vi) It generates the HTML code along with style information.

<style type="text/css">
#T_775bd_row0_col3, #T_775bd_row0_col4 {
background-color: #023858;
color: #f1f1f1;
}
....
</style>
<table id="T_775bd_">
<thead>
<tr>
<th class="blank level0" >&nbsp;</th>
<th class="col_heading level0 col0" >Manufacturer</th>
...
</tr>
</thead>
<tbody>
...
</tbody>
</table>

vii) Write this HTML Code to anotherΒ file

file = open("output/df2.html","w")
file.write(htmlCodeWithStyle)
file.close()

viii) You should be seeing the following table in your webΒ browser

Image byΒ Author

2. LaTeX Rendering

i) Run to_latex() method of Dataframe.

latexCode = df.to_latex()

ii) It generates the following latexΒ code.

\begin{tabular}{llllrr}
\toprule
{} & Manufacturer & Model & Color & engine\_capacity & price \\
\midrule
0 & Subaru & Impreza & blue & 2.0 & 10950 \\
1 & Mitsubishi & Lancer & silver & 1.5 & 6950 \\
2 & Mitsubishi & Lancer & white & 1.8 & 576 \\
3 & Suzuki & Ignis & red & 1.3 & 3800 \\
4 & Nissan & Almera & black & 1.6 & 7850 \\
\bottomrule
\end{tabular}

iii) Write this output to a latexΒ file

file = open("output/df.tex","w")
file.write(latexCode)
file.close()

iv) Open df.tex in your LaTeX viewer and see the outputΒ image.

Image byΒ Author

If you do not have a local viewer at the moment, you can use some online viewers like https://quicklatex.com/

3. Markdown Rendering

i) Run to_markdown() method of DataFrame

mdCode = df.to_markdown()

ii) It generates the following markdownΒ code

|    | Manufacturer   | Model   | Color   |   engine_capacity |   price |
|---:|:---------------|:--------|:--------|------------------:|--------:|
| 0 | Subaru | Impreza | blue | 2 | 10950 |
| 1 | Mitsubishi | Lancer | silver | 1.5 | 6950 |
| 2 | Mitsubishi | Lancer | white | 1.8 | 576 |
| 3 | Suzuki | Ignis | red | 1.3 | 3800 |
| 4 | Nissan | Almera | black | 1.6 | 7850 |

iii) Write this code to an mdΒ file.

file = open("output/df.md","w")
file.write(mdCode)
file.close()

iv) Open this markdown file in your favorite viewer. I used Visual StudioΒ Code.

Image byΒ Author

Conclusion

DataFrames are critical in supporting key decisions related to the process of analysis. Rendering is very important in making these decisions more collaborative among the stakeholders. Pandas DataFrame supports rendering into the three most popular documentation languagesβ€Šβ€”β€ŠHTML, LaTeX, and Markdown. We did a rendering exercise with an example, covering all these formats. That’s it! We are now ready to tell instant, informative and interesting stories to the business about our data analysis.


3 Ways to Render Pandas DataFrames was originally published in Towards AI on Medium, where people are continuing the conversation by highlighting and responding to this story.

Published via Towards AI

Feedback ↓