python-pour-finance/03-Pandas/.ipynb_checkpoints/05-Groupby-checkpoint.ipynb

892 lines
22 KiB
Plaintext
Raw Permalink Blame History

This file contains ambiguous Unicode characters

This file contains Unicode characters that might be confused with other characters. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.

{
"cells": [
{
"cell_type": "markdown",
"metadata": {},
"source": [
"___\n",
"\n",
"<a href='http://www.pieriandata.com'> <img src='../Pierian_Data_Logo.png' /></a>\n",
"___"
]
},
{
"cell_type": "markdown",
"metadata": {
"collapsed": true
},
"source": [
"# Groupby\n",
"\n",
"The groupby method allows you to group rows of data together and call aggregate functions"
]
},
{
"cell_type": "code",
"execution_count": 31,
"metadata": {
"collapsed": true
},
"outputs": [],
"source": [
"import pandas as pd\n",
"# Create dataframe\n",
"data = {'Company':['GOOG','GOOG','MSFT','MSFT','FB','FB'],\n",
" 'Person':['Sam','Charlie','Amy','Vanessa','Carl','Sarah'],\n",
" 'Sales':[200,120,340,124,243,350]}"
]
},
{
"cell_type": "code",
"execution_count": 32,
"metadata": {
"collapsed": false
},
"outputs": [],
"source": [
"df = pd.DataFrame(data)"
]
},
{
"cell_type": "code",
"execution_count": 33,
"metadata": {
"collapsed": false
},
"outputs": [
{
"data": {
"text/html": [
"<div>\n",
"<table border=\"1\" class=\"dataframe\">\n",
" <thead>\n",
" <tr style=\"text-align: right;\">\n",
" <th></th>\n",
" <th>Company</th>\n",
" <th>Person</th>\n",
" <th>Sales</th>\n",
" </tr>\n",
" </thead>\n",
" <tbody>\n",
" <tr>\n",
" <th>0</th>\n",
" <td>GOOG</td>\n",
" <td>Sam</td>\n",
" <td>200</td>\n",
" </tr>\n",
" <tr>\n",
" <th>1</th>\n",
" <td>GOOG</td>\n",
" <td>Charlie</td>\n",
" <td>120</td>\n",
" </tr>\n",
" <tr>\n",
" <th>2</th>\n",
" <td>MSFT</td>\n",
" <td>Amy</td>\n",
" <td>340</td>\n",
" </tr>\n",
" <tr>\n",
" <th>3</th>\n",
" <td>MSFT</td>\n",
" <td>Vanessa</td>\n",
" <td>124</td>\n",
" </tr>\n",
" <tr>\n",
" <th>4</th>\n",
" <td>FB</td>\n",
" <td>Carl</td>\n",
" <td>243</td>\n",
" </tr>\n",
" <tr>\n",
" <th>5</th>\n",
" <td>FB</td>\n",
" <td>Sarah</td>\n",
" <td>350</td>\n",
" </tr>\n",
" </tbody>\n",
"</table>\n",
"</div>"
],
"text/plain": [
" Company Person Sales\n",
"0 GOOG Sam 200\n",
"1 GOOG Charlie 120\n",
"2 MSFT Amy 340\n",
"3 MSFT Vanessa 124\n",
"4 FB Carl 243\n",
"5 FB Sarah 350"
]
},
"execution_count": 33,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"df"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"** Now you can use the .groupby() method to group rows together based off of a column name. For instance let's group based off of Company. This will create a DataFrameGroupBy object:**"
]
},
{
"cell_type": "code",
"execution_count": 34,
"metadata": {
"collapsed": false
},
"outputs": [
{
"data": {
"text/plain": [
"<pandas.core.groupby.DataFrameGroupBy object at 0x113014128>"
]
},
"execution_count": 34,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"df.groupby('Company')"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"You can save this object as a new variable:"
]
},
{
"cell_type": "code",
"execution_count": 35,
"metadata": {
"collapsed": true
},
"outputs": [],
"source": [
"by_comp = df.groupby(\"Company\")"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"And then call aggregate methods off the object:"
]
},
{
"cell_type": "code",
"execution_count": 36,
"metadata": {
"collapsed": false
},
"outputs": [
{
"data": {
"text/html": [
"<div>\n",
"<table border=\"1\" class=\"dataframe\">\n",
" <thead>\n",
" <tr style=\"text-align: right;\">\n",
" <th></th>\n",
" <th>Sales</th>\n",
" </tr>\n",
" <tr>\n",
" <th>Company</th>\n",
" <th></th>\n",
" </tr>\n",
" </thead>\n",
" <tbody>\n",
" <tr>\n",
" <th>FB</th>\n",
" <td>296.5</td>\n",
" </tr>\n",
" <tr>\n",
" <th>GOOG</th>\n",
" <td>160.0</td>\n",
" </tr>\n",
" <tr>\n",
" <th>MSFT</th>\n",
" <td>232.0</td>\n",
" </tr>\n",
" </tbody>\n",
"</table>\n",
"</div>"
],
"text/plain": [
" Sales\n",
"Company \n",
"FB 296.5\n",
"GOOG 160.0\n",
"MSFT 232.0"
]
},
"execution_count": 36,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"by_comp.mean()"
]
},
{
"cell_type": "code",
"execution_count": 37,
"metadata": {
"collapsed": false
},
"outputs": [
{
"data": {
"text/html": [
"<div>\n",
"<table border=\"1\" class=\"dataframe\">\n",
" <thead>\n",
" <tr style=\"text-align: right;\">\n",
" <th></th>\n",
" <th>Sales</th>\n",
" </tr>\n",
" <tr>\n",
" <th>Company</th>\n",
" <th></th>\n",
" </tr>\n",
" </thead>\n",
" <tbody>\n",
" <tr>\n",
" <th>FB</th>\n",
" <td>296.5</td>\n",
" </tr>\n",
" <tr>\n",
" <th>GOOG</th>\n",
" <td>160.0</td>\n",
" </tr>\n",
" <tr>\n",
" <th>MSFT</th>\n",
" <td>232.0</td>\n",
" </tr>\n",
" </tbody>\n",
"</table>\n",
"</div>"
],
"text/plain": [
" Sales\n",
"Company \n",
"FB 296.5\n",
"GOOG 160.0\n",
"MSFT 232.0"
]
},
"execution_count": 37,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"df.groupby('Company').mean()"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"More examples of aggregate methods:"
]
},
{
"cell_type": "code",
"execution_count": 38,
"metadata": {
"collapsed": false
},
"outputs": [
{
"data": {
"text/html": [
"<div>\n",
"<table border=\"1\" class=\"dataframe\">\n",
" <thead>\n",
" <tr style=\"text-align: right;\">\n",
" <th></th>\n",
" <th>Sales</th>\n",
" </tr>\n",
" <tr>\n",
" <th>Company</th>\n",
" <th></th>\n",
" </tr>\n",
" </thead>\n",
" <tbody>\n",
" <tr>\n",
" <th>FB</th>\n",
" <td>75.660426</td>\n",
" </tr>\n",
" <tr>\n",
" <th>GOOG</th>\n",
" <td>56.568542</td>\n",
" </tr>\n",
" <tr>\n",
" <th>MSFT</th>\n",
" <td>152.735065</td>\n",
" </tr>\n",
" </tbody>\n",
"</table>\n",
"</div>"
],
"text/plain": [
" Sales\n",
"Company \n",
"FB 75.660426\n",
"GOOG 56.568542\n",
"MSFT 152.735065"
]
},
"execution_count": 38,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"by_comp.std()"
]
},
{
"cell_type": "code",
"execution_count": 39,
"metadata": {
"collapsed": false
},
"outputs": [
{
"data": {
"text/html": [
"<div>\n",
"<table border=\"1\" class=\"dataframe\">\n",
" <thead>\n",
" <tr style=\"text-align: right;\">\n",
" <th></th>\n",
" <th>Person</th>\n",
" <th>Sales</th>\n",
" </tr>\n",
" <tr>\n",
" <th>Company</th>\n",
" <th></th>\n",
" <th></th>\n",
" </tr>\n",
" </thead>\n",
" <tbody>\n",
" <tr>\n",
" <th>FB</th>\n",
" <td>Carl</td>\n",
" <td>243</td>\n",
" </tr>\n",
" <tr>\n",
" <th>GOOG</th>\n",
" <td>Charlie</td>\n",
" <td>120</td>\n",
" </tr>\n",
" <tr>\n",
" <th>MSFT</th>\n",
" <td>Amy</td>\n",
" <td>124</td>\n",
" </tr>\n",
" </tbody>\n",
"</table>\n",
"</div>"
],
"text/plain": [
" Person Sales\n",
"Company \n",
"FB Carl 243\n",
"GOOG Charlie 120\n",
"MSFT Amy 124"
]
},
"execution_count": 39,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"by_comp.min()"
]
},
{
"cell_type": "code",
"execution_count": 40,
"metadata": {
"collapsed": false
},
"outputs": [
{
"data": {
"text/html": [
"<div>\n",
"<table border=\"1\" class=\"dataframe\">\n",
" <thead>\n",
" <tr style=\"text-align: right;\">\n",
" <th></th>\n",
" <th>Person</th>\n",
" <th>Sales</th>\n",
" </tr>\n",
" <tr>\n",
" <th>Company</th>\n",
" <th></th>\n",
" <th></th>\n",
" </tr>\n",
" </thead>\n",
" <tbody>\n",
" <tr>\n",
" <th>FB</th>\n",
" <td>Sarah</td>\n",
" <td>350</td>\n",
" </tr>\n",
" <tr>\n",
" <th>GOOG</th>\n",
" <td>Sam</td>\n",
" <td>200</td>\n",
" </tr>\n",
" <tr>\n",
" <th>MSFT</th>\n",
" <td>Vanessa</td>\n",
" <td>340</td>\n",
" </tr>\n",
" </tbody>\n",
"</table>\n",
"</div>"
],
"text/plain": [
" Person Sales\n",
"Company \n",
"FB Sarah 350\n",
"GOOG Sam 200\n",
"MSFT Vanessa 340"
]
},
"execution_count": 40,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"by_comp.max()"
]
},
{
"cell_type": "code",
"execution_count": 41,
"metadata": {
"collapsed": false
},
"outputs": [
{
"data": {
"text/html": [
"<div>\n",
"<table border=\"1\" class=\"dataframe\">\n",
" <thead>\n",
" <tr style=\"text-align: right;\">\n",
" <th></th>\n",
" <th>Person</th>\n",
" <th>Sales</th>\n",
" </tr>\n",
" <tr>\n",
" <th>Company</th>\n",
" <th></th>\n",
" <th></th>\n",
" </tr>\n",
" </thead>\n",
" <tbody>\n",
" <tr>\n",
" <th>FB</th>\n",
" <td>2</td>\n",
" <td>2</td>\n",
" </tr>\n",
" <tr>\n",
" <th>GOOG</th>\n",
" <td>2</td>\n",
" <td>2</td>\n",
" </tr>\n",
" <tr>\n",
" <th>MSFT</th>\n",
" <td>2</td>\n",
" <td>2</td>\n",
" </tr>\n",
" </tbody>\n",
"</table>\n",
"</div>"
],
"text/plain": [
" Person Sales\n",
"Company \n",
"FB 2 2\n",
"GOOG 2 2\n",
"MSFT 2 2"
]
},
"execution_count": 41,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"by_comp.count()"
]
},
{
"cell_type": "code",
"execution_count": 42,
"metadata": {
"collapsed": false
},
"outputs": [
{
"data": {
"text/html": [
"<div>\n",
"<table border=\"1\" class=\"dataframe\">\n",
" <thead>\n",
" <tr style=\"text-align: right;\">\n",
" <th></th>\n",
" <th></th>\n",
" <th>Sales</th>\n",
" </tr>\n",
" <tr>\n",
" <th>Company</th>\n",
" <th></th>\n",
" <th></th>\n",
" </tr>\n",
" </thead>\n",
" <tbody>\n",
" <tr>\n",
" <th rowspan=\"8\" valign=\"top\">FB</th>\n",
" <th>count</th>\n",
" <td>2.000000</td>\n",
" </tr>\n",
" <tr>\n",
" <th>mean</th>\n",
" <td>296.500000</td>\n",
" </tr>\n",
" <tr>\n",
" <th>std</th>\n",
" <td>75.660426</td>\n",
" </tr>\n",
" <tr>\n",
" <th>min</th>\n",
" <td>243.000000</td>\n",
" </tr>\n",
" <tr>\n",
" <th>25%</th>\n",
" <td>269.750000</td>\n",
" </tr>\n",
" <tr>\n",
" <th>50%</th>\n",
" <td>296.500000</td>\n",
" </tr>\n",
" <tr>\n",
" <th>75%</th>\n",
" <td>323.250000</td>\n",
" </tr>\n",
" <tr>\n",
" <th>max</th>\n",
" <td>350.000000</td>\n",
" </tr>\n",
" <tr>\n",
" <th rowspan=\"8\" valign=\"top\">GOOG</th>\n",
" <th>count</th>\n",
" <td>2.000000</td>\n",
" </tr>\n",
" <tr>\n",
" <th>mean</th>\n",
" <td>160.000000</td>\n",
" </tr>\n",
" <tr>\n",
" <th>std</th>\n",
" <td>56.568542</td>\n",
" </tr>\n",
" <tr>\n",
" <th>min</th>\n",
" <td>120.000000</td>\n",
" </tr>\n",
" <tr>\n",
" <th>25%</th>\n",
" <td>140.000000</td>\n",
" </tr>\n",
" <tr>\n",
" <th>50%</th>\n",
" <td>160.000000</td>\n",
" </tr>\n",
" <tr>\n",
" <th>75%</th>\n",
" <td>180.000000</td>\n",
" </tr>\n",
" <tr>\n",
" <th>max</th>\n",
" <td>200.000000</td>\n",
" </tr>\n",
" <tr>\n",
" <th rowspan=\"8\" valign=\"top\">MSFT</th>\n",
" <th>count</th>\n",
" <td>2.000000</td>\n",
" </tr>\n",
" <tr>\n",
" <th>mean</th>\n",
" <td>232.000000</td>\n",
" </tr>\n",
" <tr>\n",
" <th>std</th>\n",
" <td>152.735065</td>\n",
" </tr>\n",
" <tr>\n",
" <th>min</th>\n",
" <td>124.000000</td>\n",
" </tr>\n",
" <tr>\n",
" <th>25%</th>\n",
" <td>178.000000</td>\n",
" </tr>\n",
" <tr>\n",
" <th>50%</th>\n",
" <td>232.000000</td>\n",
" </tr>\n",
" <tr>\n",
" <th>75%</th>\n",
" <td>286.000000</td>\n",
" </tr>\n",
" <tr>\n",
" <th>max</th>\n",
" <td>340.000000</td>\n",
" </tr>\n",
" </tbody>\n",
"</table>\n",
"</div>"
],
"text/plain": [
" Sales\n",
"Company \n",
"FB count 2.000000\n",
" mean 296.500000\n",
" std 75.660426\n",
" min 243.000000\n",
" 25% 269.750000\n",
" 50% 296.500000\n",
" 75% 323.250000\n",
" max 350.000000\n",
"GOOG count 2.000000\n",
" mean 160.000000\n",
" std 56.568542\n",
" min 120.000000\n",
" 25% 140.000000\n",
" 50% 160.000000\n",
" 75% 180.000000\n",
" max 200.000000\n",
"MSFT count 2.000000\n",
" mean 232.000000\n",
" std 152.735065\n",
" min 124.000000\n",
" 25% 178.000000\n",
" 50% 232.000000\n",
" 75% 286.000000\n",
" max 340.000000"
]
},
"execution_count": 42,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"by_comp.describe()"
]
},
{
"cell_type": "code",
"execution_count": 43,
"metadata": {
"collapsed": false
},
"outputs": [
{
"data": {
"text/html": [
"<div>\n",
"<table border=\"1\" class=\"dataframe\">\n",
" <thead>\n",
" <tr>\n",
" <th>Company</th>\n",
" <th colspan=\"8\" halign=\"left\">FB</th>\n",
" <th colspan=\"5\" halign=\"left\">GOOG</th>\n",
" <th colspan=\"8\" halign=\"left\">MSFT</th>\n",
" </tr>\n",
" <tr>\n",
" <th></th>\n",
" <th>count</th>\n",
" <th>mean</th>\n",
" <th>std</th>\n",
" <th>min</th>\n",
" <th>25%</th>\n",
" <th>50%</th>\n",
" <th>75%</th>\n",
" <th>max</th>\n",
" <th>count</th>\n",
" <th>mean</th>\n",
" <th>...</th>\n",
" <th>75%</th>\n",
" <th>max</th>\n",
" <th>count</th>\n",
" <th>mean</th>\n",
" <th>std</th>\n",
" <th>min</th>\n",
" <th>25%</th>\n",
" <th>50%</th>\n",
" <th>75%</th>\n",
" <th>max</th>\n",
" </tr>\n",
" </thead>\n",
" <tbody>\n",
" <tr>\n",
" <th>Sales</th>\n",
" <td>2.0</td>\n",
" <td>296.5</td>\n",
" <td>75.660426</td>\n",
" <td>243.0</td>\n",
" <td>269.75</td>\n",
" <td>296.5</td>\n",
" <td>323.25</td>\n",
" <td>350.0</td>\n",
" <td>2.0</td>\n",
" <td>160.0</td>\n",
" <td>...</td>\n",
" <td>180.0</td>\n",
" <td>200.0</td>\n",
" <td>2.0</td>\n",
" <td>232.0</td>\n",
" <td>152.735065</td>\n",
" <td>124.0</td>\n",
" <td>178.0</td>\n",
" <td>232.0</td>\n",
" <td>286.0</td>\n",
" <td>340.0</td>\n",
" </tr>\n",
" </tbody>\n",
"</table>\n",
"<p>1 rows × 24 columns</p>\n",
"</div>"
],
"text/plain": [
"Company FB GOOG \\\n",
" count mean std min 25% 50% 75% max count \n",
"Sales 2.0 296.5 75.660426 243.0 269.75 296.5 323.25 350.0 2.0 \n",
"\n",
"Company ... MSFT \\\n",
" mean ... 75% max count mean std min 25% \n",
"Sales 160.0 ... 180.0 200.0 2.0 232.0 152.735065 124.0 178.0 \n",
"\n",
"Company \n",
" 50% 75% max \n",
"Sales 232.0 286.0 340.0 \n",
"\n",
"[1 rows x 24 columns]"
]
},
"execution_count": 43,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"by_comp.describe().transpose()"
]
},
{
"cell_type": "code",
"execution_count": 44,
"metadata": {
"collapsed": false
},
"outputs": [
{
"data": {
"text/html": [
"<div>\n",
"<table border=\"1\" class=\"dataframe\">\n",
" <thead>\n",
" <tr style=\"text-align: right;\">\n",
" <th></th>\n",
" <th>count</th>\n",
" <th>mean</th>\n",
" <th>std</th>\n",
" <th>min</th>\n",
" <th>25%</th>\n",
" <th>50%</th>\n",
" <th>75%</th>\n",
" <th>max</th>\n",
" </tr>\n",
" </thead>\n",
" <tbody>\n",
" <tr>\n",
" <th>Sales</th>\n",
" <td>2.0</td>\n",
" <td>160.0</td>\n",
" <td>56.568542</td>\n",
" <td>120.0</td>\n",
" <td>140.0</td>\n",
" <td>160.0</td>\n",
" <td>180.0</td>\n",
" <td>200.0</td>\n",
" </tr>\n",
" </tbody>\n",
"</table>\n",
"</div>"
],
"text/plain": [
" count mean std min 25% 50% 75% max\n",
"Sales 2.0 160.0 56.568542 120.0 140.0 160.0 180.0 200.0"
]
},
"execution_count": 44,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"by_comp.describe().transpose()['GOOG']"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"# Great Job!"
]
}
],
"metadata": {
"kernelspec": {
"display_name": "Python 3",
"language": "python",
"name": "python3"
},
"language_info": {
"codemirror_mode": {
"name": "ipython",
"version": 3
},
"file_extension": ".py",
"mimetype": "text/x-python",
"name": "python",
"nbconvert_exporter": "python",
"pygments_lexer": "ipython3",
"version": "3.5.1"
}
},
"nbformat": 4,
"nbformat_minor": 0
}