目录

上一个主题

7.7. Pandas注意事项&窍门

下一个主题

Ⅷ 自然语言与知识图谱


>>> from env_helper import info; info()
页面更新时间: 2020-03-08 18:01:49
操作系统/OS: Linux-4.19.0-8-amd64-x86_64-with-debian-10.3 ;Python: 3.7.3

7.8. Pandas与SQL比较

由于许多潜在的Pandas用户对SQL有一定的了解,因此本文章旨在提供一些如何使用Pandas执行各种SQL操作的示例。

>>> import pandas as pd
>>> url = 'tips.csv'
>>> tips=pd.read_csv(url)
>>> print (tips.head())
   total_bill   tip     sex smoker  day    time  size
0       16.99  1.01  Female     No  Sun  Dinner     2
1       10.34  1.66    Male     No  Sun  Dinner     3
2       21.01  3.50    Male     No  Sun  Dinner     3
3       23.68  3.31    Male     No  Sun  Dinner     2
4       24.59  3.61  Female     No  Sun  Dinner     4

文件:tips.csv -

total_bill,tip,sex,smoker,day,time,size
0,16.99,1.01,Female,No,Sun,Dinner,2
1,10.34,1.66,Male,No,Sun,Dinner,3
2,21.01,3.50,Male,No,Sun,Dinner,3
3,23.68,3.31,Male,No,Sun,Dinner,2
4,24.59,3.61,Female,No,Sun,Dinner,4

选择(Select)

在SQL中,选择是使用逗号分隔的列列表(或选择所有列)来完成的,例如 -

SELECT total_bill, tip, smoker, time
FROM tips
LIMIT 5;

在Pandas中,列的选择是通过传递列名到DataFrame -

tips[['total_bill', 'tip', 'smoker', 'time']].head(5)

下面来看看完整的程序 -

>>> import pandas as pd
>>>
>>> url = 'tips.csv'
>>>
>>> tips=pd.read_csv(url)
>>> rs = tips[['total_bill', 'tip', 'smoker', 'time']].head(5)
>>> print(rs)
   total_bill   tip smoker    time
0       16.99  1.01     No  Dinner
1       10.34  1.66     No  Dinner
2       21.01  3.50     No  Dinner
3       23.68  3.31     No  Dinner
4       24.59  3.61     No  Dinner

调用没有列名称列表的DataFrame将显示所有列(类似于SQL的*)。

WHERE条件

SELECT * FROM tips WHERE time = 'Dinner' LIMIT 5;

数据帧可以通过多种方式进行过滤; 最直观的是使用布尔索引。

tips[tips['time'] == 'Dinner'].head(5)

下面来看看完整的程序 -

>>> import pandas as pd
>>>
>>> url = 'tips.csv'
>>>
>>> tips=pd.read_csv(url)
>>> rs = tips[tips['time'] == 'Dinner'].head(5)
>>> print(rs)
   total_bill   tip     sex smoker  day    time  size
0       16.99  1.01  Female     No  Sun  Dinner     2
1       10.34  1.66    Male     No  Sun  Dinner     3
2       21.01  3.50    Male     No  Sun  Dinner     3
3       23.68  3.31    Male     No  Sun  Dinner     2
4       24.59  3.61  Female     No  Sun  Dinner     4

上述语句将一系列True/False对象传递给DataFrame,并将所有行返回True。 通过GroupBy分组

此操作将获取整个数据集中每个组的记录数。 例如,一个查询提取性别的数量(即,按性别分组) -

SELECT sex, count(*)
FROM tips
GROUP BY sex;

在Pandas中的等值语句将是 -

>>> tips.groupby('sex').size()
sex
Female    2
Male      3
dtype: int64

下面来看看完整的程序 -

>>> import pandas as pd
>>>
>>> url = 'tips.csv'
>>>
>>> tips=pd.read_csv(url)
>>> rs = tips.groupby('sex').size()
>>> print(rs)
sex
Female    2
Male      3
dtype: int64

前N行

SQL(MySQL数据库)使用LIMIT返回前n行 -

SELECT * FROM tips
LIMIT 5 ;

在Pandas中的等值语句将是 -

>>> tips.head(5)
total_bill tip sex smoker day time size
0 16.99 1.01 Female No Sun Dinner 2
1 10.34 1.66 Male No Sun Dinner 3
2 21.01 3.50 Male No Sun Dinner 3
3 23.68 3.31 Male No Sun Dinner 2
4 24.59 3.61 Female No Sun Dinner 4

下面来看看完整的程序 -

>>> import pandas as pd
>>>
>>> url = 'tips.csv'
>>>
>>> tips=pd.read_csv(url)
>>> rs = tips[['smoker', 'day', 'time']].head(5)
>>> print(rs)
  smoker  day    time
0     No  Sun  Dinner
1     No  Sun  Dinner
2     No  Sun  Dinner
3     No  Sun  Dinner
4     No  Sun  Dinner

这些是比较的几个基本操作,在前几章的Pandas库中学到的。