数据清洗是数据分析前的一项预处理工作,想一想,无论从第三方接口获取的数据,还是网站爬取的数据、亦或是从文件、数据库读取的数据。其需要预先分析过滤一遍,比如错误数据、格式错误、数值异常、空缺等等。这一步的操作,才可以让后续的分析、可视化以及更下一步的操作更可靠。

下面,我为大家准备了一个有问题的天气数据,如下:

city,province,area_code,temp_max,temp_min,humidity,wind_power
beijing,beijing,10,31,22,58,3
shanghai,shanghai,21,32,25,72,3
tianjin,tianjin,22,30,NaN,60,3
chongqing,chongqing,23,34,26,70,2
guangzhou,guangdong,20,33,26,78,2
shenzhen,guangdong,755,32,26,80,3
zhuhai,guangdong,756,31,26,79,3
foshan,guangdong,,33,26,77,2
dongguan,guangdong,769,NaN,26,78,2
zhongshan,guangdong,760,32,26,79,2
huizhou,guangdong,752,32,25,77,3
shantou,guangdong,754,31,25,80,3
zhanjiang,guangdong,759,32,26,82,3
nanjing,jiangsu, ,32,24,68,3
suzhou,jiangsu,512,31,24,70,3
wuxi,jiangsu,510,31,24,69,3
changzhou,jiangsu,519,31,24,68,3
NULL,jiangsu,513,30,23,72,3
xuzhou,jiangsu,516,31,22,65,3
yangzhou,jiangsu,514,31,23,69,3
hangzhou,zhejiang,571,33,25,72,2
ningbo,zhejiang,574,31,25,75,3
wenzhou,zhejiang,577,31,25,78,3
jiaxing,zhejiang,573,31,24,74,3
shaoxing,zhejiang,575,32,25,73,2
jinhua,zhejiang,579,33,25,72,2
taizhou_zj,zhejiang,576,31,25,77,3
hefei,anhui,551,32,24,70,3
wuhu,anhui,553,32,24,72,3
bengbu,anhui,552,31,23,69,3
anqing,anhui,556,32,24,73,3
fuzhou,fujian,591,33,26,76,3
xiamen,fujian,592,32,26,79,3
quanzhou,fujian,595,32,26,78,3
zhangzhou,fujian,596,33,26,77,3
nanchang,jiangxi,791,33,25,72,2
ganzhou,jiangxi,797,33,25,74,2
jiujiang,jiangxi,792,32,25,73,3
jinan,shandong,531,31,22,62,3
qingdao,shandong,532,28,22,75,3
yantai,shandong,535,28,21,72,4
weifang,shandong,536,30,21,65,3
linyi,shandong,539,30,21,67,3
zhengzhou,henan,371,32,23,64,3
luoyang,henan,379,31,22,63,3
kaifeng,henan,378,32,23,65,3
xinxiang,henan,373,31,22,64,3
wuhan,hubei,27,33,25,72,2
yichang,hubei,717,32,24,73,2


该数据中故意包含一些错误数据,请大家先简单了解,比如有空缺、有NaN、有NULL值,大家可以先保存代码同级目录下并命名为dotcpp.csv 文件,我们后续会对其处理

点赞(0)

C语言网提供由在职研发工程师或ACM蓝桥杯竞赛优秀选手录制的视频教程,并配有习题和答疑,点击了解:

一点编程也不会写的:零基础C语言学练课程

解决困扰你多年的C语言疑难杂症特性的C语言进阶课程

从零到写出一个爬虫的Python编程课程

只会语法写不出代码?手把手带你写100个编程真题的编程百练课程

信息学奥赛或C++选手的 必学C++课程

蓝桥杯ACM、信息学奥赛的必学课程:算法竞赛课入门课程

手把手讲解近五年真题的蓝桥杯辅导课程

Dotcpp在线编译      (登录可减少运行等待时间)