2012-02-18 138 views
16

我有一个zip文件(大约10,000个小文件)的目录,每个文件都是一个CSV文件,我试图读取并分割成多个不同的CSV文件。从Zip文件中读取CSV

我设法编写代码以从CSV目录中拆分CSV文件,如下所示,它读取CSV的第一个atttribute,并且取决于将它写入相关的CSV。

import csv 
import os 
import sys 
import re 
import glob 

reader = csv.reader(open("C:/Projects/test.csv", "rb"), delimiter=',', quotechar='"') 
write10 = csv.writer(open('ouput10.csv', 'w'), delimiter=',', lineterminator='\n', quotechar='"', quoting=csv.QUOTE_NONNUMERIC) 
write15 = csv.writer(open('ouput15.csv', 'w'), delimiter=',', lineterminator='\n', quotechar='"', quoting=csv.QUOTE_NONNUMERIC) 


headings10=["RECORD_IDENTIFIER","CUSTODIAN_NAME","LOCAL_CUSTODIAN_NAME","PROCESS_DATE","VOLUME_NUMBER","ENTRY_DATE","TIME_STAMP","VERSION","FILE_TYPE"] 
write10.writerow(headings10) 

headings15=["RECORD_IDENTIFIER","CHANGE_TYPE","PRO_ORDER","USRN","STREET_DESCRIPTION","LOCALITY_NAME","TOWN_NAME","ADMINSTRATIVE_AREA","LANGUAGE"] 
write15.writerow(headings15) 


for row in reader: 
    type = row[0] 
    if "10" in type:   
     write10.writerow(row) 
    elif "15" in type: 
     write15.writerow(row) 

因此,我现在试图读取Zip文件,而不是浪费时间先提取它们。

这就是我,因为我已经找到

import glob 
import os 
import csv 
import zipfile 
import StringIO 

for name in glob.glob('C:/Projects/abase/*.zip'): 
    base = os.path.basename(name) 
    filename = os.path.splitext(base)[0] 


datadirectory = 'C:/Projects/abase/' 
dataFile = filename 
archive = '.'.join([dataFile, 'zip']) 
fullpath = ''.join([datadirectory, archive]) 
csv = '.'.join([dataFile, 'csv']) 


filehandle = open(fullpath, 'rb') 
zfile = zipfile.ZipFile(filehandle) 
data = StringIO.StringIO(zfile.read(csv)) 
reader = csv.reader(data) 

for row in reader: 
    print row 

但是和错误被抛出

下尽可能多的教程后,至今

AttributeError的:“海峡”对象有没有属性“读者”

希望有人可以告诉我如何更改我的CSV阅读代码,用于阅读Zip文件。

非常感谢

+0

也许这是你如何粘贴代码,但几乎没有什么是你的名字循环。这个错误指的是什么? – 2012-02-18 18:27:47

回答

19

简单的解决。您使用当地的csv变量覆盖了csv模块。只需更改该变量的名称:

import glob 
import os 
import csv 
import zipfile 
import StringIO 

for name in glob.glob('C:/Projects/abase/*.zip'): 
    base = os.path.basename(name) 
    filename = os.path.splitext(base)[0] 


    datadirectory = 'C:/Projects/abase/' 
    dataFile = filename 
    archive = '.'.join([dataFile, 'zip']) 
    fullpath = ''.join([datadirectory, archive]) 
    csv_file = '.'.join([dataFile, 'csv']) #all fixed 


    filehandle = open(fullpath, 'rb') 
    zfile = zipfile.ZipFile(filehandle) 
    data = StringIO.StringIO(zfile.read(csv_file)) #don't forget this line! 
    reader = csv.reader(data) 

    for row in reader: 
     print row 
+0

那杰出杰出。 – tjmgis 2012-02-18 18:50:06

+0

但是,它似乎没有通过压缩文件循环? – tjmgis 2012-02-18 18:50:30

+0

@ user1218419:检查您的缩进。正如斯科特·亨特所说,你的大部分代码都在glob.glob('c:etc'):'循环中的名字之下,因此在你之外。 – DSM 2012-02-18 19:03:17