2010-02-05 23 views
0

有问题我确定有人遇到过某个地方的人。我们一直在将客户的.csv文件传输到我们的笔记本电脑,然后将它们加载到我们的Oracle数据库中,但是网络使它成为一个缓慢的过程。我设置了一个shell脚本,将这些文件LFTP文件下载到Solaris数据库, sqlload他们 - 更快。有一些人物问题,所以我能够改变NLS_LANG,现在看到DB中的字符与我们走窗口路线时相同。这7个文件中的2个存在问题。在500,000条记录中,有几千个被写入.bad文件,因为行被拆分。好奇的是,在Windows环境中,这没有发生。不知道这是一个FTP与LFTP的事情,还是进入UNIX时发生的字符集转录(MSWIN - > WE8ISO)。也许有一个设置变量可以用来使LFTP在这方面更像FTP。 ...有任何想法吗?.csv文件问题与分裂线在UNIX中,而不是Windows

我的创可贴替代方法如果我无法弄清楚上面的真实问题,请在将分割线重新操作回到上一行的末尾后重新加载2 .bad文件。以下是.bad文件中的分割记录示例。他们似乎总是在这个地址字段分裂,很多时候,那里应该是一个点或一个逗号 - 看到有在“215圣”换行:

"","","1-1000035","","","1-1000035","SIS STRATEGIC INFORMATION SYSTEMS","SIS STRATEGIC INFORMATION SYSTEMS","","RESELLER","Active","N","Y","","","","","","$" 
,"","","","","","","","80","","","","","","","","","","","","","(403) 281-4252","(780) 701-4050","North America","","","11432 215 St 
Summerbarn Rd","","","Edmonton","AB","T2S3Y5","Canada","","","","","","1-1000035","","","","","","","","","","","","", 
"","","","","",,,,"",,0,"UPSERT",10,"Y","Inserted By Widget",2009-10-23 15:08:03.387000000,2009-10-23 15:08:03.387000000,"",,"",,"","","1-1000035"^M 

回答

0

难道Unix和Windows之间的区别行结尾(\ n与\ r \ n)?

+0

试图将它扼杀在萌芽中,可以这么说,并且可以使LFTP xfer像FTP xfer一样,如果它在这些协议之间而不是在字符之间。 – Ryan 2010-02-05 23:26:11