2014-06-19 40 views
0

即时尝试从配置单元导出数据到一个mssql服务器,我知道sqoop和sql服务器都可以,因为我可以导出另一个没有问题的表。使用sqoop从配置单元导出到sqlsrver

,即时通讯得到的错误是:

14/06/19 14:48:37 INFO mapreduce.Job: Task Id : attempt_1403175168750_0031_m_000003_0, Status : FAILED Error: java.io.IOException: Can't export data, please check failed map task logs at org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:112) at org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:39) at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:145) at org.apache.sqoop.mapreduce.AutoProgressMapper.run(AutoProgressMapper.java:64) at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:340) at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1548) at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:163) Caused by: java.lang.RuntimeException: Can't parse input data: 'You may be harboring secret illusions about how you want to li... More for Virgo http://t.co/Jnt91NMNt5 ' at StageFlumeTweets.__loadFromFields(StageFlumeTweets.java:236) at StageFlumeTweets.parse(StageFlumeTweets.java:174) at org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:83) ... 10 more Caused by: java.lang.NumberFormatException: For input string: "You may be harboring secret illusions about how you want to li... More for Virgo http://t.co/Jnt91NMNt5 " at java.lang.NumberFormatException.forInputString(NumberFormatException.java:65) at java.lang.Long.parseLong(Long.java:441) at java.lang.Long.valueOf(Long.java:540) at StageFlumeTweets.__loadFromFields(StageFlumeTweets.java:228) ... 12 more

使用导出数据的命令IM是:

sqoop export --verbose --connect "jdbc:sqlserver://xx;database=xx;username=xx;password=xx" --export-dir /user/hive/warehouse/xx/twitter_bulk2/ --table StageFlumeTweets --input-fields-terminated-by ','

与数据文件只是一个tweetid和像这样的文本:

468751929271517185,RT @BestofScorpio: A woman may want you, but she doesnt need you. 468751929565130752,I'm gonna need to borrow someone's red lipstick for this

回答

0

您收到NumberFormatException

这可能是一个溢出问题(给定的大小为tweedid)。 Sql Server中的对应字段是否宣告为bigint

相关问题