2012-09-27 89 views
2

我想从SQL Server 2008 R2数据库导入一个简单的表到配置单元。sqoop从sql server导入表时挂起

Hadoop version - CDH3U3 
Sqoop version - 1.3.0-cdh3u3 
$SQOOP_HOME/lib - sqljdbc4.jar 
$SQOOP_HOME/lib - sqoop-sqlserver-1.0.jar 
$SQOOP_CONF_DIR/managers.d/mssqoop-sqlserver 

Windows firewall - disabled 
Linux IPTables - disabled 

我的导入命令是 -

sqoop import --connect 'jdbc:sqlserver://172.16.1.47;username=sa;password=asdf1234;database=test' --table bruce --hive-import --verbose 

我没有看到任何错误消息,但它只是挂起,直到永远。如果我查看SQL Server活动监视器,我可以看到正在创建一个进程。

这里是sqoop输出 -

[[email protected] bruce]# ./sqoop_test_sqlserver.sh<br> 
Warning: /usr/lib/hbase does not exist! HBase imports will fail.<br> 
Please set $HBASE_HOME to the root of your HBase installation.<br> 
12/09/27 15:37:58 DEBUG tool.BaseSqoopTool: Enabled debug logging.<br> 
12/09/27 15:37:58 INFO tool.BaseSqoopTool: Using Hive-specific delimiters for output. You can override<br> 
12/09/27 15:37:58 INFO tool.BaseSqoopTool: delimiters with --fields-terminated-by, etc.<br> 
12/09/27 15:37:58 DEBUG sqoop.ConnFactory: Added factory com.microsoft.sqoop.SqlServer.MSSQLServerManagerFactory specified by /usr/lib/sqoop/conf/managers.d/mssqoop-sqlserver<br> 
12/09/27 15:37:58 DEBUG sqoop.ConnFactory: Loaded manager factory: com.microsoft.sqoop.SqlServer.MSSQLServerManagerFactory<br> 
12/09/27 15:37:58 DEBUG sqoop.ConnFactory: Loaded manager factory: com.cloudera.sqoop.manager.DefaultManagerFactory<br> 
12/09/27 15:37:58 DEBUG sqoop.ConnFactory: Trying ManagerFactory: com.microsoft.sqoop.SqlServer.MSSQLServerManagerFactory<br> 
12/09/27 15:37:58 INFO SqlServer.MSSQLServerManagerFactory: Using Microsoft's SQL Server - Hadoop Connector<br> 
12/09/27 15:37:58 INFO manager.SqlManager: Using default fetchSize of 1000<br> 
12/09/27 15:37:58 DEBUG sqoop.ConnFactory: Instantiated ConnManager [email protected]<br> 
12/09/27 15:37:58 INFO tool.CodeGenTool: Beginning code generation<br> 
12/09/27 15:37:58 DEBUG manager.SqlManager: No connection paramenters specified. Using regular API for making connection.<br><br> 

任何建议,将不胜感激。

回答

0

看来您正在使用Microsoft SQL Connector for Sqoop。作为第一步,我会建议关闭它,看看是否有帮助。

1

使用以下命令

sqoop import --connect 'jdbc:sqlserver://172.16.1.47:<port_number>/test --table bruce --username sa --password asdf1234 --hive-import --hive-table <table_in_hive> --verbose 

凡table_in_hive是动态创建