Spark提交错误：java.lang.ClassNotFoundException：DirectKafkaWordCount

Question

我想运行火花流示例DirectKafkaWordCount。

这是我目录结构：

root@sandbox:/usr/local/spark/test# find 
. 
./src 
./src/main 
./src/main/scala 
./src/main/scala/DirectKafkaWordCount.scala 
./simple.sbt 

sbt package完成后，一切正常。

........ 
[info] Done updating. 
[info] Compiling 1 Scala source to /usr/local/spark-1.6.0-bin-hadoop2.6/test/target/scala-2.10.5/classes... 
[info] Packaging /usr/local/spark-1.6.0-bin-hadoop2.6/test/target/scala-2.10.5/direct-kafka-word-count_2.10.5-1.0.jar ... 
[info] Done packaging. 
[success] Total time: 60 s, completed May 12, 2016 1:34:04 AM 

却发现错误，当我运行​​：

root@sandbox:/usr/local/spark# bin/spark-submit --class DirectKafkaWordCount --master local[4] test/target/scala-2.10.5/direct-kafka-word-count_2.10.5-1.0.jar 
java.lang.ClassNotFoundException: DirectKafkaWordCount 
    at java.net.URLClassLoader$1.run(URLClassLoader.java:366) 
    at java.net.URLClassLoader$1.run(URLClassLoader.java:355) 
    at java.security.AccessController.doPrivileged(Native Method) 
    at java.net.URLClassLoader.findClass(URLClassLoader.java:354) 
    at java.lang.ClassLoader.loadClass(ClassLoader.java:425) 
    at java.lang.ClassLoader.loadClass(ClassLoader.java:358) 
    at java.lang.Class.forName0(Native Method) 
    at java.lang.Class.forName(Class.java:278) 
    at org.apache.spark.util.Utils$.classForName(Utils.scala:174) 
    at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:689) 
    at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:181) 
    at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:206) 
    at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:121) 
    at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) 

我在引发新的，希望有人能帮助我。

Answer 1

- >其实我觉得你应该包括groupId和你的类的artifactId当您运行

火花提交命令，如：

spark-submit --class com.balabala.spark.DirectKafkaWordCount --master local[4] test/target/scala-2.10.5/direct-kafka-word-count_2.10.5-1.0.jar 

然后火花应该能找到你类。