去正规化地图类型

Question

鉴于此集合：

("user1",Map("Gobelin" -> "2","Archers" ->"3")) 
("user2",Map("Giant" -> "1")) 

我想要的输出看起来像这样

("user1","Gobelin","2") 
("user1","Archers","3") 
("user2","Giant","1") 

我怎样才能达致这与火花？

Answer 1

最有可能你正在寻找flatMapValues：

val rdd = sc.parallelize(
    ("user1",Map("Gobelin" -> "2","Archers" ->"3")) :: 
    ("user2",Map("Giant" -> "1")) :: Nil) 

rdd.flatMapValues(identity[Map[String, String]]) 

或explode：

rdd.toDF.select($"_1", explode($"_2")).as[(String, String, String)].rdd