阿帕奇猪节目

Question

需要帮助编写脚本猪计数无：在

文件，其中包含下面的文本

What|is|Hadoop 
History|of|Hadoop 
How|Hadoop|name|was|given 
Problems|with|Traditional|Large-Scale|Systems|and|Need|for|Hadoop 
Understanding|Hadoop|Architecture 
Fundamental|of|HDFS|(Blocks,|Name|Node,|Data|Node,|Secondary|Name|Node) 
Rack|Awareness 
Read/Write|from|HDFS 
HDFS|Federation|and|High|Availability 

Answer 1

将数据加载到一个chararray.Replace词的“|”与空间，即“”和记号化，这将给你的话，然后组和算的话

A = LOAD '/user/hadoop/data.txt' AS (line:chararray); 
B = FOREACH A GENERATE FLATTEN(TOKENIZE(REPLACE(line,'\\|',' '))); 
C = GROUP B BY $0; 
D = FOREACH C GENERATE group, COUNT(B); 
DUMP D; 

输出