如何创建一个使用三联图

Question

我想在java中构建一个倒排索引。我有1400个文本文件的cran数据。我能够计算每个术语/单词的频率。我已经能够返回一个单词出现在整个集合中的次数，但是我没有能够创建一个t = term，d = doc，f = frequency的三元组（t，d，f）。这是我的代码至今：

我想在下面的表格输出

term1: doc1:2, 
term2: doc2:3, 
term1: doc3:1 

这里术语是在doc文件和文档1字：2意味着字词1出现在文档1 2次

public static void main(String[]args) throws FileNotFoundException{ 
 
     Map<String, Integer> m = new HashMap<>(); 
 
     
 
     String wrd; 
 
     
 
     for(int i=1;i<=2;i++){ 
 
      //FileInputStream tdfr = new FileInputStream("D:\\logs\\steem"+i+".txt"); 
 
      Scanner tdsc=new Scanner(new File("D:\\logs\\steem"+i+".txt")); 
 
      while(tdsc.hasNext()){ 
 
       // m.clear(); 
 
       Integer docid=i; 
 
       
 
       wrd=tdsc.next(); 
 
       //Vector<Integer> vPosList = p.hPosList.get(wrd); 
 
       Integer freq=m.get(wrd); 
 
       
 
       //Integer doc=m1.get(i); 
 
       //System.out.println(m.get(wrd)); 
 
       m.put(wrd, (freq == null) ? 1 : freq + 1); 
 
      
 
       
 
       
 
       
 
       
 
      } 
 
     
 
       
 
       
 
      System.out.println(m.size() + " distinct words" + " steem" +i); 
 
      System.out.println("Doc" +i+""+m); 
 
      //System.out.println("Doc"+i+""+m1); 
 
      m.clear(); 
 
     
 
      
 
     tdsc.close(); 
 
     
 
    } 
 
     //System.out.println(m.size() + " distinct words"); 
 
     //System.out.println(m); 
 
     // System.out.println(m1); 
 
     
 
} 
 
}

public static void main(String[]args) throws FileNotFoundException{ 
     Map<String, Integer> m = new HashMap<>(); 

     String wrd; 

     for(int i=1;i<=2;i++){ 
      //FileInputStream tdfr = new FileInputStream("D:\\logs\\steem"+i+".txt"); 
      Scanner tdsc=new Scanner(new File("D:\\logs\\steem"+i+".txt")); 
      while(tdsc.hasNext()){ 
       // m.clear(); 
       Integer docid=i; 

       wrd=tdsc.next(); 
       //Vector<Integer> vPosList = p.hPosList.get(wrd); 
       Integer freq=m.get(wrd); 

       //Integer doc=m1.get(i); 
       //System.out.println(m.get(wrd)); 
       m.put(wrd, (freq == null) ? 1 : freq + 1); 





      } 



      System.out.println(m.size() + " distinct words" + " steem" +i); 
      System.out.println("Doc" +i+""+m); 
      //System.out.println("Doc"+i+""+m1); 
      m.clear(); 


     tdsc.close(); 

    } 
     //System.out.println(m.size() + " distinct words"); 
     //System.out.println(m); 
     // System.out.println(m1); 

} 
} 

Answer 1

有关存储我什么t为List<Map<String,Integer>>？ 为每个文档创建一个新的映射，并将该术语与其频率进行映射。

List<Map<String, Integer>> list = new ArrayList<>(); 
    Map<String, Integer> map; 
    String word; 
    //Iterate over documents 
    for (int i = 1; i <= 2; i++) { 
     map = new HashedMap<>(); 
     Scanner tdsc = new Scanner(new File("D:\\logs\\steem" + i + ".txt")); 
     //Iterate over words 
     while (tdsc.hasNext()) { 
      word = tdsc.next(); 
      final Integer freq = map.get(word); 
      if (freq == null) { 
       map.put(word, 1); 
      } else { 
       map.put(word, map.get(word) + 1); 
      } 
     } 
     list.add(map); 
    } 

    //Print result 
    int documentNumber = 0; 
    for (Map<String, Integer> document : list) { 
     for (Map.Entry<String, Integer> entry : document.entrySet()) { 
      System.out.println(entry.getKey() + ":doc"+documentNumber+":" + entry.getValue()); 
     } 
     documentNumber++; 
    }