替换特定单词

该脚本从多个新闻网站抓取标题，并统计新闻标题中出现多少次单词。替换特定单词

我收到了像“to”，“for”和类似的词，我不打算用这个脚本抢夺。

我试着写一个str.translate（None，“to”）来删除这个单词，但它删除了“贪婪” - 抢走了华盛顿的一些部分，当我想删除它的时候就是“to” 。

import pprint 
import feedparser 
from collections import Counter 

def feedGrabber(feed): 
    parsed = feedparser.parse(feed) 
    feed1 = [] 
    feed1.append(parsed.entries[0].title) 
    feed1.append(parsed.entries[1].title) 
    feed1.append(parsed.entries[3].title) 
    feed1.append(parsed.entries[4].title) 
    feed1.append(parsed.entries[5].title) 
    feed1.append(parsed.entries[6].title) 
    feed1.append(parsed.entries[7].title) 
    feed1.append(parsed.entries[8].title) 
    feed1.append(parsed.entries[9].title) 
    feed1 = str(feed1) 
    feedsplit = feed1 
    feedsplit = feedsplit.translate(None, '\'') 
    feedsplit = feedsplit.translate(None, 'u') 
    feedsplit = feedsplit.translate(None, '[') 
    feedsplit = feedsplit.translate(None, ']') 
    feedsplit = str.lower(feedsplit) 
    feedsplit = str.split(feedsplit) 
    return(feedsplit) 

reddit = feedGrabber("https://www.reddit.com/r/news/.rss") 
cnn = feedGrabber('http://rss.cnn.com/rss/cnn_topstories.rss') 
nyt = feedGrabber('http://rss.nytimes.com/services/xml/rss/nyt/HomePage.xml') 

one = Counter(reddit) 
two = Counter(cnn) 
three = Counter(nyt) 
pprint.pprint(one + two + three)

来源

2015-09-23 n1c9

删除它们为什么不删除的话，如“”从'Counter'对象创建？这比创建正则表达式更容易。另外，你可能想了解'for'循环。 – TigerhawkT3

您正在查找* stopword filtering * [见这篇文章]（http://stackoverflow.com/questions/5486337/how-to-remove-stop-words-using-nltk-or-python） – rebeling

这里是常见单词的列表，你可以使用列表理解中从文本

text = [ x for x in text if not isCommon(x)] 


    def isCommon(word): 

    commonWords = ["the", "be", "and", "of", "a", "in", "to", "have", "it", 
     "i", "that", "for", "you", "he", "with", "on", "do", "say", "this", 
     "they", "is", "an", "at", "but","we", "his", "from", "that", "not", 
     "by", "she", "or", "as", "what", "go", "their","can", "who", "get", 
     "if", "would", "her", "all", "my", "make", "about", "know", "will", 
     "as", "up", "one", "time", "has", "been", "there", "year", "so", 
     "think", "when", "which", "them", "some", "me", "people", "take", 
     "out", "into", "just", "see", "him", "your", "come", "could", "now", 
     "than", "like", "other", "how", "then", "its", "our", "two", "more", 
     "these", "want", "way", "look", "first", "also", "new", "because", 
     "day", "more", "use", "no", "man", "find", "here", "thing", "give", 
     "many", "well"] 

    if word in commonWords: 
     return True 
    return False

来源

2015-09-23 23:32:01 LetzerWille

替换特定单词

回答

相关问题