最佳方法在Python

Question

我需要指出在这个问题的正确方向查找多个字符串纪录我的工作：

比方说，我是从一个C程序读取输出如下：

while True: 
    ln = p.stdout.readline() 
    if '' == ln: 
     break 
    #do stuff here with ln 

而且我的输出看起来像这行线：

TrnIq: Thread on CPU 37 
TrnIq: Thread on CPU 37 but will be moved to CPU 44 
IP-Thread on CPU 33 
FANOUT Thread on CPU 37 
Filter-Thread on CPU 38 but will be moved to CPU 51 
TRN TMR Test 2 Supervisor Thread on CPU 34 
HomographyWarp Traking Thread[0] on CPU 26 

我想捕捉“TrnIq：线程”和“37”作为两个独立的变量：一个字符串和一个数字从输出“TrnIq ：在CPU上线程37" 。

对于其他行，例如捕获“HomographyWarp Traking Thread [0] on”和＃“26”，来自“在CPU 26上的HomographyWarp Traking Thread [0]”，它相当不错。

唯一真正的挑战是这样的行：“在CPU 38上的过滤器线程，但将被移动到CPU 51”，我需要“Filer-Thread”和＃“51”不是第一个＃“ 38" 。

Python有很多不同的方法来做到这一点我甚至不知道从哪里开始！

在此先感谢！

Answer 1

正则表达式在这里似乎有点小题大做了我。 [免责声明：我不喜欢正则表达式，但喜欢使用Python，所以尽可能用Python编写，不要写正则表达式。出于我从未完全理解的原因，这被认为是令人惊讶的。]

s = """TrnIq: Thread on CPU 37 
TrnIq: Thread on CPU 37 but will be moved to CPU 44 
IP-Thread on CPU 33 
FANOUT Thread on CPU 37 
Filter-Thread on CPU 38 but will be moved to CPU 51 
TRN TMR Test 2 Supervisor Thread on CPU 34 
HomographyWarp Traking Thread[0] on CPU 26""" 

for line in s.splitlines(): 
    words = line.split() 
    if not ("CPU" in words and "on" in words): continue # skip uninteresting lines 
    prefix_words = words[:words.index("on")+1] 
    prefix = ' '.join(prefix_words) 
    cpu = int(words[-1]) 
    print (prefix, cpu) 

给

('TrnIq: Thread on', 37) 
('TrnIq: Thread on', 44) 
('IP-Thread on', 33) 
('FANOUT Thread on', 37) 
('Filter-Thread on', 51) 
('TRN TMR Test 2 Supervisor Thread on', 34) 
('HomographyWarp Traking Thread[0] on', 26) 

，我不认为我需要翻译此代码的任何成英文。

Answer 2

以下应返回的信息假定ln一个元组数据的一个单一的线（编辑为包括CPU值转换为int）：

match = re.match(r'(.*?)(?: on CPU.*)?(?: (?:on|to) CPU)(.*)', ln).groups() 
if match: 
    proc, cpu = match.groups() 
    cpu = int(cpu) 

实施例：

>>> import re 
>>> for ln in lines: 
...  print re.match(r'(.*?)(?: on CPU.*)?(?: (?:on|to) CPU)(.*)', ln).groups() 
... 
('TrnIq: Thread', '37') 
('TrnIq: Thread', '44') 
('IP-Thread', '33') 
('FANOUT Thread', '37') 
('Filter-Thread', '51') 
('TRN TMR Test 2 Supervisor Thread', '34') 
('HomographyWarp Traking Thread[0]', '26') 

说明：

(.*?)   # capture zero or more characters at the start of the string, 
       # as few characters as possible 
(?: on CPU.*)? # optionally match ' on CPU' followed by any number of characters, 
       # do not capture this 
(?: (?:on|to) CPU) # match ' on CPU ' or ' to CPU ', but don't capture 
(.*)   # capture the rest of the line 

Rubular：http://www.rubular.com/r/HqS9nGdmbM

Answer 3

因此，使用正则表达式^(.*?)\s+on\s+CPU.*(?<=\sCPU)\s+(\d+)\s*$

import sys 
import re 

for ln in sys.stdin: 
    m = re.match(r'^(.*?)\s+on\s+CPU.*(?<=\sCPU)\s+(\d+)\s*$', ln); 
    if m is not None: 
    print m.groups(); 

见并测试实例here。

Answer 4

在你所提到的情况下，你总是希望第二个CPU数量，因此它可以用一个正则表达式来完成：

# Test program 
import re 

lns = [ 
    "TrnIq: Thread on CPU 37", 
    "TrnIq: Thread on CPU 37 but will be moved to CPU 44", 
    "IP-Thread on CPU 33", 
    "FANOUT Thread on CPU 37", 
    "Filter-Thread on CPU 38 but will be moved to CPU 51", 
    "TRN TMR Test 2 Supervisor Thread on CPU 34", 
    "HomographyWarp Traking Thread[0] on CPU 26" 
] 

for ln in lns: 
    test = re.search("(?P<process>.*Thread\S* on).* CPU (?P<cpu>\d+)$", ln) 
    print "%s: '%s' on CPU #%s" % (ln, test.group('process'), test.group('cpu')) 

在也许你想情况加以区分一般情况下（如线程一个CPU，移动线程，子线程...）。要做到这一点，您可以一个接一个地使用多个re.search（）。例如：

# This search recognizes lines of the form "...Thread on CPU so-and-so", and 
# also lines that add "...but will be moved to CPU some-other-cpu". 
test = re.search("(?P<process>.* Thread) on CPU (?P<cpu1>\d+)(but will be moved to CPU (?P<cpu2>\d+))*", ln) 
if test: 
    # Here we capture Process Thread, both moved and non moved 
    if test.group('cpu2'): 
     # We have process, cpu1 and cpu2: moved thread 
    else: 
     # Nonmoved task, we have test.group('process') and cpu1. 
else: 
    # No match, try some other regexp. For example processes with a thread number 
    # between square brackets: "Thread[0]", which are not captured by the regex above. 
    test = re.search("(?P<process>.*) Thread[(?P<thread>\d+)] on CPU (?P<cpu1>)", ln) 
    if test: 
     # Here we have Homography Traking in process, 0 in thread, 26 in cpu1 

为了获得最佳性能，对于频率更高的线路的测试最好先完成。

Answer 5

可以有两个正则表达式搜索非常简单地完成：

import re 

while True: 
    ln = p.stdout.readline() 
    if '' == ln: 
     break 

    start_match = re.search(r'^(.*?) on', ln) 
    end_match = re.search(r'(\d+)$', ln) 
    process = start_match and start_match.group(0) 
    process_number = end_match and end_match.group(0)