Skip to main content
 首页 » 编程设计

Python 决策树分类器 batch_prob_classify 函数

2025年05月04日13cmt

我正在尝试运行以下 nltk 站点中提供的决策树代码 http://www.nltk.org/howto/classify.html

>>> train = [ 
...      (dict(a=1,b=1,c=1), 'y'), 
...      (dict(a=1,b=1,c=1), 'x'), 
...      (dict(a=1,b=1,c=0), 'y'), 
...      (dict(a=0,b=1,c=1), 'x'), 
...      (dict(a=0,b=1,c=1), 'y'), 
...      (dict(a=0,b=0,c=1), 'y'), 
...      (dict(a=0,b=1,c=0), 'x'), 
...      (dict(a=0,b=0,c=0), 'x'), 
...      (dict(a=0,b=1,c=1), 'y'), 
...      ] 
>>> 
>>> 
>>> test = [ 
...      (dict(a=1,b=0,c=1)), # unseen 
...      (dict(a=1,b=0,c=0)), # unseen 
...      (dict(a=0,b=1,c=1)), # seen 3 times, labels=y,y,x 
...      (dict(a=0,b=1,c=0)), # seen 1 time, label=x 
...      ] 
>>> 
>>> 
>>> import nltk 
>>> classifier = nltk.classify.DecisionTreeClassifier.train(train, entropy_cutoff=0, support_cutoff=0) 
>>> sorted(classifier.labels()) 
['x', 'y'] 
>>> print(classifier) 
c=0? .................................................. x 
  a=0? ................................................ x 
  a=1? ................................................ y 
c=1? .................................................. y 
 
>>> classifier.batch_classify(test) 
['y', 'y', 'y', 'x'] 
>>> for pdist in classifier.batch_prob_classify(test): 
...      print('%.4f %.4f' % (pdist.prob('x'), pdist.prob('y'))) 
... 
Traceback (most recent call last): 
  File "<stdin>", line 1, in <module> 
  File "//anaconda/lib/python2.7/site-packages/nltk/classify/api.py", line 87, in batch_prob_classify 
    return [self.prob_classify(fs) for fs in featuresets] 
  File "//anaconda/lib/python2.7/site-packages/nltk/classify/api.py", line 67, in prob_classify 
    raise NotImplementedError() 
NotImplementedError 
>>> 

问题出在 batch_prob_classify 函数上。任何人都可以建议如何解决这个问题以及如何获得概率分布值。

请您参考如下方法:

DecisionTreeClassifier 使用概率类 MLEProbDist,它没有任何 prob 方法。另一方面,NaiveBayesClassifier 使用概率类 ELEProbDist,它又继承自 LidstoneProbDist 概率类并且做 提供一个 prob 方法。

因此,除非您想创建 DecisionTreeClassifier 的子类并自己添加 prob 方法,否则您可能想改用 NaiveBayesClassifier :

>>> classifier = nltk.classify.NaiveBayesClassifier.train(train)  # note the use of NaiveBayesClassifier here 
>>> for pdist in classifier.batch_prob_classify(test): 
      print('%.4f %.4f' % (pdist.prob('x'), pdist.prob('y'))) 
 
 
0.3104 0.6896 
0.5746 0.4254 
0.3685 0.6315 
0.6365 0.3635 

正如@Mike 指出的那样,您收到了预期的结果。您可能对本页前面的一个非常相似的示例感到困惑。