官术网_书友最值得收藏!

How the Naive Bayes algorithm works

The Naive Bayes algorithm uses Bayes' theorem to calculate the posterior probability of every condition in the dataset and uses these probabilities to calculate the conditional probability of an event given a set of conditions. The Naive Bayes algorithm assumes that each conditional feature is independent of each other. This is an important assumption that helps simplify how the conditional probability is calculated. The independence assumption is the reason why the algorithm gets the name, Naive Bayes. 

In this section, instead of considering one x feature variable, we consider a vector of features, , where n is the number of feature variables used to calculate the class probability. We represent the conditional probability of a class variable for the x vector in formula 3:

Formula 3

 

As we have assumed that each feature variable is independent of each other, the conditional probability of a class variable can be calculated as follows:

Formula 4

    

Based on posterior probability calculations shown in the previous sections, this formula can be rewritten as follows:

Formula 5

  

Formula 5 explains how a probability of event C is calculated based on the  feature variables. An interesting thing to note in this formula is how easy it is to calculate each element from the dataset. Also, since the evidence probability from Bayes' theorem is not dependent on the class variable, it is not used in the Naive Bayes formula.

The Naive Bayes algorithm only requires one pass over the dataset during the training phase to calculate the probability of the value of a feature for each event. During the prediction phase, we calculate the probability of each event given the instance of the features and predict the event with the highest probability. Formula 6 shows how the prediction of a Na?ve Bayes classifier is calculated when k events are possible. Argmax in the formula means that the event with maximum probability is selected as the prediction:

 Formula 6

Na?ve Bayes classifier is a multiclass classifier that can be used to train on a dataset where two or more class variables need to be predicted. In the next chapters, we will present some examples of binary classifiers that only work with two class variables needs to be predicted. However, we will show you the methodologies of applying binary classifiers to multiclass problems.

主站蜘蛛池模板: 清镇市| 曲沃县| 北辰区| 兴业县| 北川| 石柱| 乐山市| 新野县| 剑河县| 娄底市| 丽水市| 襄汾县| 莎车县| 石家庄市| 永登县| 理塘县| 祁连县| 武陟县| 二连浩特市| 高平市| 石屏县| 浙江省| 阿坝县| 阜新| 鹿邑县| 宕昌县| 宜城市| 同心县| 义乌市| 织金县| 克拉玛依市| 申扎县| 建昌县| 定远县| 郑州市| 新密市| 平潭县| 山阴县| 两当县| 苍溪县| 思南县|