Random Forest Notes

February 25, 2020

Here are some notes explaining the basics of Random Forest and Decision Trees with a simple example of Decision Trees in the end.

In this example the decision tree of a dataset with three samples with two features each. The importance for each feature was calculated as well.

The references used for the notes are:

  1. The Elements of Statistical Learning. T. Hastie, R. Tibshirani, and J. Friedman. Springer Series in Statistics Springer New York Inc., New York, NY, USA, (2001)
  2. https://towardsdatascience.com/the-mathematics-of-decision-trees-random-forest-and-feature-importance-in-scikit-learn-and-spark-f2861df67e3
  3. https://stackoverflow.com/questions/15810339/how-are-feature-importances-in-randomforestclassifier-determined
  4. https://stats.stackexchange.com/questions/311488/summing-feature-importance-in-scikit-learn-for-a-set-of-features
Random Forest Notes - February 25, 2020 - carlos ronchi