Boosting

• Weak learner
  • A learning algorithm producing a data structure whose predictions over two labels are more accurate than 50%.
  • Decision stumps
    • Decision tree with one interior node and two leaf nodes
• Conjecture
  • Can a collection of weak learners, working together, produce a strong learner?