Posts Tagged ‘toreadinhardcopy’

Thoughts on “A few useful things to know about machine learning”

Thursday, February 14th, 2013

Some thoughts on a good paper giving intuition on machine learning approaches

In particular, the paper gives good intuition about:

– overfitting (e.g. how it’s related to multiple testing & bias v variance)
– the curse of dimensionality (in high-D all neighbors look the same)
– the non-practicality of theoretical guarantees
– how different frontiers can give the same prediction
– ensembles (which reduce variance greatly without increasing bias that much)
– ensembles vs Bayesian model averaging (which essentially select the best model)

A few useful things to know about machine learning

Saturday, February 9th, 2013