DescriptionModel selection and its diagnosis are foundational elements in modern statistical and machine learning applications that serve the purpose of obtaining reliable information and reproducible results. In this short course, we introduce the principles and theories on model selection and model averaging and their applications in high-dimensional regression. Model selection methods includ...
In statistical learning, various mathematical optimalities are used to characterize performances of different learning methods. They include minimax optimality from a worst-case standpoint and asymptotic efficiency from a rosy view that the regression function to be learned sits there to be discovered. When multiple models, e.g., trees, neural networks and support vector machines, are considere...