Validation tells you whether a regression model is trustworthy; refinement is what you do about it. This topic closes the loop: once residual plots, diagnostic statistics, and cross-validation results have revealed a problem — curvature in the residuals, non-constant variance, a redundant or collinear predictor, an influential point, or poor out-of-sample performance — you have to choose a response. Typical responses include dropping or adding variables, transforming the response or a predictor, changing the functional form, or accepting the model as it stands because it is good enough for its intended use.
In this course, refinement matters because engineering models are built to support decisions, not to win a contest for the highest R-squared. A slightly less accurate model that uses measurable, inexpensive inputs and is easy to explain may be the better engineering choice. You will also see that refinement is iterative: each change produces a new model that must be re-validated, and you need a stopping rule so the process converges rather than drifting into overfitting the data you happen to have.
While watching the videos, pay attention to three things: what evidence triggers a particular refinement, how competing models are compared on a common footing (information criteria, adjusted fit measures, or out-of-sample error), and what the trade-off is between fit and complexity. Keep asking: would this change actually make the model more useful to the engineer who has to apply it?
Brandon Foltz works through a regression model before and after applying variable transformations, using the well-known Boston housing data as the running example. Expect to see how a transformation changes the fitted relationship and the diagnostic picture, and how you judge whether the transformed model is actually an improvement.
This is the most direct coverage of the "applying transformations and functional form adjustments" subtopic, and the before-and-after structure models exactly the diagnose-change-recheck loop that iterative refinement requires. Foltz's Statistics 101 series is widely used for its slow, worked-example pacing.
This video introduces AIC, AICc, and BIC as scores for comparing multiple regression models, explaining what the acronyms stand for and how the criteria penalize added complexity. It focuses on how to read and compare these numbers across candidate models rather than on heavy derivation.
Comparing competing models and balancing fit against simplicity is central to this topic, and information criteria give you a defensible, quantitative basis for that comparison instead of eyeballing R-squared.
From Stanford Online's Statistical Learning course with Trevor Hastie, this opening lecture of the model-selection unit motivates why we do not simply keep every available predictor and then presents best subset selection as a systematic search over candidate variable sets. It frames variable selection in terms of prediction accuracy and model interpretability.
It supplies the conceptual backbone for variable selection and model simplification from the authors of the standard reference text, which complements the more hands-on treatment in the other two videos.
These videos extend the diagnostic work of MO1, MO2, and MO4 into action: once residual patterns or collinearity have been identified, the Foltz transformation video shows how a functional-form change is applied and re-evaluated, and the Hastie lecture shows how redundant predictors are systematically removed — together supplying the specific refinement strategies called for in MO5. The AIC/AICc/BIC video gives you a principled way to compare the resulting candidate models and to decide when added complexity is not paying for itself, which reinforces the out-of-sample thinking behind MO3 and supports judgments about when a model is sufficient for its intended engineering application.
These videos were chosen from YouTube on October 2, 2026. Each has captions; the player turns them on. Videos on YouTube can be changed or removed — if one no longer plays, tell your instructor. If a player does not appear, use its Watch on YouTube link.