11 Practical Methodology

11.4 Selecting Hyperparameters

11.4.1 Manual Hyperparameter Tuning

Effective capacity is constrained by three factors: the representational capacity of the model, the ability of the learning algorithm to successfully minimize the cost function used to train the model, and the degree to which the cost function and training procedure regularize the model.