You can fix every defect in your model by adding more parameters to handle more cases and learning them more precisely, except for the problem of having too many parameters set too precisely.