What is "regularization"

n. The act of making regular, of regularize.

1. n. the condition of having been made regular (or more regular) [syn: regularisation]

2. the act of bringing to uniformity; making regular [syn: regulation, regularisation]

Regularization may refer to:

• Regularization (mathematics)
• Regularization (physics)
• Regularization (solid modeling)
• Regularization (linguistics)

Regularization, in mathematics and statistics and particularly in the fields of machine learning and inverse problems, refers to a process of introducing additional information in order to solve an ill-posed problem or to prevent overfitting.

In physics, especially quantum field theory, regularization is a method of modifying observables which have singularities in order to make them finite by the introduction of a suitable parameter called regulator. The regulator, also known as a "cutoff", models our lack of knowledge about physics at unobserved scales (eg. scales of small size or large energy levels). It compensates for (and requires) the possibility that "new physics" may be discovered at those scales which the present theory is unable to model, while enabling the current theory to give accurate predictions as an "effective theory" within its intended scale of use.

It is distinct from renormalization, another technique to control infinities without assuming new physics, by adjusting for self-interaction feedback.

Regularization was for many decades controversial even amongst its inventors, as it combines physical and epistemological claims into the same equations. However it is now well-understood and has proven to yield useful, accurate predictions.

In linguistics, regularization is a phenomenon in language acquisition, language development, and language change whereby irregular forms in morphology or syntax are replaced by regular ones. Examples are "gooses" instead of "geese" in child speech and replacement of the Middle English plural form for " cow", "kine", with "cows". Regularization is a common process in natural languages; regularized forms can replace loanword forms (such as with "cows" and "kine") or coexist with them (such as with "formulae" and "formulas" or "hepatitides" and "hepatitises").

Erroneous regularization is also called overregularization. In overregularization the regular ways of modifying or connecting words are mistakenly applied to words that require irregular modifications or connections. It is a normal effect observed in the language of beginner and intermediate language-learners, whether native-speaker children or foreign-speaker adults. Because most natural languages have some irregular forms, moving beyond overregularization is a part of mastering them. Usually learners' brains move beyond overregularization naturally, as a consequence of being immersed in the language.

The same person may sometimes overregularize and sometimes say the correct form. Native-speaker adults can overregularize, but this does not happen often.