Generalized additive model for location, scale and shape

The Generalized Additive Model for Location, Scale and Shape (GAMLSS) is about statistical modelling and learning. GAMLSS is a modern distribution based approach to (semiparametric) regression analysis. A parametric distribution is assumed for the response (target) variable but the parameters of this distribution can vary according to explanatory variables using linear, nonlinear or smooth functions. In data science language GAMLSS is about supervised machine learning.

A guiding principle of GAMLSS is how to learn from data generated in many fields. In particular, the GAMLSS statistical framework enables flexible regression and smoothing models to be fitted to the data. The GAMLSS model assumes that the distribution of response variable has any parametric distribution which might be heavy or light-tailed, and positively or negatively skewed. In addition, all the parameters of the distribution [location (e.g., mean), scale (e.g., variance) and shape (skewness and kurtosis)] can be modelled as linear, nonlinear or smooth functions of explanatory variables.

The book "Flexible Regression and Smoothing: Using GAMLSS in R" provides an easy and comprehensive introduction to GAMLSS models, which practitioners could refer to, describing the different functionalities of the GAMLSS software.

Overview of the model

The generalized additive model for location, scale and shape (GAMLSS) is a statistical model developed by Rigby and Stasinopoulos and later expanded to overcome some of the limitations associated with the popular generalized linear models (GLMs) and generalized additive models (GAMs). For an overview of these limitations see Nelder and Wedderburn (1972)^[1] and Hastie and Tibshirani's book.^[2]

In GAMLSS the exponential family distribution assumption for the response variable, ( $y$ ), (essential in GLMs and GAMs), is relaxed and replaced by a general distribution family, including highly skew and/or kurtotic continuous and discrete distributions.

The systematic part of the model is expanded to allow modeling not only of the mean (or location) but other parameters of the distribution of y as linear and/or nonlinear, parametric and/or additive non-parametric functions of explanatory variables and/or random effects.

GAMLSS is especially suited for modelling a leptokurtic or platykurtic and/or positively or negatively skewed response variable. For count type response variable data it deals with over-dispersion by using proper over-dispersed discrete distributions. Heterogeneity also is dealt with by modelling the scale or shape parameters using explanatory variables. There are several packages written in R related to GAMLSS models.^[3]

A GAMLSS model assumes independent observations $y_{i}$ for $i=1,2,\dots ,n$ with probability (density) function $f(y_{i}|\mu _{i},\sigma _{i},\nu _{i},\tau _{i})$ conditional on $(\mu _{i},\sigma _{i},\nu _{i},\tau _{i})$ a vector of four distribution parameters, each of which can be a function to the explanatory variables. The first two population distribution parameters $\mu _{i}$ and $\sigma _{i}$ are usually characterized as location and scale parameters, while the remaining parameter(s), if any, are characterized as shape parameters, e.g. skewness and kurtosis parameters, although the model may be applied more generally to the parameters of any population distribution with up to four distribution parameters, and can be generalized to more than four distribution parameters.

{\begin{aligned}g_{1}(\mu )=\eta _{1}=X_{1}\beta _{1}+\sum _{{j=1}}^{{J_{1}}}{h}_{{j1}}(x_{{j1}})\\g_{2}(\sigma )=\eta _{2}=X_{2}\beta _{2}+\sum _{{j=1}}^{{J_{2}}}{h}_{{j2}}(x_{{j2}})\\g_{3}(\nu )=\eta _{3}=X_{3}\beta _{3}+\sum _{{j=1}}^{{J_{3}}}{h}_{{j3}}(x_{{j3}})\\g_{4}(\tau )=\eta _{4}=X_{4}\beta _{4}+\sum _{{j=1}}^{{J_{4}}}{h}_{{j4}}(x_{{j4}})\end{aligned}}

where μ, σ, ν, τ and $\eta _{k}$ are vectors of length $n$ , $\beta _{k}^{{T}}=(\beta _{{1k}},\beta _{{2k}},\ldots ,\beta _{{J'_{{k}}k}})$ is a parameter vector of length $J'_{k}$ , $X_{k}$ is a fixed known design matrix of order $n\times J'_{k}$ and $h_{{jk}}$ is a smooth non-parametric function of explanatory variable $x_{{jk}}$ , $j=1,2,\ldots ,J_{{k}}$ and $k=1,2,3,4$ .

For centile estimation the WHO Multicentre Growth Reference Study Group have recommended GAMLSS and the Box-Cox power exponential (BCPE) distributions^[4] for the construction of the WHO Child Growth Standards.^[5]^[6]

What distributions can be used

The form of the distribution assumed for the response variable y, is very general. For example an implementation of GAMLSS in R^[7] has around 50 different distributions available. Such implementations also allow use of truncated distributions and censored (or interval) response variables.^[7]

References

↑ Nelder, J.A.; Wedderburn, R.W.M (1972). "Generalized linear models". J. R. Statist. Soc. A. 135: 370–384.
↑ Hastie, TJ; Tibshirani, RJ (1990). Generalized additive models. London: Chapman and Hall.
↑ Stasinopoulos, D. Mikis; Rigby, Robert A (December 2007). "Generalized additive models for location scale and shape (GAMLSS) in R". Journal of Statistical Software. 23 (7). doi:10.18637/jss.v023.i07.
↑ Rigby, Robert; Stasinopoulos, D. Mikis (February 2004). "Smooth Centile Curves for Skew and Kurtotic data Modelled Using the Box-Cox Power Exponential Distribution". Statistics in Medicine. 23 (19): 3053–3076. doi:10.1002/sim.1861.
↑ Borghi, E.; De Onis, M.; Garza, C.; Van Den Broeck, J.; Frongillo, E. A.; Grummer-Strawn, L.; Van Buuren, S.; Pan, H.; Molinari, L.; Martorell, R.; Onyango, A. W.; Martines, J. C.; WHO Multicentre Growth Reference Study Group (2006). "Construction of the World Health Organization child growth standards: Selection of methods for attained growth curves". Statistics in Medicine. 25 (2): 247–265. doi:10.1002/sim.2227. PMID 16143968.
↑ WHO Multicentre Growth Reference Study Group (2006) WHO Child Growth Standards: Length/height-for-age, weight-for-age, weight-for-length, weight-for-height and body mass index-for-age: Methods and development. Geneva: World Health Organization.
1 2 R packages for GAMLSS can be downloaded from here

External links

This article is issued from Wikipedia - version of the 11/18/2016. The text is available under the Creative Commons Attribution/Share Alike but additional terms may apply for the media files.

Generalized additive model for location, scale and shape

Overview of the model

What distributions can be used

References

Further reading

External links