**Have a Question?**

**Phone:** +1 (888) 427-9486

+1 (312) 257-3777

Contact Us

# Generalized Linear Models

The generalized linear model (GLM^{i}) is a flexible generalization of ordinary least squares regression. The GLM generalizes linear regression by allowing the linear model to be related to the response variable (i.e. ) via a link function (i.e. )and by allowing the magnitude of the variance of each measurement to be a function of its predicted value.

The GLM is described as follow:

And

Where:

- is the residuals or deviation from the mean
- is the link function
- is the inverse-link function
- is the inverse link function
- is the independent variables or the exogenous factors
- is a parameter vector
- is the
__linear predictor__: the quantity which incorporates the information about the independent variables into the model.

**Remarks**

- Each outcome of the dependent variables,, is assumed to be generated from a particular distribution in the exponential family, a large range of probability distributions that includes the normal, binomial and Poisson distributions, among others.
- The distribution mean of the variable (i.e. ) depends solely on the independent variables, .

- The conditional variance of the dependent variable, , is constant:

Where:

- is the variance function.
- is the dispersion factor (constant value).

**Link Function**

- The Link Function provides the relationship between the linear predictor and the mean of the distribution function. here are many commonly used link functions, and their choice can be somewhat arbitrary. It can be convenient to match the domain of the link function to the range of the distribution function's mean.
- NumXL supports five canonical link functions: Identity, Logit, Probit, Complementary Log-Log and Log. In the table below, we define the link function and outline the residuals distribution assumption.

Distribution Name Link Function Normal Identity Binomial Logit Poisson Log

## Files Examples

## References

- Hamilton, J .D.; Time Series Analysis , Princeton University Press (1994), ISBN 0-691-04289-6
- Tsay, Ruey S.; Analysis of Financial Time Series John Wiley & SONS. (2005), ISBN 0-471-690740