Skip Main Navigation Skip To Navigation Content

X-13ARIMA-SEATS Seasonal Adjustment Program

You are here: Census.govSubjects A to ZX-13ARIMA-SEATSSeasonal Adjustment PapersPapers by Year › Abstract of Findley (1991)
Skip top of page navigation

Counterexamples to Parsimony and BIC

David F. Findley(1)

ABSTRACT:

Suppose that the log-likelihood-ratio sequence of two models with different numbers of estimated parameters is bounded in probability, without necessarily having a chi-square limiting distribution. Then BIC and all other related consistent model selection criteria, meaning those which penalize the number of estimated parameters with a weight which becomes infinite with the sample size, will, with asymptotic probability 1, select the model having fewer parameters. This note presents examples of nested and non-nested regression model pairs for which the likelihood-ratio sequence is bounded in probability and which have the property that the model in each pair with more estimated parameters has better predictive properties, for an independent replicate of the observed data, than the model with fewer parameters. Our second example also shows how a one-dimensional regressor can overfit the data used for estimation in comparison to the fit of a two-dimensional regressor.

KEYWORDS:

Model selection, linear regression, misspecified models, AIC, BIC, MDL, Hannan-Quinn criterion, overfitting




(1) David F. Findley was the Senior Mathematical Statistican for Time Series and is now a consultant, U. S. Census Bureau, 4600 Silver Hill Road, Washington, DC 20233. email : david.f.findley@census.gov



[PDF] or PDF denotes a file in Adobe’s Portable Document Format. To view the file, you will need the Adobe® Reader® Off Site available free from Adobe.

This symbol Off Site indicates a link to a non-government web site. Our linking to these sites does not constitute an endorsement of any products, services or the information found on them. Once you link to another site you are subject to the policies of the new site.

Source: U.S. Census Bureau | Center for Statistical Research and Methodology | (301) 763-1649 (or x12@census.gov) |  Last Revised: November 19, 2012