GRADUATE SCHOOL OF WESTMINSTER INTERNATIONAL UNIVERSITY IN TASHKENT PROFESSORSHIP OF STATISTICS AND ECONOMETRICS
Keywords:
sample size, linear model, confidence Interval, bootstrap,, accuracy, interval sizeAbstract
Linear regression is one of the widely used statistical methods in social sciences. The core part of the regressions are coefficients which bring some inference. Yet, we rely on hypothesis testing or confidence intervals and certain assumptions underlying linear models such as sample size being large enough. In this study, we suggest alternative way of constructing confidence intervals using bootstrap which is expected to work well even when the sample size is smaller than required per OLS assumptions. We find that even in small samples, bootstrap confidence intervals can perform better than traditional interval estimations
References
Efron, B. (1979). Bootstrap methods: Another look at the jackknife. The Annals of Statistics, 7(1), 1-26.
Efron , B. (1982). The Jackknife, the Bootstrap and Other Resampling Plans. SIAM, Philadelphia
Efron , B., and Tibshirani , R. (1986). Bootstrap methods for standard errors, confidence intervals and other measures of statistical accuracy. Statistical Science. Vol. 1 , 54 – 77
Davison , A. C. , and Hinkley , D. V. (1997). Bootstrap Methods and Their Applications. Cambridge University Press, Cambridge .
Chernick, M. R., and LaBudde, R. A. (2014). An introduction to bootstrap methods with applications to R. John Wiley & Sons.
Chernozhukov, V., and Hong, H. (2003). An MCMC approach to classical estimation. Journal of Econometrics, 115(2), 293-346.
DiCiccio , T., and Efron , B. (1992). More accurate confidence intervals in exponential families. Biometrika 79, 231 – 245 .
Fan, Y., and Li, Q. (2004). A consistent model specification test based on the kernel density estimation. Econometrica, 72(6), 1845-1858.
Freedman , D. A. (1981). Bootstrapping regression models. Annals of Statistics, 9, 1218 – 1228
Flachaire, E. (2007). Bootstrapping heteroscedastic regression models: wild bootstrap vs pairs bootstrap. Computational Statistics and Data Analysis, 49 (2), 361-376
Horowitz, J. L., and Markatou, M. (1996). Semiparametric estimation of regression models for panel data. Review of Economic Studies, 63(1), 145-168.
Greene, W. H. (2021) Econometric Analysis, 8th edn, Pearson
Gujarati, D. N., Porter, D. C., and Gunasekar, S. (2012). Basic econometrics. McGraw-Hill Higher Education
James, G., Witten, D., Hastie, T., and Tibshirani, R. (2023). An Introduction to Statistical Learning. Publisher.
Politis, D. and Romano, J, (1994). The Stationary bootstap. The journal of American Statistical Association. 89 (428), 1303-1312
Lind, D. A., Marchal, W. G., and Wathen, S. A. (1967). Statistical Techniques in Business and Economics (2nd ed). Publisher
Liu , R. Y. (1988). Bootstrap procedures under some non i.i.d. models . Annals of Statistics 16, 1696 – 1708
