F. R. Bach, Bolasso, Proceedings of the 25th international conference on Machine learning, ICML '08, pp.33-40, 2008.
DOI : 10.1145/1390156.1390161
URL : https://hal.archives-ouvertes.fr/hal-00271289

K. Balasubramanian, B. Sriperumbudur, and G. Lebanon, Ultrahigh dimensional feature screening via 416 rkhs embeddings, Artificial Intelligence and Statistics, pp.126-134, 2013.

R. Baranowski and P. Fryzlewicz, Ranking-based variable selection for high-dimensional data, 2016.

H. J. Breaux, On stepwise multiple linear regression, 1967.
DOI : 10.21236/AD0658674
URL : http://www.dtic.mil/cgi-bin/GetTRDoc?AD=AD0658674&Location=U2&doc=GetTRDoc.pdf

P. Breheny and J. Huang, Penalized methods for bi-level variable selection, Statistics and Its Interface, vol.2, issue.3, p.369, 2009.
DOI : 10.4310/SII.2009.v2.n3.a10
URL : http://europepmc.org/articles/pmc2904563?pdf=render

L. Breiman, Better Subset Regression Using the Nonnegative Garrote, Technometrics, vol.37, issue.4, pp.373-384, 1995.
DOI : 10.1080/01621459.1980.10477428

L. Breiman, Random forests, Machine Learning, vol.45, issue.1, pp.5-32, 2001.
DOI : 10.1023/A:1010933404324

J. Campos, R. Neil, . Ericsson, F. David, and . Hendry, General-to-Specific Modeling: An Overview and Selected Bibliography, SSRN Electronic Journal, 2005.
DOI : 10.2139/ssrn.791684

E. Candes and T. Tao, The Dantzig selector: Statistical estimation when p is much larger than n, The Annals of Statistics, vol.35, issue.6, pp.2313-2351, 2007.
DOI : 10.1214/009053606000001523
URL : http://doi.org/10.1214/009053606000001523

J. L. Castle, A. Jurgen, . Doornik, F. David, and . Hendry, Evaluating Automatic Model Selection, Journal of Time Series Econometrics, vol.3, issue.1, 2011.
DOI : 10.2202/1941-1928.1097
URL : http://www.nuff.ox.ac.uk/users/hendry/Papers/EvaluatingAutomaticModelSelectionJan2013.pdf

J. L. Castle, F. David, and . Hendry, A low-dimension portmanteau test for non-linearity, Journal of Econometrics, vol.158, issue.2, pp.231-245, 2010.
DOI : 10.1016/j.jeconom.2010.01.006

X. Chen and M. Xie, A split-and-conquer approach for analysis of extraordinarily large data, Statistica Sinica, vol.431, pp.1655-1684, 2014.
DOI : 10.5705/ss.2013.088

G. Cheng, . Hao-helen, Z. Zhang, and . Shang, Sparse and efficient estimation for partial spline models with increasing dimension, Annals of the Institute of Statistical Mathematics, vol.67, issue.1, pp.93-127, 2015.
DOI : 10.1214/08-AOS625
URL : http://europepmc.org/articles/pmc4299673?pdf=render

N. Choi, W. Hee, J. Li, and . Zhu, Variable Selection With the Strong Heredity Constraint and Its Oracle Property, Journal of the American Statistical Association, vol.105, issue.489, p.435, 2010.
DOI : 10.1198/jasa.2010.tm08281

, Journal of the American Statistical Association, vol.105, issue.489, pp.354-364

W. S. Cleveland, Robust Locally Weighted Regression and Smoothing Scatterplots, Journal of the American Statistical Association, vol.39, issue.368, pp.829-836, 1979.
DOI : 10.1214/aos/1176343886

W. S. Cleveland and E. Grosse, Computational methods for local regression, Statistics and Computing, vol.26, issue.no. 810345, pp.47-62, 1991.
DOI : 10.1093/comjnl/17.4.318

J. A. Doornik, Econometric model selection with more variables than observations. Unpublished paper), Economics, pp.109-135, 2009.

J. Friedman, T. Hastie, and R. Tibshirani, Sparse inverse covariance estimation with the graphical lasso, Biostatistics, vol.94, issue.1, pp.432-441, 2008.
DOI : 10.1093/biomet/asm018

J. H. Friedman, Multivariate adaptive regression splines. The annals of statistics, pp.1-67, 1991.

W. J. Fu, Penalized regressions: the bridge versus the lasso, Journal of computational and graphical statistics, vol.7, issue.3, pp.473-397, 1998.
DOI : 10.2307/1390712

P. Hall and H. Miller, Using Generalized Correlation to Effect Variable Selection in Very High Dimensional Problems, Journal of Computational and Graphical Statistics, vol.18, issue.3, p.475, 2009.
DOI : 10.1198/jcgs.2009.08041

, Journal of Computational and Graphical Statistics, vol.18, issue.3, pp.533-550

W. Hardle, H. Liang, and J. Gao, Partially linear models, 2012.

T. Hastie and R. Tibshirani, Varying-coefficient models, Journal of the Royal Statistical Society. Series BMethodological), vol.478, pp.757-796, 1993.

D. F. Hendry, S. Johansen, and C. Santos, Selecting a regression saturated by indicators, 2006.

D. F. Hendry and H. Krolzig, Improving on 'data mining reconsidered'by kd hoover and sj perez, The 481 econometrics journal, pp.202-219, 1999.

D. F. Hendry and H. Krolzig, The Properties of Automatic GETS Modelling*, The Economic Journal, vol.48, issue.502, 2005.
DOI : 10.1111/1468-0297.00114

D. F. Hendry and J. Richard, Recent developments in the theory of encompassing, 1987.

. De-louvain, Center for Operations Research and Econometrics (CORE)

A. E. Hoerl, W. Robert, and . Kennard, Ridge regression: Biased estimation for nonorthogonal problems, 1970.

, Technometrics, vol.12, issue.1, pp.55-67

K. D. Hoover, J. Stephen, and . Perez, Data mining reconsidered: encompassing and the general-to-specific approach to specification search, The Econometrics Journal, vol.2, issue.2, pp.167-191, 1999.
DOI : 10.1111/1368-423X.00025

T. Hu and Y. Xia, Adaptive semi-varying coefficient model selection, Statistica Sinica, vol.22, issue.2, pp.575-599, 2012.
DOI : 10.5705/ss.2010.105

J. Huang, P. Breheny, and S. Ma, A selective review of group selection in high-dimensional models. 491 Statistical science: a review, of the Institute of Mathematical Statistics, vol.27, issue.4, 2012.

J. Huang, S. Ma, H. Xie, and C. Zhang, A group bridge approach for variable selection, Biometrika, vol.67, issue.3, 2009.
DOI : 10.1093/biomet/asm037

, Biometrika, vol.96, issue.2, pp.339-355

C. M. Hurvich and C. Tsai, The impact of model selection on inference in linear regression. The American 495, Statistician, vol.44, issue.3, pp.214-217, 1990.

B. Kai, R. Li, and H. Zou, New efficient estimation and variable selection methods for semiparametric varying-coefficient partially linear models, The Annals of Statistics, vol.39, issue.1, p.305, 2011.
DOI : 10.1214/10-AOS842

M. Kazemi, M. Shahsavani, and . Arashi, A sure independence screening procedure for ultra-high dimensional partially 499 linear additive models. arXiv preprint, 2017.

T. Ke, J. Jin, and J. Fan, Covariate assisted screening and estimation, The Annals of Statistics, vol.42, issue.6, p.2202, 2014.
DOI : 10.1214/14-AOS1243SUPP
URL : http://europepmc.org/articles/pmc4274608?pdf=render

Z. Ke, F. Tracy, and . Yang, Covariate assisted variable ranking. arXiv preprint, 2017.

Y. Kim, H. Choi, and H. Oh, Smoothly Clipped Absolute Deviation on High Dimensions, Journal of the American Statistical Association, vol.103, issue.484, p.503, 2008.
DOI : 10.1198/016214508000001066

, American Statistical Association, vol.103, issue.484, pp.1665-1673

E. Kong and Y. Xia, Variable selection for the single-index model, Biometrika, vol.94, issue.1, pp.217-229, 2007.
DOI : 10.1093/biomet/asm008

M. Kowalski, Thresholding RULES and iterative shrinkage/thresholding algorithm: A convergence study, 2014 IEEE International Conference on Image Processing (ICIP), pp.506-4151, 2014.
DOI : 10.1109/ICIP.2014.7025843
URL : https://hal.archives-ouvertes.fr/hal-01102810

H. Krolzig, F. David, and . Hendry, Computer automation of general-to-specific model selection procedures, Journal of Economic Dynamics and Control, vol.25, issue.6-7, p.508, 2001.
DOI : 10.1016/S0165-1889(00)00058-0

, Journal of Economic Dynamics and Control, vol.2567, pp.831-866

J. Lafferty and L. Wasserman, Rodeo: Sparse, greedy nonparametric regression, The Annals of Statistics, vol.36, issue.1, pp.28-63, 2008.
DOI : 10.1214/009053607000000811

R. Li and H. Liang, Variable selection in semiparametric regression modeling, The Annals of Statistics, vol.36, issue.1, p.261, 2008.
DOI : 10.1214/009053607000000604

R. Li, W. Zhong, and L. Zhu, Feature Screening via Distance Correlation Learning, Journal of the American Statistical Association, vol.58, issue.499, pp.1129-1139, 2012.
DOI : 10.1214/08-AOS625

H. Lian, H. Liang, and D. Ruppert, Separation of covariates into nonparametric and parametric parts in 515 high-dimensional partially linear additive models, Statistica Sinica, pp.591-607, 2015.

Y. Lin and H. H. Zhang, Component selection and smoothing in multivariate nonparametric regression, The Annals of Statistics, vol.34, issue.5, pp.2272-2297, 2006.
DOI : 10.1214/009053606000000722

T. Liu, K. Lee, and H. Zhao, Ultrahigh dimensional feature selection via kernel canonical correlation 519 analysis. arXiv preprint, 2016.

L. Meier, S. Van-de-geer, and P. Buhlmann, High-dimensional additive modeling, The Annals of Statistics, vol.37, issue.6B, pp.3779-3821, 2009.
DOI : 10.1214/09-AOS692

N. Meinshausen and P. Bühlmann, High-dimensional graphs and variable selection with the lasso. The annals of 523 statistics, pp.1436-1462, 2006.

N. Meinshausen and P. Bühlmann, Stability selection, Journal of the Royal Statistical Society: Series B (Statistical Methodology), vol.7, issue.4, pp.417-473, 2010.
DOI : 10.1186/1471-2105-9-307

X. Ni, . Hao-helen, D. Zhang, and . Zhang, Automatic model selection for partially linear models, Journal of Multivariate Analysis, vol.100, issue.9, pp.2100-2111, 2009.
DOI : 10.1016/j.jmva.2009.06.009

H. Noh, . Suk, U. Byeong, and . Park, Sparse varying coefficient models for longitudinal data, Statistica Sinica, pp.1183-1202, 2010.

. Park, U. Byeong, E. Mammen, K. Young, E. R. Lee et al., Varying Coefficient Regression Models: A Review and New Developments, International Statistical Review, vol.36, issue.1, pp.36-64, 2015.
DOI : 10.1214/009053607000000802

J. S. Racine, A primer on regression splines, 2017.

P. Radchenko, M. Gareth, and . James, Variable Selection Using Adaptive Nonlinear Interaction Structures in High Dimensions, Journal of the American Statistical Association, vol.105, issue.492, pp.1541-1553, 2010.
DOI : 10.1198/jasa.2010.tm10130
URL : http://www-rcf.usc.edu/%7Egareth/research/Vanish.pdf

P. Ravikumar, H. Liu, J. Lafferty, and L. Wasserman, Spam: Sparse additive models, Proceedings of the 536 20th International Conference on Neural Information Processing Systems, pp.1201-1208, 2007.

C. Santos, F. David, S. Hendry, and . Johansen, Automatic selection of indicators in a fully saturated regression, Computational Statistics, vol.4, issue.5, pp.317-335, 2008.
DOI : 10.1093/0198283164.001.0001

R. D. Shah, J. Richard, and . Samworth, Variable selection with error control: another look at stability selection, Journal of the Royal Statistical Society: Series B (Statistical Methodology), vol.97, issue.1, pp.55-80, 2013.
DOI : 10.1198/016214502760047032
URL : http://www.statslab.cam.ac.uk/~rjs57/rssb_1034.pdf

. Steyerberg, W. Ewout, J. Marinus, J. Eijkemans, F. Dik et al., Stepwise Selection in Small Data Sets A Simulation Study of Bias in Logistic Regression Analysis, Journal of Clinical Epidemiology, vol.52, issue.10, pp.935-942, 1999.
DOI : 10.1016/S0895-4356(99)00103-1

R. Tibshirani, Regression shrinkage and selection via the lasso, Journal of the Royal Statistical Society. Series BMethodological), vol.544, pp.267-288, 1996.
DOI : 10.1111/j.1467-9868.2011.00771.x

R. Tibshirani, M. Saunders, S. Rosset, J. Zhu, and K. Knight, Sparsity and smoothness via the fused lasso, Journal of the Royal Statistical Society: Series B (Statistical Methodology), vol.99, issue.1, pp.91-108, 2005.
DOI : 10.1016/S0140-6736(02)07746-2
URL : http://www.stanford.edu/group/SOL/papers/fused-lasso-JRSSB.pdf

. Van-den-burg, J. Gerrit, J. Patrick, A. Groenen, and . Alfons, Sparsestep: Approximating the counting norm for 548 sparse regularization. arXiv preprint, 2017.

H. Wang, Forward regression for ultra-high dimensional variable screening, Journal of the American Statistical, vol.550, issue.104488, pp.1512-1524, 2009.
DOI : 10.1198/jasa.2008.tm08516

H. Wang and Y. Xia, Shrinkage estimation of the varying coefficient model, Journal of the American Statistical Association, vol.552, issue.104486, pp.747-757, 2009.
DOI : 10.1198/jasa.2009.0138

L. Wang, G. Chen, and H. Li, Group SCAD regression analysis for microarray time course gene expression data, Bioinformatics, vol.68, issue.38, pp.1486-1494, 2007.
DOI : 10.1111/j.1467-9868.2005.00532.x
URL : https://academic.oup.com/bioinformatics/article-pdf/23/12/1486/598837/btm125.pdf

M. J. Whittingham, A. Philip, . Stephens, B. Richard, . Bradbury et al., Why do we still use stepwise modelling in ecology and behaviour?, Journal of Animal Ecology, vol.17, issue.5, pp.1182-1189, 2006.
DOI : 10.1111/j.1523-1739.2003.00614.x

X. Yan, N. Tang, and X. Zhao, The spearman rank correlation screening for ultrahigh dimensional 558 censored data. arXiv preprint, 2017.

M. Yuan and Y. Lin, Model selection and estimation in regression with grouped variables, Journal of the Royal Statistical Society: Series B (Statistical Methodology), vol.58, issue.1, pp.49-67, 2006.
DOI : 10.1198/016214502753479356
URL : http://www2.isye.gatech.edu/~myuan/papers/glasso.final.pdf

C. Zhang and . Hui, Penalized linear unbiased selection, 2007.

C. Zhang, Nearly unbiased variable selection under minimax concave penalty, The Annals of Statistics, vol.38, issue.2, pp.563-894, 2010.
DOI : 10.1214/09-AOS729
URL : http://doi.org/10.1214/09-aos729

J. Zhang, Y. Liu, and Y. Wu, Correlation rank screening for ultrahigh-dimensional survival data, Computational Statistics & Data Analysis, vol.108, pp.121-132, 2017.
DOI : 10.1016/j.csda.2016.11.005

H. Zou, The Adaptive Lasso and Its Oracle Properties, Journal of the American Statistical Association, vol.101, issue.476, pp.1418-1429, 2006.
DOI : 10.1198/016214506000000735
URL : http://cbio.ensmp.fr/~jvert/svn/bibli/local/Zou2006adaptive.pdf

H. Zou and T. Hastie, Regularization and variable selection via the elastic net, Journal of the Royal Statistical, vol.569, 2005.
DOI : 10.1111/j.1467-9868.2005.00503.x

, Society: Series B (Statistical Methodology), vol.67, issue.2, pp.301-320

H. Zou, T. Hastie, and R. Tibshirani, Sparse Principal Component Analysis, Journal of computational and 571 graphical statistics, pp.265-286, 2006.
DOI : 10.1198/106186006X113430

H. Zou and R. Li, One-step sparse estimates in nonconcave penalized likelihood models, The Annals of Statistics, vol.36, issue.4, p.1509, 2008.
DOI : 10.1214/009053607000000802

H. Zou and H. Zhang, On the adaptive elastic-net with a diverging number of parameters, Annals of 575 statistics 1733. 576 c 2018 by the author. Submitted to Econometrics for possible open access publication under the terms and conditions of 577 the Creative Commons Attribution (CC BY) license, 2009.
DOI : 10.1214/08-AOS625