Moderately Clipped LASSO for the Sparse High-Dimensional Logistic Regression Models

• 발행기관: 한국자료분석학회
• 저자명: 이상인(Sangin Lee) 권성훈(Sunghoon Kwon)
• 간행물 정보: 『Journal of The Korean Data Analysis Society (JKDAS)』Vol.17 No.3, 1145~1154쪽, 전체 10쪽
• 주제분류: 자연과학 > 통계학
• 파일형태: PDF
• 발행일자: 2015.06.30

영문 초록

Many penalized estimation methods have been applied to the sparse high-dimensional logistic regression models for the classification tasks. Standard convex penalties such as the least absolute shrinkage and selection operator (LASSO) and ridge are known to have high prediction accuracy but tend to select too many irrelevant variables. On the other hand, standard concave penalties such as the smoothly clipped absolute deviation (SCAD) and minimax concave penalty (MCP) are known to successfully delete irrelevant variables but tend to be inferior to convex penalties in prediction accuracy. In this paper, we study a new penalty, the moderately clipped LASSO (MCL), in the sparse high-dimensional logistic regression models. The MCL is designed by combining the LASSO and MCP, and hence it is expected to preserve advantages of the LASSO and MCP simultaneously. We develop an efficient algorithm also. Numerical studies using simulated and real data analysis show that the MCL method successfully deletes irrelevant variables without losing prediction accuracy.

목차

1. Introduction

2. Moderately clipped LASSO estimation

3. Numerical studies

4. Concluding remarks

References

키워드

LASSO Logistic regression Moderately clipped LASSO Minimax concave penalty Variable selection