Abstract
Recently, credit scoring problems have come into prominence depending on growing the number of applicants. As known from literature, the traditional techniques are not sufficient to model this kind of problems accurately. For this reason, the researchers are still struggling to develop the novel techniques and improve the current ones to achieve better solutions. In this paper, credit scoring problem is handled by artificial neural networks (ANNs) because they provide flexible modeling procedure and superior performances in the nonlinear environments. However, the researchers mostly overlook some important requirements such as model complexity, overfitting and selection of optimization algorithm during training of ANNs. This paper presents an efficient procedure that allows estimating more robust credit scoring models by means of the information criteria and the early stopping approach based on the cross-validation technique. In the application section, ANNs are trained by various gradient based algorithms over German credit scoring data, and then their classification performances are compared with each other and logistic regression. According to results, the performance of ANNs is better than logistic regression.