Evaluation is based on roc_auc. The system will use the roc_auc_score from sklearn metrics. https://scikit-learn.org/stable/modules/generated/sklearn.metrics.roc_auc_score.html There is no external testing set. So your score will be based on the original training set. Be aware to set aside your validation set from it.