Test decision tree, XGB, and logistic model performance more thoroughly. Use cross validation, pruning, feature reduction, etc.
This addresses data tutor's comments:
"Did you cross validate? What pruning did you do? Did you do PCA? did you try other feature reduction techniques? Did you try XGB?
I would be very surprised that you couldn't get a better result than your baseline model and there is a risk that the time difference is interpreted as a lack of optimisation rather than LR being the better choice. What other reasons was LR the right choice?"
Test decision tree, XGB, and logistic model performance more thoroughly. Use cross validation, pruning, feature reduction, etc.
This addresses data tutor's comments:
"Did you cross validate? What pruning did you do? Did you do PCA? did you try other feature reduction techniques? Did you try XGB?
I would be very surprised that you couldn't get a better result than your baseline model and there is a risk that the time difference is interpreted as a lack of optimisation rather than LR being the better choice. What other reasons was LR the right choice?"