I am trying to solve a regression problem using R caret package. I have tried multiple algorithms and identified that most of my algorithms are over fitting the data. Can somebody suggest me some ways apart from k fold validation and tuning mtry parameter in Random forest to overcome this problem?
I have seen there is something called Regularized Random forest but couldn’t find any example related to it. Also how to do pruning and significance test using Random forest using the Caret package so the algorithm can become more robust.
Any help with a sample code will be appreciated!