What are some intersting techniques, skills or tips you use to solve regression/classification problems?

classification
regression
#1

I am curious about the skills and tips you have applied to regression or classification problems. For example, what I’ve been considering is the autocoder, various encoding techniques, imputation, and target validation that we use to remove noise. I’m also curious about tips that I’ve tried and tips that use statistics!