What are the different methods/techniques for cluster validation in cluster analysis?

data_mining
hierarchical_cluster
clustering

#1

What are the different methods/techniques for cluster validation in cluster analysis?
Methods with examples will be preferrable


#2

Hi Sowmiyanm,
There are many ways how we validate a clustering analysis, but most of them are not as objective as we get for supervised models. In general, here is what I do to validate :

  1. Split my population into training and validation. And build the clusters on training population.
  2. We will get some k and some means as the final iteration (where the algorithm will converge).
  3. Now using the same parameters, I build clusters for the validation sample.
  4. Now compare PSI (population stability) and other profiles (beyond the variables we have built the clusters) of the validation and training population.
    Hope this helps,
    Tavish

#3

@tavish_srivastava : Thank you tavish.
Also, I came across clValid package in R, which has internal, stability and biological validation methods.