I am currently facing a challenge of comparing a metric (y) across different times (x). But there is a parameter ‘z’ which affects the calculation of ‘y’. How to bring ‘z’ across different ‘x’ to a common reference level so that ‘y’ can be compared across ‘x’.
I have two ideas:
- Either create a custom metric out of 'y and ‘z’ and compare. If yes, how do I validate the invention of this new metric?
- Find out a threshold for ‘x’ so that only the ‘y’ values corresponding to above that ‘x’ value would be considered and compared ignoring the outliers.
Which one to go with?