Evaluation Score - Date your Data Contest

hackthon

#1

Team,

Is the Evaluation AUC Score for “Date your data” contest on the entire TEST dataset or a partial set of the TEST Dataset?
If yes, what is the split?


#2

The split is 20% public, 80% private


#3

what is your local cv score…??? I am facing very much difference between local and public score.


#4

Same here. There is a significant difference between the Public Leaderboard score and the Local CV Score.
May be the PL Validation Set has not been properly stratified.

Expecting the final scores to be much different.


#5

Yes you are right. my local score is like .88. What is your’s


#6

Exactly the same.
:slightly_smiling:


#7

Thanks for replying… :slight_smile:


#8

Dear @dsai_500 / @kunal ,
I would suggest that the split between the Private and Public Leaderboard should be clearly mentioned in the Contest details page itself for the upcoming contests. This will save a lot of time.

It also says that the Code has to be submitted while selecting the Final Submission File which is not true.
This should also be corrected.