Primary competition visual

InstaDeep Enzyme Classification Challenge

Job Interview
Completed (over 5 years ago)
Classification
527 joined
70 active
Starti
17 Nov 20
Closei
21 Feb 21
Reveali
21 Feb 21
Low test accuracy
Data · 15 Jan 2021, 19:57 · 2

I don't understand - train accuracy is higher then 90, validation accuracy close to 90, curve is coverging nice, BUT test accuracy - lower then 80! Why is that? Is test data differs that much from train? How to fight that? Thanks for any ideas.

Discussion 2 answers
User avatar
KamenialexneaAmbassador
Zindi Ambassador

train creature : (array(['creature9', 'creature3', 'creature8', 'creature4', 'creature0', 'creature2', 'creature5', 'creature1'], dtype=object), test creature : array(['creature7', 'creature6'], dtype=object))

I think it can explain the difference

Upvotes 0
User avatar

Yes, I understand that. but ussually we evaluate our model on validation test, taking from train, considering distribution of features the same in train and test. Such big difference shows that test sreatures structure actually differs from train. It was shown by Humza, that, for example, test set doesn't include some amino acids (X, U), that are present in train. But I beleive it it not the only reason.

Upvotes 0