Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Permute which is the "lower" team #11

Open
sfirke opened this issue Mar 15, 2018 · 0 comments
Open

Permute which is the "lower" team #11

sfirke opened this issue Mar 15, 2018 · 0 comments

Comments

@sfirke
Copy link
Owner

sfirke commented Mar 15, 2018

From my comment here: https://www.kaggle.com/c/mens-machine-learning-competition-2018/discussion/51230

I hadn't thought of testing my model on a case where two teams are equally strong. Seems like a great test for any model. When I predict a dummy game where the teams are identical, I get 0.51 when it should be 0.5, even after removing the intercept. Not good. I suspect this is due to failing to permute which team is the "lower" team. Perhaps teams with lower Kaggle numbers have historically done slightly better over the years of data I trained on and that leaked into my model.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant