Skip to content
This repository has been archived by the owner on Jul 6, 2020. It is now read-only.

Add Features and Organization comparision #245

Open
wants to merge 8 commits into
base: master
Choose a base branch
from
Prev Previous commit
Next Next commit
Change AICrowd to AIcrowd
FirePing32 authored Dec 28, 2019
commit f7e23cd351e6b575eb88355261f3b532a44c28cc
2 changes: 1 addition & 1 deletion README.md
Original file line number Diff line number Diff line change
@@ -13,7 +13,7 @@ EvalAI is an open source web application that helps researchers, students and da

In recent years, it has become increasingly difficult to compare an algorithm solving a given task with other existing approaches. These comparisons suffer from minor differences in algorithm implementation, use of non-standard dataset splits and different evaluation metrics. By providing a central leaderboard and submission interface, we make it easier for researchers to reproduce the results mentioned in the paper and perform reliable & accurate quantitative analysis. By providing swift and robust backends based on map-reduce frameworks that speed up evaluation on the fly, EvalAI aims to make it easier for researchers to reproduce results from technical papers and perform reliable and accurate analyses.

| Features | OpenML | TopCoder | Kaggle | AICrowd | ParlAI | Codalab | EvalAI |
| Features | OpenML | TopCoder | Kaggle | AIcrowd | ParlAI | Codalab | EvalAI |
FirePing32 marked this conversation as resolved.
Show resolved Hide resolved
| :------------------------: | :----------------------: | :----------------------: | :----------------------: | :----------------------: | :----------------------: | :----------------------: | :----------------: |
| AI challenge hosting | :heavy_multiplication_x: | :white_check_mark: | :white_check_mark: | :white_check_mark: | :heavy_multiplication_x: | :white_check_mark: | :white_check_mark: |
| Custom metrics | :heavy_multiplication_x: | :heavy_multiplication_x: | :heavy_multiplication_x: | :white_check_mark: | :white_check_mark: | :white_check_mark: | :white_check_mark: |