ImageNet Large Scale Visual Recognition Challenge (ILSVRC)
Date: May 19, 2015
Dear ILSVRC community,
Over the past years, the ImageNet Challenge, and in particular the classification task, has become one of the benchmarks to evaluate the progress of image classification. New results often attract significant attention from not only the academic community, but also industry and the popular press at large.
It was recently brought to our attention that one group has circumvented our policy of allowing only 2 evaluations on the test set per week. (As stated on our test server page: "Please note that you cannot make more than 2 submissions per week."). This group submitted evaluation requests to our test server more frequently than permitted by creating and using multiple ImageNet accounts.
As organizers of the ImageNet Challenge, we feel that it is necessary to inform our research community of this incident. We have reached out to the group. We will make additional effort to closely monitor the submission server. We will keep our community informed if there is further development.
Finally, we would like to take this opportunity to thank all of you who have adhered to the submission policy when it comes to evaluating methods on the ILSVRC test set. We look forward to continued progress in visual recognition!
June 2, 2015: Additional information can be found here