http://blog.pixeltje.be/2008/09/data-set-competitions/ Thoughts on image processing, reproducible research, and science in general Sun, 05 Feb 2012 01:49:11 +0000 http://wordpress.org/?v=2.7 hourly 1 http://blog.pixeltje.be/2008/09/data-set-competitions/comment-page-1/#comment-11 Xiaolin Fri, 24 Oct 2008 14:21:54 +0000 http://blog.pixeltje.be/?p=60#comment-11 I certainly agree with your thought about the data set problem, since I encountered the same difficulty in my research. When I wanted to compare my algorithm with others for video coding, it is almost impossible for me to find a common test set that others used. And most of the algorithms proposed can not be found on the authors' websites, which makes comparison very difficult. I really think research should be made more 'transparent' and open to competition! So I like your idea of 'data set competition'. Although not only the 'best' algorithms should be appreciated, new concept/trial/idea can also be promoted, providing benchmark is definitely something useful to do.:) I certainly agree with your thought about the data set problem, since I encountered the same difficulty in my research. When I wanted to compare my algorithm with others for video coding, it is almost impossible for me to find a common test set that others used. And most of the algorithms proposed can not be found on the authors’ websites, which makes comparison very difficult. I really think research should be made more ‘transparent’ and open to competition!
So I like your idea of ‘data set competition’. Although not only the ‘best’ algorithms should be appreciated, new concept/trial/idea can also be promoted, providing benchmark is definitely something useful to do.:)

]]>