Middlebury College
        Stereo Vision Research Page
Daniel Scharstein, Middlebury College
Richard Szeliski, Microsoft Research
Home Data Evaluation Results Code New Data
Stereo algorithm evaluation

NOTE: The evaluation below has been replaced by our new evaluation, which includes the teddy and cones images and has many new features.

We are inviting other researchers to run their stereo algorithms on the four image pairs used in our overall comparison. If you are interested in participating, please download one of the zip files below, and run your algorithm on each of the four image pairs. Submit the resulting disparity maps using the form-based interface below. It will automatically produce a table showing how your method compares with the other algorithms. You will have the option to submit your results to the permanent version of the table if desired. Details on how to encode the disparity maps can be found in the README file contained in each zip file.

Download the four image pairs

Original image pairs (three in color, one b/w):
PPM format: data_ppm.zip (2.36 MB)
TIF format: data_tif.zip (2.40 MB)

If your stereo matcher only runs on graylevel images, download one of these files:
PGM format: data_bw_pgm.zip (0.76 MB)
TIF format: data_bw_tif.zip (0.85 MB)

If you are interested, here are the true disparity maps, as well as the occlusion, discontinuity, and textureless maps:
PGM format: truedisp_pgm.zip (68 KB)
(Note: we ignore a border of 18 pixels when evaluating results of the Tsukuba images and 10 pixels for the other images.)


This evaluation script is no longer in operation

Please go to the new evaluation page.

Submit your results to our evaluation script (note: all files must be in GIF or "rawbits" PGM format):

Tsukuba disparity file (scale 16):    
Sawtooth disparity file (scale 8):
Venus disparity file (scale 8):
Map disparity file (scale 8):
 
After uploading and evaluating all four disparity maps, you can request to add your results to our permanent table by clicking here