A robust multi-view disparity estimation algorithm for noisy images is presented. The proposed algorithm constructs 3D focus image stacks (3DFIS) by projecting and stacking multi-view images and estimates a disparity map based on the 3DFIS. To make the algorithm robust to noise and occlusion, a texture-based view selection and patch size variation scheme based on texture map is proposed. Experiment results indicate that the proposed algorithm outperforms conventional stereo matching algorithms as well as previously reported multi-view disparity estimation algorithms under noisy conditions.