A new hypothesis based method for detecting rectilinear buildings, that have ground projection made of combination of rectangles, in satellite images is proposed. While the hypotheses are established using the lines detected in the satellite images they are verified by using shadow and color segmentation information. The proposed method is implemented in MATLAB and tested in satellite images of different urban areas. The experimental results obtained are encouraging. ©2010 IEEE.