In this letter, a two-stage method for airport detection on remote sensing images is proposed. In the first stage, a new algorithm composed of several line-based processing steps is used for extraction of candidate airport regions. In the second stage, the scale-invariant feature transformation and Fisher vector coding are used for efficient representation of the airport and nonairport regions and support vector machines employed for classification. In order to evaluate the performance of the proposed method, extensive experiments are conducted on airports around the world with different layouts. The measures used in the evaluation are accuracy, sensitivity, and specificity. The proposed method achieved an accuracy of 94.6%, which was benchmarked with two previous methods to prove its superiority.