In this paper, we present a new method for video sequence segmentation which can be used in video indexation applications. Our approach uses the image content as indice of segmentation. As for most video sequences, the images contain 3D hints. In order to detect these indices efficiently, we develop a two steps Hough Transforamtion (HT). The first HT tries to find all lines contained in video image. The second one according to the theory of projective geometry, gives the possible focus of expansion (FOE) point. Once we have all possible FOE positions, simple comparaison of these positions tells the difference of video sequences. This method is robust not only for the images taken from well structured objects in the scene as buildings, roads and other man made entities, but also for the scene containing the newer field or other alligned natural objects. The results of the approch are shown at final part of the paper.