This paper proposes a content-based video indexing system which provides the functionalities necessary for automatic management of video data through integration of syntactic and semantic features. The proposed system has been applied to detection, classification and then indexing of news programs collected from different TV channels. AG though the paper focuses on news programs, the same methods con be used to content-based index and search other TV programs with distinct semantic structure.