Research Based On Web Specific Information-Gathering Technology

Lan Shan, Hengyong Zhao, John Casey, Li Ning, Yao Xu

School of Information Science and Technology

Beijing University of Chemical Technology, Beijing China

The growth of networked information resources such as the Internet has spurned the development of application specific information retrieval tools. In this paper, we introduce a “Web page specific” Web-based information gathering system that identifies and isolates various topic groupings using link analysis. This process categorizes the priority with which a particular Web page topic is processed so that relevant topics are processed with a higher priority. The system has been applied in crawling petrochemical industry Web pages and achieves high crawl efficiency.