Defining logical domains in a web site

Each URL identifies a unique Web page; thus, it is viewed as a natural choice to use for organizing Web query results. Web search results may be grouped by domain and presented to users as clusters for ease of visualization. However, it has a drawback: dealing with large Web sites, such as Geocities, W3C ,a ndwww.cs.umd.edu. Large Web sites tend to yield many matches that leads to a few large, flat structured, and unorganized clusters. As a matter of fact, these sites contain Web sites of other entities, such as projects and people. Many pages in these sites are actually “logical domains” by themselves. For example, Web sites for projects at a university or the XML section at W3C could be viewed as “logical domains”. In this paper, we propose the concept of logical domain with respect to physical domainwhich is identified simply by domain name. We have developed and implemented a set of rules based on link structure, path information, document metadata, and citation to identify logical domain entry pages and their corresponding boundaries. Experiments on real Web data have been conducted to validate the usefulness of this technique.