DGoogle: A Full-Text Search Engine in Large-Scale Peer-to-Peer Systems.

Abstract

Full-text search engines like Google serve an important role in accessing Internet resources. In such engines, a search for web pages, matching a user's query, are typically carried on a set of co-administered, physically co-located clusters of servers. Full-text search capabilities are also needed in distributed, peer-to-peer systems. Such systems are inherently not co-administered due to the limited capacity and the instability of their members, and to provide censorship resilience and member anonymity. Full-text search in large-scale peer-topeer systems is challenging since the search can potentially span millions of peers in different administrative domains.

In this paper, we introduce a full-text search engine, DGoogle, designed for largescale peer-to-peer systems. DGoogle is simple to implement, does not require an organization of maintained resources based on their semantics, and can deal with text queries of arbitrary format. Simulation results show that DGoogle offers faster response to user queries, and consumes lesser network bandwidth when compared to the existing techniques such as Inverted Indices.