FedBench: A Benchmark Suite for Federated Semantic Data Query Processing
Nov 25, 2011 2685 views 
In this paper we present FedBench, a comprehensive benchmark suite for testing and analyzing the performance of federated query processing strategies on semantic data. The major challenge lies in the heterogeneity of semantic data use cases, where applications may face diff erent settings at both the data and query level, such as varying data access interfaces, incomplete knowledge about data sources, availability of diff erent statistics, and varying degrees of query expressiveness. Accounting for this heterogeneity, we present a highly flexible benchmark suite, which can be customized to accommodate a variety of use cases and compare competing approaches. We discuss design decisions, highlight the flexibility in customization, and elaborate on the choice of data and query sets. The practicability of our benchmark is demonstrated by a rigorous evaluation of various application scenarios, where we indicate both the bene fits as well as limitations of the state of-the-art federated query processing strategies for semantic data.