This Article Full Text (PDF) References Alert me when this article is cited Alert me if a correction is posted Services Email this article to a friend Similar articles in this journal Similar articles in Web of Science Alert me to new issues of the journal Add to Saved Citations Download to citation manager Request Permissions Request Reprints Add to My Marked Citations Citing Articles Citing Articles via Web of Science (3) Citing Articles via Google Scholar Citing Articles via Scopus Google Scholar Articles by Cohen, O. Articles by Schechtman, E. Search for Related Content Social Bookmarking                         What's this?

Statistical Evaluation Method for Comparing Grid Map Based Sensor Fusion Algorithms

Department of Industrial Engineering and Management, Ben-Gurion University of the Negev, PO Box 653, Beer Sheva 84105, Israel, oprc{at}bgu.ac.il

Yael Edan

Department of Industrial Engineering and Management, Ben-Gurion University of the Negev, PO Box 653, Beer Sheva 84105, Israel, yael{at}bgu.ac.il

Edna Schechtman

Department of Industrial Engineering and Management, Ben-Gurion University of the Negev, PO Box 653, Beer Sheva 84105, Israel, ednas{at}bgu.ac.il

In this paper we present a method for evaluating sensor fusion algorithms based on a quantitative comparison, which is independent of the data acquired and the sensors used. The sensor fusion performance measures and performance analysis procedure provide a basis for modeling, analyzing, experimenting, and comparing different sensor fusion algorithms. The capability to compare different algorithms creates a ranking basis, making it possible to select the best algorithm. The statistical evaluation method defines the experimental design and statistical analysis. The numbers of experiments and repetitions required are derived from the statistical characteristics and the desired confidence level. Since procedures are defined to ensure that the experiments are indeed conducted differently, the results are not specific for either the evaluated test cases or the sensor characteristics. The statistical analysis provides a systematic method for comparing sensor fusion algorithms. Although this method requires experimentation, it offers the ability to compare actual performances in the real world. Quantitative procedures are developed to ensure that specific environmental conditions evaluated do not influence the evaluation. To demonstrate the statistical evaluation method it is applied to a case study that compared five different sensor fusion algorithms in a mobile robot experiment.

Key Words: evaluation method • mobile robots • performance measures • sensor fusion

The International Journal of Robotics Research, Vol. 25, No. 2, 117-133 (2006)
DOI: 10.1177/0278364906060480


CiteULike    Complore    Connotea    Del.icio.us    Digg    Reddit    Technorati    Twitter    What's this?