Title:The statistical and physical significance of confidence intervals

Abstract: It is shown that the necessity to choose a specific Frequentist method, among several available, for the analysis of experimental data does not introduce any degree of subjectivity from a statistical point of view. However, the physical significance of confidence intervals obtained with different methods is different. Considering the case of a Poisson process with known background, we show that the expectation value ("exclusion potential") and the standard deviation of the upper limit in the absence of a signal can help to decide which is the most appropriate method from a physical point of view. In the framework of both Frequentist and Bayesian statistical theories, we also define the "Pull" of a null result, expressing the reliability of an experimental upper limit, the "upper and lower detection functions", that give information on the possible outcome of an experiment if there is a signal, and the "sensitivity", that quantifies the capability of an experiment to reveal the signal that is searched for at the given confidence level.