I have a photon detector that I would like to test. Don't worry about the physics just the statistics. I think for this it is enough to say that every 20 minutes I can detect the direction of an incoming photon. The photon will come into the detector from an angle from 0 to 120 degrees. I can design the test that there will be a number of sources in known locations or a number of sources in unknown locations. I want to test whether this detector works and with a high confidence. From web reading, I see statistically significant means a p-value is less than 0.05 or the confidence interval does not overlap 0 on a graph of correlation on the x-axis and probability on the y-axis. I believe I understand confidence intervals better right now.

I can either do two approaches that I will call discreet numbers or azimuths. An example of discreet numbers would be: say I put one source "out there" and three fake sources. I then use the detector and looking at the different possible sources I say "I just got a photon from source 1." I then look at what is the real source and it came from source 1. How many tests do I need to do to get a certain confidence (either calculated by p-value or confidence interval)?

Azimuths: I put one photon source out there but I have no idea where it is. I then get an azimuth from 0 to 120. I then look and see what the real azimuth should be. How do I calculate the accuracy in this case and the confidence of what the accuracy would be?

Thanks! -xerxes73