Hi all,

Edit: First I must say sorry for the ridiculous spelling mistake in the title! I wish I could go back and change 'two' to 'to'.

I have only just come across this forum while searching the net for some info - it looks fantastic so I'm hoping I'll get plenty of use out of it in the future! If I have posted this in the wrong area I apologise, and will happily delete it and reopen it in the correct one.

Currently I am creating two plots, of the mean plus and minus one standard deviation of the errors (i.e. estimated set 1 - truth and estimated set 2 - truth). From these plots I can see clearly that one method is better than the other (i.e. the mean error and standard deviations are smaller) but I am looking for a method of determining this statistically.

I'm not looking for anyone to walk me through the process, I am more than happy to go and look up how to do the process - just not sure which one to do! I thought about doing an F test, but I can't make my mind up if that is really suitable for what I want to do or not.

Thanks in advance for any help anyone can provide!

Kind Regards,

- Sean

Edit: First I must say sorry for the ridiculous spelling mistake in the title! I wish I could go back and change 'two' to 'to'.

I have only just come across this forum while searching the net for some info - it looks fantastic so I'm hoping I'll get plenty of use out of it in the future! If I have posted this in the wrong area I apologise, and will happily delete it and reopen it in the correct one.

**The problem**: I have a large set of "truth data" i.e. data that I consider to be correct, and I have two other sets of data which are estimates of said data. The methods used to derive these two sets are different. What I am looking for is a way to say if one is statistically significantly better than the other.Currently I am creating two plots, of the mean plus and minus one standard deviation of the errors (i.e. estimated set 1 - truth and estimated set 2 - truth). From these plots I can see clearly that one method is better than the other (i.e. the mean error and standard deviations are smaller) but I am looking for a method of determining this statistically.

I'm not looking for anyone to walk me through the process, I am more than happy to go and look up how to do the process - just not sure which one to do! I thought about doing an F test, but I can't make my mind up if that is really suitable for what I want to do or not.

Thanks in advance for any help anyone can provide!

Kind Regards,

- Sean

Last edited: