Here is the identity: When expanding it should be sums of integrals where one part is a variance of regression function and the other a variance about regression function. Excuse my English, I am not sure about the correct terminology.