Example: try
executing:
k=1; figure(1); hist(sum((1/k)*rand(k,1000)))
for different values of k.
The average
of noise is smaller than one example.
This is
intuitive
Can be proven in many
cases (some technical conditions: noise
must be independent, many samples
.)
Actually true for many real examples: Gaussian noise, flipping a coin many times