True, though some sites are butterfly hotspots due to the particular regime run by English Nature. Silbury and White Horse Hill/Uffington come to mind.
Silbury is particularly precious nature-wise as it's been studied for so long and is the only place where a uniform exposed slope extends around 360 degrees [That's another reason not to go galumphing up it of course ;) ]