The bottom of the stone is unlikely to be flat. The bottom of the holes were never dug flat.
When you drop an uneven thing on to an uneven thing it could go anywhere.
Stonehenge may be the one example where the bottom of the stone 'might' have been flattened - most others are left rough. This is probably because Stonehenge was built by chippies, not stone masons.