I see the above activities as being evening and nighttime activities. accomplished in the safety of the Caves. While Stone structure building strikes me a a daytime activity and at a time when hunting and gathering could be carried out.
The megaliths of the neolithic comes at a time when people had more control over their environment and therefore control over their time management.