There's an example of a reproduction cup n' ring carving done on Millstone Grit using an ankler in Ilkley Museum. Reckon they used possibly a mixture of ankers and hard stone hammer and chisels.
I'd like to think that when they were created, they were also painted with colour... maybe just my fancy tho'.