As a scheduled ancient monument its illegal for you to remove anything, but I wonder if taking a small shard to the local FLO may be the only way someone will listen to you. You could try contacting the county archaeologist or the EH person in charge of that region, but sadly they will probably be too busy to help.
Cheers...have tried another society...awaiting their reply now......