I think you'll find most ppl who post here would do something about it in real life.
Not to the extent of tracking down caches, but I know if I found a cache lying about near an ancient site I would treat it as I treat all litter near those sites. I'd dispose of it in a bin.
Hide them well out of the way and they'll be fine, in my opinion.