To get their DNA we would have had to breed with them (As you say) and the offspring from that union would then carry both of their genetic material. whether or not that offspring only mated with humans or not, would not alter the fact that it's children, would have a neanderthal as a grandparent, and all children of that line would have a neanderthal as a ancestor.