I think so, because Harry is a descendent of Ignatius, the brother smart enough to choose the cloak and not the wand or Stone. Most of his descendents generally ended up being Gryffindor. Voldemort's family line was the brother who chose the Resurrection Stone and they generally ended up Slytherin. And the third brother's line died out so no one to pass it on to, and due to the nature of the Elder Wand ended up being passed on to many people.
Going into pure speculation zone now, but that might also be the reason why Voldemort choose Harry over Neville as the one that the prophecy spoke of. Even though the family names had changed (as proven by the Gaunts) maybe the family relation was something that he sensed on a certain level.