Yes, as you said, because their family has a resurrection stone handed down from the family, which can prove that tom riddle is indeed a descendant of Cadmus Pei Flier. So we can also know that tom riddle and Harry are related because Harry has an invisibility cloak, and he is the descendant of the third of Flier's three brothers.