When you look at the tribes induvidualy they have to be close related to each other. Savah stated that the first villagers of sorrows end were born out of her and her mother. The wolfriders all have wolfblood, which came from one ancestor. Even the go back tribe is relativly small so I suppose that they also must be close related. Also (if it's canon) there were only 10 high ones to start with.