Not all tribes were like that. Some tribes were displaced by us and ended up displacing others, though. But they had also been displacing each other for thousands of years.
Look at Europe even, what a mess. Greeks, Romans, barbarians, Mongols, Moors, etc.