The anthropology of Africa strongly refutes your claim. Along with the fact that one of the earliest civilizations ever recorded is Ancient Egypt*, and the fact that humans arose in Africa and we are therefore, in that sense, all Africans.
*Yes I'm aware that Egypt isn't particularly relevant to Sub-Saharan Africa, just roll with it.