I hope you realize that whites weren't the only slave owners in the US. Plenty of blacks also owned slaves.
Chattel slavery came to the new world through Anthony Johnson (former indentured slave himself) when he refused to let go of his indentured slave John Casor. It was a black man that gave the new world chattel slavery.
In 1705, Virginia declared that any non christian (Protestant) was a slave. Race wasn't even mentioned.