Williams was born in Westchester County, New York and was raised in Yonkers, New York. His mother, Angela Williams, is a singer and songwriter, and his father, Le’Roy Williams, is a police sergeant. Williams has two younger brothers; Tyrel Jackson Williams (b. 1997) and Tylen Jacob Williams (b. 2001). His younger brothers are both actors, with Tyrel starring on the Disney XD series, Lab Rats as Leo Dooley and Tylen starring on the Nickelodeon sitcom Instant Mom as James Phillips. Williams had also appeared on Lab Rats, portraying his brother's character's future self and Instant Mom as his younger brother's family cousin Jamal.