Williams was born in Westchester County, New York and grew up in Yonkers, New York. His mother, Angela Williams, is a singer and songwriter, and his father, Le’Roy Williams, is a police sergeant. Williams has two younger brothers; Tyrel Jackson Williams (b. 1997) and Tylen Jacob Williams (b. 2001). His younger brothers are both actors; Tyrel starred on the Disney XD series, Lab Rats as Leo Dooley and Tylen starred on the Nickelodeon sitcom Instant Mom as James Phillips. Williams had also appeared on Lab Rats, portraying his brother's character's future self and Instant Mom as his younger brother's family cousin Jamal.