Solis-Ortiz, 56, is charged with felony murder and aggravated assault, police said.
He was also wanted for a probation violation unrelated to the homicide investigation.
According to an incident report, an officer responded to the apartment and found the victim lying on the kitchen floor with a food pan and spilled food. The officer could not find a pulse and called the homicide investigation team.
There were signs of blunt force trauma, Gwinnett police Officer Jacob Albright said after an initial investigation.
Correction: Earlier Thursday, Gwinnett police erroneously said in a statement that Solis-Ortiz was captured in Peru.