Horne retreated into the home, and officers later heard another gunshot, when investigators believe Horne shot the woman, the GBI said.
Crews entered the home and Horne was taken into custody by a SWAT team. He was charged with three counts of aggravated assault and one count each of false imprisonment, theft by receiving stolen property and criminal damage to property.
The woman was taken to the hospital. At last check, she was stable.
The exact sequence of events remains under investigation, according to the GBI.
Robot units could be seen at the complex during the hostage situation.
In other news:
Her daughter is currently in the Fulton County jail.