In fact, guns are now banned in every Episcopal church in Georgia. Here's a rather definitive, April 24 letter from the Right Rev. Scott Anson Benhase, bishop of the Episcopal diocese of Georgia:
The broad expansion of gun rights, signed into law last week, allows Georgians to legally carry firearms in places including schools, bars and government buildings. It also for the first time expressly permits licensed concealed-weapons holders to bring firearms into the state’s churches, provided that an individual place of worship allows it.