A store owner was arrested after police say he shot at a shoplifter as she was leaving his store.

Dunwoody Package Store owner Bryan Luu faces reckless conduct charges after he chased a shoplifter who stole a bottle of vodka, Channel 2 Action News reported.

According to police, the woman placed a bottle of liquor in her purse and left the store. That’s when the owner took off after her.

A witness told the news station that the owner chased the woman through the parking lot and fired shots.

“I see him holding a black thing in his hand,” Max Kahn said. “It was a very far distance, and then I hear him saying you better give that back.”

Unfortunately, that may not have been the wisest decision.

“You obviously want to prevent thefts from inside the store,” Sandy Springs police spokesman Capt. Mike Lindstrom said, “but that type of crime prevention is not allowed.”

Luu told Channel 2 he was only trying to defend his business, but declined further comment.

The shoplifter has not been caught.