A Florida man, armed with a machete, a gun and several rounds of ammunition, was arrested after allegedly shoplifting from a Fort Myers Walmart store.

Phillip Joseph, 23, went to a local Walmart on Monday and gathered items throughout the store, before trying to make off with the goods, according to WZVN TV.

Police officers confronted Joseph in the parking lot, and said he had a handgun, along with three fully loaded extended magazines of ammunition for the gun. He also had a large machete visible in his waistband, police said.

Joseph had a concealed carry permit, thus making it legal to carry the gun. But, because of the machete, he was arrested and charged with improper exhibition of a dangerous weapon.

He also faces a charge of first degree petty theft.