A Bay man is being held on a $125,000 cash bond after police said he was caught on camera stealing a gun from a car.