This is because your main product image full size might be too small.
The zoom feature cannot negative zoom so it struggles to make sense of where it start the zooming. If you upload an image at least 3 times the thumbnail size then it should start working correctly.
