For minor adjustments, up, down, left, or right, click near the edge of the image that appears in the Zoom View area. The center of the display is based on your click.
For moving more quickly across an image, try clicking in the Navigator's thumbnail image. The Navigator highlights the selection area with a red rectangle. Clicking anywhere in the Navigator's image will recenter the Zoom View image display.