The zoomed area also jumps to the top-left or bottom-right when mouse zooming in and out,
in XnView v2.03 and v2.04 running through Wine.
[/Update]
I have tested this in xnview mp v0.61, v0.6 and v0.56 on linux mint 15 cinnamon 32bit.
When holding down the left mouse button and scrolling up or down to zoom in and out on a selection,
the selection jumps to the bottom-right or top-left.
The same thing happens to the zoomed in area but in the reverse direction when
zooming in and out with the right mouse button held down and scrolling up or down.
To reproduce the selection jumping around do the following:
Draw a selection on an image,
put the cursor in the middle of the selection

Hold down the left mouse button,
scroll up to zoom in,
then move the mouse, 1 pixel is enough
the selection jumps to the bottom-right when zooming in,
(for me it jumped around 50x50px)

and to the top-left when scrolling down to zooming out,
(for me it jumped around 100,100 px)

To reproduce the zoomed area jumping around do the following:
Set the right mousebutton to "Move picture",
Tools > Settings > Keyboard/Mouse > Mouse > Right button
Make sure "show pan tool" is checked,
settings > view > show pan tool
to see the zoomed in area jump around.
Open a large image so there is room to zoom in and out,
make the window slightly smaller than the image,
so there is room to pan with the right mousebutton.
If i try to zoom in on the right dot,
i place the cursor on the dot,
hold down the right mousebutton and
scroll up to zoom in,
if i move the cursor even slightly (it's difficult not to)

the zoomed area jumps towards the top-left

If i start at 200% again,
hold down the right mousebutton and
scroll down to zoom out,
and move the cursor again,
the zoomed area jumps towards the bottom-left

If i start mouse zooming when the image is smaller than the window,
then it works fine.
on a related note,
When zooming in with the left mousebutton held down but not on a selection,
a new tiny selection gets started even if one doesn't move the cursor.
When holding down the right mousebutton and scrolling to zoom in or out,
if one doesn't move the mouse before releasing the right button the context menu pops up.
thanks for making a great image viewer/manipulator,
keep up the good work