I like this, but I am getting a lot of weird behavior. Sometimes clicking the image so I can pan it moves me to the previous image. Using the arrow keys sometimes pans the image, sometimes it takes me to the previous image.
Yes. playing with it a bit more, it seems when clicking in a location that does not give you the circle (to move your position) that this happens. If the circle is there it advances you along the road as it should. I am not sure, but I think it may be correlated with using the left/right arrow keys. i.e., use arrow keys to move forwards/backwards on the road, click "go" to go to the next image, and then click in the video with the mouse, and it displays the previous scene. But I can't make it 100% repeatable.
Also, I have it set on 'auto', and it seems to stop and not continue playing after several images. The play/stop button shows "stop(0)" and does not update. If I press the button twice to toggle playing it resumes (again for a short time).
Not complaining - I found the issues because I like it and am using it.
I'll try to reproduce the problems you mentioned. There are some keyboard shortcuts - J and K for previous and next image, and G for go. Maybe these are being triggered somehow.
When you see stop(0) it might still be searching for a Street View, especially if you're using the map.
Firefox 26.0, Windows 7