I think most users understand how to handle that. Put your cursor to the side.
It's one of those things like don't ever use the text "click here" for hyperlinks because people know what links look like. In the same way, it's OK to implement scrolling on maps like this within the page.
