Point moved after buffer switch

Hi Vegard, I have noticed for a few days that after your recent fixes, whenever switching to other buffers and switching back, the point moves to somewhere else, in most cases if I typed C-o one or more times I could get back to the original position before switching buffer. I used to have this problem from time to time but now it is guaranteed to be happening every time when switching buffer using C-x b. On the other hand however, it is much better for the developer to always have the problem happening rather than sometimes work and sometime doesn't.