When in Vim, I can keep pressing C-o to go back to the file where I lasted left vim.