Yeah, I wondered if it might be to try and fool his team he hadn't been away - depending on when he thought the Doctor had dropped him back. Which we still don't know.

Or... it could have been that he thought the Doctor had dropped him off the same day he left?