What version of Outlook?
Have you checked to make sure the "prompt for profile" option is checked?
If it is checked, it could be that Outlook isn't closing properly, so it's
just reopening the last-used profile. When you close Outlook open your Task
Manager and see if OUTLOOK.EXE is still running.