This could be related to your Send Receive Settings
Have you set Outlook to automatically S/R on exit.
Uncheck Send Receive on exit
It might also be that you have a number of mails in Deleted items to be deleted on exit
If yes, try to delete al mails manually before exiting (or move them t another offline folder)
