It sounds like you have perhaps configured Outlook to download from a POP3
server, and set the "Leave a copy of messages on the server."
If this is the case, Outlook will sometimes do this. I think it has
something to do with marking the messages as read (Or failing to do so) on
the server.