If you are seeing the Reviewing toolbar each time you open an Office
document then there really isn't a default setting that can be changed
to prevent this behavior.
For more on the reason why this occurs and a workaround take a look at
this article: