It is a good practice to always apologize, except when you have done something wrong.
You need to keep reminding yourself of the obvious: charm lies in the unsaid, the unwritten, and the undisplayed. It takes mastery to control silence.