Why does hydrogen peroxide sometimes give off a distinct odor?

Sometimes when I'm using hydrogen peroxide, it leaves a bad smell on my skin, mostly like vinegar. It's very pungent and "sour-smelling". Then today I got a bottle of H2O2-containing mouthwash, and it left the same "fermented" smell in my mouth. Is this some sort of chemical reaction? Thanks.