That 2nd O atom is hardly attached and to the H20 and is ready to fly off and combine with something else. That makes it caustic.

My contacts use H2O2 for cleaning. The other day I picked the wrong bottle to put water in my lenses to put in my eyes. It only takes a split of a second to know you screwed up. I did not wear contacts for the rest of that week.