Language is alive and has been for thousands of years and isn't ever ever going to conform to your rules regardless of how logical you insist that they are.
People complain about literally being used as exaggeration but never have a problem with "really" being used in similar ways. But, like, what do you think "really" started out as meaning? It's got a big hint right there in the spelling.