Wat. Numerologists are so lolfail.
Numbers and mathematical operations are strictly human inventions. They are not naturally occurring phenomena. For instance, you aren't going to watch a nature show about observing a pack of rare, elusive "eights" and "threes" "adding each other" in the wild.
Numbers do not "really exist" any more than, say, the characters in Shakespeare's work. Since we made them up, they mean whatever we want them to mean. As such, we can also do whatever we want with numbers using mathematical operations, like addition or subtraction. Similarly, those mathematical operations do not exist in the "real world"; we also invented them and defined them as we saw fit. You can physically combine tangible objects, and you can physically take them away from a collection of other tangible objects, but you can't actually physically perform mathematical operations on them.
Numbers are indeed based on physical quantities that exist in the "real world", and operations like addition and subtraction are indeed based on the acts of combining and taking away, but it's only because that's how we defined them to be. "9+1=2" is no less correct than "2+2=4" if that's what I defined addition, equality, and the numbers 1, 2, and 9 to mean in this particular case. Numbers and operations do not even have to represent quantities or changes to those quantities. They could represent candy canes or flowerpots or tabby cats or anything else, if that's what I wanted.
That alone should be enough to discredit numerology or at least make it a misnomer.