That's not true. It makes perfectly reasonable sense to add two RGB numbers, but you have to translate them into a linear space first (see http://en.wikipedia.org/wiki/Gamma_correction). Indeed, our whole scientific framework for understanding color is based on the ability to meaningfully add such numbers. Look up “Grassman’s Law”. (The wikipedia article is kind of spare, unfortunately.)