> Translation is a process which both erases information and introduces new information.

There's an essay I enjoyed by Douglas Hofstadter which is all about this, though from an artistic POV without much (any?) information science. Translator, Trader. The title itself is a fun bit of translational wordplay on "traduttore, traditore."