You're obviously far more informed on the subject than I am, but I've always thought the best way to learn is by asking stupid questions to smarter people......
The problem that I have with mathematical and physicalist definitions of information is that they shift an enormous amount of the explanatory weight onto the question of relevance - an issue which they then seem to blackbox for another field, another day.
Unless the relevant information is somehow sifted from the irrelevant information (relevant from the perspective of the receiver/interpreter) then I don't see how the mathematical model really gets us anywhere all that deep and interesting.
Yes, these equations are VERY useful for syntactical coding and condensing of messages, but it doesn't have much to say about the meaningful, semantic information expressed by the message itself that is being coded and condensed.
RE: Information Science – What the Hell Is Information?