This week's banner is by lwc from Oklahoma, USA

Straight photography and off-topic
Back to the book | Post New Topic | Search | Help | Log In | Register

» Forum Index » Straight photography and off-topic » Topic: Web Connections - Shannons Law - Information Theory

Posted on 12/11/10 2:37:55 PM
Jota120
Ingenious Inventor
Posts: 2615

Reply


Web Connections - Shannons Law - Information Theory
Here is mine in Ireland (the small one). Intersting how much information goes through there.
Information Theory
Someone from Ireland asked me about Shannons Law, prove disprove it.
I could not. I find it very difficult.
Do want to try?
It rules your mobile phones air interface (I think I know about them), down the wire.
It seems right, but I don't have an answer.



Posted on 12/11/10 2:58:47 PM
Jota120
Ingenious Inventor
Posts: 2615

Reply


Re: Web Connections - Shannons Law - Information Theory
http://en.wikipedia.org/wiki/Shannon-Hartley_theorem

Posted on 16/11/10 08:38:44 AM
Daniel
Poser Professor
Posts: 192

Reply


Re: Web Connections - Shannons Law - Information Theory
Hi Trever,

Very nice photo ...But how does Shannons theory come into picture here?!

I guess Shannons theory tells us that there is a limit for how fast “errorless" information can be carried out over a communication channel.

For instance if we think about your example of mobile phones: no matter how clever we become and invent/implement more and more sophisticated modulation techniques, our wireless channel will always have a speed limitation (in terms of the bandwidth versus distance that we can send the data). And the theory says that we can never go beyond that limitation …

Now, how this particular theory of Shannon would apply to photography, I don’t have a clue!! … Do you? By the way the proof of the theorem can be fond in many text books. My favourite is “Digital Communication" written by Proakis.

Shannon has another theorem though, which has to do with the sampling rate. I use to refer to that one as Nyquist only, but some people refer to it as Shannon-Nyquist. That one is really relevant to photography (and filming) …

Which theory did you have in your mind?









Posted on 16/11/10 09:57:12 AM
tooquilos
Wizard of Oz
Posts: 2899

Reply


Re: Web Connections - Shannons Law - Information Theory
Another theory can be applied here...Occam's Razor

"one should not increase, beyond what is necessary, the number of entities required to explain anything"

http://pespmc1.vub.ac.be/occamraz.html

_________________
Dorothy: "there's no place like home!"

Posted on 16/11/10 5:25:54 PM
Jota120
Ingenious Inventor
Posts: 2615

Reply


Re: Web Connections - Shannons Law - Information Theory
Hi Daniel,

Guess I need to keep closer to topic, but:

I was only thinking how that little wire and all the network behind it can transmit and receive all that information and with increasing technology gets closer to Shannon-Hartley theorum, where the for digital transmission the channel capacity is based on Bandwidth, Power(received) and Noise. The theoretical limits of course apply to fiber optics and mobile/wi-fi/wimax etc communication. I operate in the industry, but does not mean I cannot be still amazed, maybe makes more amazed as technology builds and moves forward on what we have learnt.

I was not thinking of the image technology itself. For astronomy have to start thinking of optical and Heisenberg Uncertainty Principle as well.

Thanks. Enough from me.

You're right Anna . Some people should remember that.

Trevor

Posted on 17/11/10 08:03:12 AM
Daniel
Poser Professor
Posts: 192

Reply


Re: Web Connections - Shannons Law - Information Theory
Hi Trever,

Sorry … I must have misinterpreted your email. I didn’t figure out that your question about Shannon’s theory was a kind of rhetorical one.

Anyway … your entries are always very entertaining and the fact that you think out of the box make them really interesting. I guess that’s where your title Ingenious Inventor comes from …

Have a nice day …

Cheers
Daniel


Jota120 wrote:
Hi Daniel,

Guess I need to keep closer to topic, but:

I was only thinking how that little wire and all the network behind it can transmit and receive all that information and with increasing technology gets closer to Shannon-Hartley theorum, where the for digital transmission the channel capacity is based on Bandwidth, Power(received) and Noise. The theoretical limits of course apply to fiber optics and mobile/wi-fi/wimax etc communication. I operate in the industry, but does not mean I cannot be still amazed, maybe makes more amazed as technology builds and moves forward on what we have learnt.

I was not thinking of the image technology itself. For astronomy have to start thinking of optical and Heisenberg Uncertainty Principle as well.

Thanks. Enough from me.

You're right Anna . Some people should remember that.

Trevor




Posted on 17/11/10 08:25:16 AM
Daniel
Poser Professor
Posts: 192

Reply


Re: Web Connections - Shannons Law - Information Theory
Hi Anna,

I am not exactly sure what you are implying, but I personally prefer Einstein’s approach:

"Everything should be made as simple as possible, but no simpler”.


Cheers
Dan

tooquilos wrote:
Another theory can be applied here...Occam's Razor

"one should not increase, beyond what is necessary, the number of entities required to explain anything"

http://pespmc1.vub.ac.be/occamraz.html




Posted on 18/11/10 2:42:19 PM
Jota120
Ingenious Inventor
Posts: 2615

Reply


Re: Web Connections - Shannons Law - Information Theory
Thanks Daniel.

No need for sorry, sometimes, as others know, I'm not very clear, maybe by intent sometimes, but other times by mistake.

Great to see you're active on the forum.
I really enjoy most entries from all, including your's and great to see the variations and creativity.

Have a nice day too,
Trevor

Back

[ To post a reply, please Log In or Register ]

Powered by SimpleForum Pro 4.6