Wednesday, June 06, 2007

Entropy

An article at PLoS Biology discusses research into thermodynamics and evolution. The article is interesting in its own right, but it contains a nice summary of the concept of entropy that I thought I would reproduce here.

Entropy is a powerful but slippery concept. One reason for both its power and its slipperiness is that several different branches of physics have been able to formulate the second law of thermodynamics independently. This has meant that other fields, such as computing and ecology, can use the concept of entropy, and so entropy takes rather different forms in different systems.

In thermodynamics, entropy is uselessness. An energy gradient, such as a difference in temperature, can be used to do work. But as the gradient levels out, the energy is transformed into useless heat in equilibrium with its surroundings. In statistical mechanics, a system's entropy is the number of possible arrangements of all its microscopic states that yield any particular macroscopic state. Maximum entropy is the most probable, and most disordered state. For example, for 1,000 flipped coins, the most likely, and also the most entropic state, is 500 heads and 500 tails. This form of entropy has also been called “mixedupness”: a far greater number of molecular arrangements yield a cup of white coffee than yield a black coffee with a layer of milk sitting on top of it.

In information theory, entropy is uncertainty. The most entropic systems are those in which one is least certain what is coming next. In a very orderly message, such as a string of identical letters, the next letter is predictable. Such a system has no entropy. A string of random letters is very noisy, carries no information, and has the maximum possible entropy. This formulation of entropy was devised by the mathematician Claude Shannon, who also gave his name to a measure of biodiversity, the Shannon index. This index expressed how evenly individuals are distributed within a number of categories. The more categories, and the more equal the number of individuals in each, the greater the biodiversity; this is mathematically equivalent to a measure of entropy. In the most diverse ecosystems, a naturalist has little or no idea what species she will find next.




Whitfield J (2007) Survival of the Likeliest? PLoS Biol 5(5): e142

1 comments:

Scott Hinrichs,  6/07/2007 11:14:00 AM  

Nice. I have always wondered why there seemed to be so many definitions of entropy.

  © Blogger templates The Professional Template by Ourblogtemplates.com 2008

Back to TOP