Academia.eduAcademia.edu

Outline

Title
Abstract
Introduction
Conclusion
6 Conclusion
References

1 Is Entropy Associated with Time ' s Arrow ?

Profile image of Arieh Ben-NaimArieh Ben-Naim

2017

Abstract

We start with reviewing the origin of the idea that entropy and the Second Law are associated with the Arrow of Time. We then introduced a new definition of entropy based on Shannon’s Measure of Information (SMI). The SMI may be defined on any probability distribution; and therefore it is a very general concept. On the other hand entropy is defined on a very special set of probability distributions. More specifically the entropy of a thermodynamic system is related the probability distribution of locations and velocities (or momenta) of all the particles, which maximized the Shannon Measure of Information. As such, entropy is not a function of time. We also show that the H-function, as defined by Boltzmann is an SMI but not entropy. Therefore, while the H-function, as an SMI may change with time, Entropy, as a limit of the SMI does not change with time.

Related papers

The Nature of Thermodynamic Entropy
James A Putnam

2011

Thermodynamic entropy is a pathway for transitioning from the mechanical world of fundamental physics theory to the world of probabilities, statistics, microstates, and information theory as applied to analyses of the universe. This paper proposes to explain the physical meaning of thermodynamic entropy, and, its connection to Boltzmann’s entropy. The inclusion of Boltzmann’s constant in his definition of entropy establishes the connection. The physical basis of Boltzmann’s constant and his entropy are explained. These explanations first require new analyses of fundamental properties such as force and mass.

View PDFchevron_right
The Physical Meaning of Entropy
Antonio León Sánchez

The Physical Meaning of Entropy, 2023

I propose here a new physical interpretation of entropy based on the concept of isotropy that results compatible with both Clausius and Boltzmann interpretations. I also introduce a basic principle of physics that, although implicitly assumed, has never been explicitly declared as such a principle: the Principle of Identicality (all elementary particles of the same type are identical). Both, the new principle and the new interpretation of entropy as isotropy make it possible to deduce in formal terms three laws on the evolution of entropy that are equivalent to the Second and the Third Law of Thermodynamics. All the oddities and mysteries of the enigmatic concept of entropy and of its fundamental laws disappear when examined from this new perspective: Identicality and random evolution formally imply isotropy, and then entropy.

View PDFchevron_right
The Entropy Universe
André Souto

Entropy

About 160 years ago, the concept of entropy was introduced in thermodynamics by Rudolf Clausius. Since then, it has been continually extended, interpreted, and applied by researchers in many scientific fields, such as general physics, information theory, chaos theory, data mining, and mathematical linguistics. This paper presents The Entropy Universe, which aims to review the many variants of entropies applied to time-series. The purpose is to answer research questions such as: How did each entropy emerge? What is the mathematical definition of each variant of entropy? How are entropies related to each other? What are the most applied scientific fields for each entropy? We describe in-depth the relationship between the most applied entropies in time-series for different scientific fields, establishing bases for researchers to properly choose the variant of entropy most suitable for their data. The number of citations over the past sixteen years of each paper proposing a new entropy ...

View PDFchevron_right
Entropy and Information Theory: Uses and Misuses
Arieh Ben-Naim

Entropy

This article is about the profound misuses, misunderstanding, misinterpretations and misapplications of entropy, the Second Law of Thermodynamics and Information Theory. It is the story of the “Greatest Blunder Ever in the History of Science”. It is not about a single blunder admitted by a single person (e.g., Albert Einstein allegedly said in connection with the cosmological constant, that this was his greatest blunder), but rather a blunder of gargantuan proportions whose claws have permeated all branches of science; from thermodynamics, cosmology, biology, psychology, sociology and much more.

View PDFchevron_right
"A few exciting words": information and entropy revisited
David Bawden

A review is presented of the relation between information and entropy, focusing on two main issues: the similarity of the formal definitions of physical entropy, according to statistical mechanics, and of information, according to information theory; and the possible subjectivity of entropy considered as missing information. The paper updates the 1983 analysis of Shaw and Davis. The difference in the interpretations of information given respectively by Shannon and by Wiener, significant for the information sciences, receives particular consideration. Analysis of a range of material, from literary theory to thermodynamics, is used to draw out the issues. Emphasis is placed on recourse to the original sources, and on direct quotation, to attempt to overcome some of the misunderstandings and oversimplifications that have occurred with these topics. While it is strongly related to entropy, information is neither identical with it, nor its opposite. Information is related to order and pattern, but also to disorder and randomness. The relations between information and the "interesting complexity," which embodies both patterns and randomness, are worthy of attention.

View PDFchevron_right
Entropy in Physics
Jeremy Dunning-Davies

viXra, 2018

Following worries that the entropy functions of classical thermodynamics and statistical thermodynamics were not equivalent, attention is drawn here to work by Lazar Mayants indicating that this is not the case and the two are, in fact, equivalent.

View PDFchevron_right
Entropy: From Thermodynamics to Information Processing
Ivonete Ávila

Entropy, 2021

Entropy is a concept that emerged in the 19th century. It used to be associated with heat harnessed by a thermal machine to perform work during the Industrial Revolution. However, there was an unprecedented scientific revolution in the 20th century due to one of its most essential innovations, i.e., the information theory, which also encompasses the concept of entropy. Therefore, the following question is naturally raised: “what is the difference, if any, between concepts of entropy in each field of knowledge?” There are misconceptions, as there have been multiple attempts to conciliate the entropy of thermodynamics with that of information theory. Entropy is most commonly defined as “disorder”, although it is not a good analogy since “order” is a subjective human concept, and “disorder” cannot always be obtained from entropy. Therefore, this paper presents a historical background on the evolution of the term “entropy”, and provides mathematical evidence and logical arguments regard...

View PDFchevron_right
Introduction to the Philosophy of Statistical Mechanics: Can Probability Explain the Arrow of Time in the Second Law of Thermodynamics?
Orly Shenker

Philosophy Compass, 2011

The arrow of time is a familiar phenomenon we all know from our experience: we remember the past but not the future and control the future but not the past. However, it takes an effort to keep records of the past, and to affect the future. For example, it would take an immense effort to unmix coffee and milk, although we easily mix them. Such time directed phenomena are subsumed under the Second Law of Thermodynamics. This law characterizes our experience of the arrow of time in terms of an increase of a theoretical magnitude called entropy. Statistical mechanics tries to explain the Second Law as an effect of the behavior of the microscopic particles that make up the universe. Since our senses are too coarse to see this microstructure, statistical mechanics describes our experience in terms of probability, or in terms of the partial information we have about the particles. In this paper we explain the workings of statistical mechanics; how it accounts for probability as an objective feature of the world based on the underlying dynamics; how it accounts for our memories of the past; how the statistical mechanical probability underwrites the Second Law; and how, at the same time, it leads to a violation of the Second Law by the so-called Maxwell's Demon.

View PDFchevron_right
Entropy: An ill-conceived mathematical contrivance?
Kent W Mayhew

Entropy remains part of so many thermodynamics relations, yet its true identity lacks clarity. We shall show that entropy may be nothing more than a mathematical contrivance, one that is illogically used to explain too many phenomena. In so doing, we shall question many traditional thermodynamic conceptualizations, as well as provide a unique understanding as to how Boltzmann’s constant relates to a system’s ability to do work.

View PDFchevron_right
Boltzmann entropy of thermodynamics versus Shannon entropy of information theory
siavash sohrab

International Journal of Geomechanics, 2014

Some implications of a scale invariant model of statistical mechanics to Boltzmann entropy in thermodynamics versus Shannon entropy in information theory are investigated. The objective versus subjective nature of entropy as well as the fundamental significance of the choice of Shannon measure K as Boltzmann constant k is described. In addition, the impact of the results on Nernst-Planck statement of the third law of thermodynamics is discussed.

View PDFchevron_right

References (50)

  1. To reserve and use the concept of entropy only to macroscopic systems at equilibrium, and to use the concept of SMI for all other systems; small or large number of particles, near or far from equilibrium. References
  2. Albert, D. Z. (2000), Time And Chance, Harvard University Press
  3. Atkins, P. (2007), Four Laws that Drive the Universe, Oxford University Press.
  4. Bruce, C. (2004), Schrödinger's Rabbits, The Many Worlds of Quantum, Joseph Henry Press, Washington, DC
  5. Campbell, J. (1982), Grammatical Man. Information Entropy Language and Life, Simon and Schuster, New York,
  6. Carroll, S. (2010), From Eternity to Here, The Quest for the Ultimate Theory of Time, Plume, USA
  7. Davis, P. C. W. (1974), The Physics of Time Asymmetry, University of California Press
  8. Frampton, P. H. (2010), Did Time Begin? Will Time End? World Scientific, Singapore
  9. Greene, B. (2004), The Fabric of the Cosmos. Space, Time and the Texture of Reality, Alfred A. Knopf, USA
  10. Hawking, S. (1988), A Brief History of Time, From the Big Bang to Black Holes, Bantam Books, New York
  11. Hawking, S. and Mlodinov L. (2005), A Briefer History of Time, Bantam Dell, New York
  12. Ben-Naim, A. (2016), The Briefest History of Time. World Scientific, Singapore.
  13. Penrose, R. (1989), The Emperor's Mind. Concerning Computers, Minds and the Law of Physics, Penguin Books, New York
  14. Scully, R. J. (2007), The Demon and the Quantum. From the Pythagorean Mystics to Maxwell's Demon and Quantum Mystery, Wiley-VCH Verlag GmbH & Co. KGaA
  15. Seife, C. (2006), Decoding the Universe. How the Science of Information is Explaining Everything in the Cosmos, From our Brains to Black Holes, Penguin Book, USA
  16. Lloyd, S. (2006), Programming The Universe, A Quantum Computer Scientist Takes On The Cosmos, Alfred A Knopf, New York
  17. Rifkin, J. (1980), Entropy: A New World View. Viking Adult.
  18. Mackey, M. C. (1992), Time's Arrow, The Origins of Thermodynamic Behavior, Dover Publications, New York
  19. Clausius, R. (1865), Presentation to the Philosophical Society of Zurich
  20. Eddington, A. (1928), The Nature of the Physical World, Cambridge University Press, Cambridge
  21. Ben-Naim, A. (2012), Entropy and the Second Law, Interpretation and Misss-Interpretationsss, World Scientific Publishing, Singapore.
  22. Ben-Naim, A. (2015), Information, Entropy, Life and the Universe, What We Know and What We Do Not Know, World Scientific Publishing, Singapore
  23. Ben-Naim, A. (2009), An Informational-Theoretical Formulation of the Second Law of . , 99 86 , J. Chem. Education, Thermodynamics
  24. Ben-Naim, A. (2011), Entropy: Order or Information, J. Chem. Education, 88, 594.
  25. Ben-Naim, A. (2008), A Farewell to Entropy: Statistical Thermodynamics Based on Information, World Scientific Publishing, Singapore.
  26. Callen, H.B. (1960), Thermodynamics, John Wiley and Sons, New York
  27. Callen, H. B. (1985), Thermodynamics and an Introduction to Thermostatistics, 2 nd edition, John Wiley and Sons, USA
  28. Ben-Naim, A. (2016), Entropy the Truth the Whole Truth and Nothing but the Truth, World Scientific Publishing, Singapore
  29. Ben-Naim, A. (2017), The Four Laws that do not drive the Universe. World Scientific Publishing, Singapore
  30. Brush, S. G. (1976), The Kind Of Motion We Call Heat. A History Of The Kinetic Theory of GasesIn The 19 th Century, Book 2: Statistical Physics and Irreversible Processes. North-Holland Publishing Company.
  31. Brush, S. G. (1983), Statistical Physics and the Atomic Theory of Matter, from Boyle and Newton to Landau and Onsager. Princeton University Press, Princeton.
  32. Lemons, D. S. (2013), A student's Guide to Entropy. Cambridge University Press.
  33. Boltzmann, L. (1896), Lectures on Gas Theory, Translated by S.G. Brush, Dover, New York (1995)
  34. Gibbs, J.W. (1906), Collected Scientific Papers of J. Willard Gibbs, Longmans Green, New York
  35. Goldsein, S. (2001), Boltzmann's Approach to Statistical Mechanics. (Published in arXiv:cond- mat/0105242,v1, 11 May 2001). , 391
  36. Am. J. Phys , Gibbs vs Boltzmann Entropies Jaynes, E.T. (1965),
  37. Lebowitz, J.L. (1993), Boltzmann's Entropy and Time's Arrow, Physica Today, 46, 32
  38. Wehrl, A. (1991), The Many Faces of Entropy, Reports on Mathematical Physics, 30, 119
  39. Hill, T.T. (1960), An Introduction to Statistical Thermodynamics, Addison-Wesley Publishing Company, Inc. Reading Mass. USA. 27 , Bell System Tech. J., A Mathematical Theory of Communication Shannon, C. E. (1948),
  40. 620 106 , Phys.Rev., Information Theory and Statistical Mechanics 40. Jaynes, E.T. (1957), , 171 108 , Phys. Rev., Statistical Mechanics II Information Theory and 41. Jaynes, E.T. (1957),
  41. Jaynes, E.T. (1973), The well-posed Problem, Chapter 8 in Jaynes (1983)
  42. Jaynes, E.T. (1983), Papers on Probability, Statistics, and Statistical Physics, Edited by R.D. Rosenkrantz, D. Reidel Publishing Co., London
  43. Ben-Naim, A. (2017), Entropy, Shannon's Measure of Information and Boltzmann's H-Theorem, in Entropy, 19, 48-66, (2017). , 958 36 , Annalen der Physik Sackur, O. (1911),
  44. 434 38 , Annalen der Physik Tetrode, H. (1912),
  45. Ben-Naim, A. (2010), Discover Entropy and the Second Law, World Scientific Publishing, Singapore , 725 55 Am. J. Phys. Is Mixing a Thermodynamic Process? Naim, A. (1987), - Ben 48.
  46. Kozliak, E.I. and Lambert, F.L (2005), "Order -to Disorder" for Entropy Change? Consider the Numbers! Chem. Education, 10, 24 , 1 225 , Scientific American, Entropy and Information Tribus M. and McIrvine, E.C. (1971),
  47. de Groot, S. R., and Mazur, P. (1962), Non-Equilibrium Thermodynamics, North-Holland Publishing Co., Amsterdam
  48. Kondepudi, D. and Prigogine, I. (1998), Modern Thermodynamics From Heat Engines to Dissipative Structures, John Wiley and Sons, England
  49. Sethna, J. P. (2006), Statistical Mechanics: Entropy, Order Parameters and Complexity, Oxford University Press, Oxford
  50. Kreuzer, H. J. (1981), Non-equilibrium Thermodynamics and Statistical Foundations, Oxford University Press, Oxford

Related papers

Is Entropy Associated with Time's Arrow?
Arieh Ben-Naim

2017

We start with reviewing the origin of the idea that entropy and the Second Law are associated with the Arrow of Time. We then introduced a new definition of entropy based on Shannons Measure of Information, SMI. The SMI may be defined on any probability distribution, and therefore it is a very general concept. On the other hand entropy is defined on a very special set of probability distributions. More specifically the entropy of a thermodynamic system is related the probability distribution of locations and velocities or momenta of all the particles, which maximized the Shannon Measure of Information. As such, entropy is not a function of time. We also show that the H function, as defined by Boltzmann is an SMI but not entropy. Therefore, while the H-function, as an SMI may change with time, Entropy, as a limit of the SMI does not change with time.

View PDFchevron_right
Entropy and Time
Arieh Ben-Naim

Entropy

The idea that entropy is associated with the “arrow of time” has its roots in Clausius’s statement on the Second Law: “Entropy of the Universe always increases.” However, the explicit association of the entropy with time’s arrow arises from Eddington. In this article, we start with a brief review of the idea that the “increase in entropy” is somehow associated with the direction in which time increases. Then, we examine three different, but equivalent definitions of entropy. We find that none of these definitions indicate any hint of a relationship between entropy and time. We can, therefore, conclude that entropy is a timeless quantity. We also discuss the reasons as to why some scientists went astray in associating entropy with time’s arrow. Finally, we shall discuss Boltzmann’s H-Theorem, which is viewed by many as a proof of the Second Law of Thermodynamics.

View PDFchevron_right
Entropy, Its Language, and Interpretation
Harvey Leff

The language of entropy is examined for consistency with its mathematics and physics, and for its efficacy as a guide to what entropy means. Do common de-scriptors such as disorder, missing information, and multiplicity help or hinder under-standing? Can the language of entropy be helpful in cases where entropy is not well defined? We argue in favor of the descriptor spreading, which entails space, time, and energy in a fundamental way. This includes spreading of energy spatially during processes and temporal spreading over accessible microstates states in thermody-namic equilibrium. Various examples illustrate the value of the spreading metaphor. To provide further support for this metaphor's utility, it is shown how a set of reasonable spreading properties can be used to derive the entropy function. A main conclusion is that it is appropriate to view entropy's symbol S as shorthand for spreading.

View PDFchevron_right
Entropy: a guide for the perplexed
Charlotte Werndl

C. Beisbart and S. Hartmann (eds), Probabilities in Physics. Oxford University Press, 115-142., 2011

View PDFchevron_right
Entropy and 'The Arrow of Time', A Love Story
Constantinos Ragazas

2010

In this short note we give a new definition to entropy and derive an interesting relationship between entropy and time. In light of this relationship, we show that The Second Law of Thermodynamics acquires a new meaning as stating that every physical process requires a lapse of time. In simple language, the Second Law says that 'everything happens in time'. This defines 'the arrow of time'. Furthermore, using Planck's Law we derive Boltzmann's Equation for Thermodynamic Entropy and obtain an equation for the number of microstates of a system.

View PDFchevron_right
580 California St., Suite 400
San Francisco, CA, 94104
© 2025 Academia. All rights reserved