Academia.eduAcademia.edu

Outline

Title
Abstract
Introduction
Data and Methods
Results
Statistical Analysis of Features
Discussion and Conclusions
Supplementary Materials
References
All Topics
Mathematics

Approximate Entropy in Canonical and Non-Canonical Fiction

Profile image of Volker GastVolker Gast

2022, Entropy

https://doi.org/10.3390/E24020278
visibility

…

description

16 pages

link

1 file

Abstract

Computational textual aesthetics aims at studying observable differences between aesthetic categories of text. We use Approximate Entropy to measure the (un)predictability in two aesthetic text categories, i.e., canonical fiction (‘classics’) and non-canonical fiction (with lower prestige). Approximate Entropy is determined for series derived from sentence-length values and the distribution of part-of-speech-tags in windows of texts. For comparison, we also include a sample of non-fictional texts. Moreover, we use Shannon Entropy to estimate degrees of (un)predictability due to frequency distributions in the entire text. Our results show that the Approximate Entropy values can better differentiate canonical from non-canonical texts compared with Shannon Entropy, which is not true for the classification of fictional vs. expository prose. Canonical and non-canonical texts thus differ in sequential structure, while inter-genre differences are a matter of the overall distribution of loc...

Related papers

Bayesian Analysis of the Heterogeneity of Literary Style
Xavier Renedo Renedo

Revista Colombiana de Estadística, 2016

We proposed statistical analysis of the heterogeneity of literary style in a set of texts that simultaneously use different stylometric characteristics, like word length and the frequency of function words. The data set consists of several tables with the same number of rows, with the i-th row of all tables corresponding to the i-th text. The analysis proposed clusters the rows of all these tables simultaneously into groups with homogeneous style, based on a finite mixture of sets of multinomial models, one set for each table. Different from the usual heuristic cluster analysis approaches, our method naturally incorporates the text size, the discrete nature of the data, and the dependence between categories in the analysis. The model is checked and chosen with the help of posterior predictive checks, together with the use of closed form expressions for the posterior probabilities that each of the models considered to be appropriate. This is illustrated through an analysis of the he...

View PDFchevron_right
Quantifying Structure Differences in Literature Using Symbolic Diversity and Entropy Criteria
Gerardo L Febres

Journal of Quantitative Linguistics, 2016

We measured entropy and symbolic diversity of texts written in English and Spanish. We included texts by Literature Nobel laureates and other famous authors. We formed four groups of texts according to the combinations of language used and the author's Literature Nobel Prize condition. Entropy, symbol diversity and symbol frequency profiles were compared for these four groups. We also built a scale sensitive to the quality of writing and evaluated its relationship with the Flesch´s readability index for English and the Szigriszt´s perspicuity index for Spanish. Results suggest a correlation between entropy and word diversity with quality of writing. Text genre also influences the resulting entropy and diversity of the text. Results suggest the plausibility of automated quality assessment of texts.

View PDFchevron_right
Quantitative patterns of stylistic influence in the evolution of literature
David Krakauer

Proceedings of the National Academy of Sciences, 2012

View PDFchevron_right
The Rest of the Story: Distilling Meaning from Stylistic Variation
Shlomo Engelson Argamon

As we have seen, there are many diverse concepts of what we mean when we speak of the 'style' of a work; we may speak, for example, of an individual's specific style of artistic expression , of style as a means of implicitly contextualizing a work as part of a certain genre , of style as a means of conveying emotion [26], or of style as a concept organizing how observers tend to interpret a work . In this chapter, we explore automated methods for stylistic analysis of written texts (computational stylistics), formulated as having roughly two research goals: (a) develop methods to automatically distinguish texts with a certain stylistic character from those of another, and (b) distill an interpretable representation of the difference between such stylistic characters. We seek an inclusive view of the nature of style, endeavoring to consider models and methods covering the individual style of a genius as well as the generic style of a collective, style's communicative functions as well as its social determinants, and the intentions of the author as well as the potential reaction of the reader.

View PDFchevron_right
Computational Study of Stylistics: A Clustering-Based Interestingness Measure for Extracting Relevant Syntactic Patterns
Jean-Gabriel Ganascia

Int. J. Comput. Linguistics Appl., 2015

In this contribution, we present a computational stylistic study of the French classic literature texts based on a data-driven approach where discovering interesting linguistic patterns is done without any prior knowledge. We propose an objective interestingness measure to extract meaningful stylistic syntactic patterns from a given author’s work. Our hypothesis is based on the fact that the most characterising linguistic patterns should significantly reflect the author’s stylistic choice in that the positions of theirs occurrences are controlled by the author’s purpose, while the irrelevant linguistic patterns are distributed randomly in the text. Since it does not rely on the counts of occurrences of the syntactic patterns in texts, this measure can work reasonably well with both large and small text samples. The analysed results show the effectiveness in extracting interesting syntactic patterns from a single text, and this seems particularly promising for the analyses of such te...

View PDFchevron_right
Entropy Text Analyzer
Delfim F. M. Torres
View PDFchevron_right
The Rest of the Story: Finding Meaning in Stylistic Variation
Moshe Koppel

The Structure of Style, 2010

As we have seen, there are many diverse concepts of what we mean when we speak of the 'style' of a work; we may speak, for example, of an individual's specific style of artistic expression , of style as a means of implicitly contextualizing a work as part of a certain genre , of style as a means of conveying emotion [26], or of style as a concept organizing how observers tend to interpret a work . In this chapter, we explore automated methods for stylistic analysis of written texts (computational stylistics), formulated as having roughly two research goals: (a) develop methods to automatically distinguish texts with a certain stylistic character from those of another, and (b) distill an interpretable representation of the difference between such stylistic characters. We seek an inclusive view of the nature of style, endeavoring to consider models and methods covering the individual style of a genius as well as the generic style of a collective, style's communicative functions as well as its social determinants, and the intentions of the author as well as the potential reaction of the reader.

View PDFchevron_right
Quantifying structure differences in literature using symbolic diversity
Gerardo L Febres

2016

We measured entropy and symbolic diversity of texts written in English and Spanish. We included texts by Literature Nobel laureates and other famous authors. We formed four groups of texts according to the combinations of language used and the author's Literature Nobel Prize condition. Entropy, symbol diversity and symbol frequency profiles were compared for these four groups. We also built a scale sensitive to the quality of writing and evaluated its relationship with the Flesch's readability index for English and the Szigriszt's perspicuity index for Spanish. Results suggest a correlation between entropy and word diversity with quality of writing. Text genre also influences the resulting entropy and diversity of the text. Results suggest the plausibility of automated quality assessment of texts.

View PDFchevron_right
Entropy of English Text: Experiments with Humans and a Machine Learning System Based on Rough Sets
Hamid Moradi

Information Sciences, 1998

The goal of this paper is to show the dependency of measured entropy of English text on subject of the experiment, the type of English text, and the methodology used to estimate the entropy.

View PDFchevron_right
Can Zipf Analyses and Entropy Distinguish Between Artificial and Natural Language Texts?
Rosario N Mantegna

1996

We study statistical properties of natural texts written in English and of two types of artificial texts. As statistical tools we use the conventional and the inverse Zipf analyses, the Shannon entropy and a quantity which is a nonlinear function of the word frequencies, the frequency relative\ entropy". Our results obtained by investigating eight complete books and sixteen related artificial texts suggest that the inverse Zipf analysis of the frequencies of distinct words may succeed better than the conventional Zipf analysis of the distinct words ...

View PDFchevron_right

References (74)

  1. Craig, H.; Kinney, A.F. Shakespeare, Computers, and the Mystery of Authorship; Cambridge University Press: Cambridge, UK, 2009.
  2. Koppel, M.; Schler, J.; Argamon, S. Computational Methods in Authorship Attribution. J. Am. Soc. Inf. Sci. Technol. 2009, 60, 9-26.
  3. Biber, D. Dimensions of Register Variation. A Cross-linguistic Comparison; Cambridge University Press: Cambridge, UK, 1995.
  4. Lee, D. Genres, Registers, Text Types, Domains and Styles: Clarifying the Concepts and Navigating a Path through the BNC Jungle. Technology 2001, 5, 37-72. [CrossRef]
  5. Fechner, G.T. Vorschule der Ästhetik; Breitkopf and Härtel: Leipzig, Germany, 1876.
  6. Bell, C. Art; Chatoo & Windus: London, UK, 1914.
  7. Redies, C.; Brachmann, A.; Wagemans, J. High Entropy of Edge Orientations Characterizes Visual Artworks From Diverse Cultural Backgrounds. Vis. Res. 2017, 133, 130-144. [CrossRef]
  8. Brachmann, A.; Redies, C. Computational and Experimental Approaches to Visual Aesthetics. Front. Comput. Neurosci. 2017, 11, 102. [CrossRef]
  9. Mohseni, M.; Gast, V.; Redies, C. Fractality and Variability in Canonical and Non-Canonical English Fiction and in Non-Fictional Texts. Front. Psychol. 2021, 12, 920. [CrossRef]
  10. Diessel, H. The Grammar Network. How Linguistic Structure is Shaped by Language Use; Cambridge University Press: Cambridge, UK, 2019.
  11. Hartung, F.; Wang, Y.; Mak, M.; Willems, R.; Chatterjee, A. Aesthetic Appraisals of Literary Style and Emotional Intensity in Narrative Engagement Are Neurally Dissociable. Commun. Biol. 2021, 4, 1401. [CrossRef]
  12. Simonton, D.K. Lexical Choices and Aesthetic Success: A Computer Content Analysis of 154 Shakespeare Sonnets. Comput. Humanit. 1990, 24, 251-264. [CrossRef]
  13. Forsyth, R.S. Pops and Flops: Some Properties of Famous English Poems. Empir. Stud. Arts 2000, 18, 49-67. [CrossRef]
  14. Kao, J.; Jurafsky, D. A Computational Analysis of Style, Affect, and Imagery in Contemporary Poetry. In Proceedings of the NAACL-HLT 2012 Workshop on Computational Linguistics for Literature, Montreal, QC, Canada, 8 June 2012.
  15. Ashok, V.; Feng, S.; Choi, Y. Success With Style: Using Writing Style to Predict the Success of Novels. In Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing, Seattle, WA, USA, 18-21 October 2013.
  16. Maharjan, S.; Arevalo, J.; Montes, M.; González, F.; Solorio, T. A Multi-task Approach to Predict Likability of Books. In Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 1, Long Papers; Association for Computational Linguistics: Stroudsburg, PA, USA, 2017; pp. 1217-1227. [CrossRef]
  17. Maharjan, S.; Kar, S.; Montes, M.; González, F.A.; Solorio, T. Letting Emotions Flow: Success Prediction by Modeling the Flow of Emotions in Books. In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 2 (Short Papers); Association for Computational Linguistics: Stroudsburg, PA, USA, 2018; pp. 259-265. [CrossRef]
  18. Montemurro, M.A.; Zanette, D.H. Universal Entropy of Word Ordering Across Linguistic Families. PLoS ONE 2011, 6, e19875. [CrossRef]
  19. Montemurro, M.A.; Zanette, D.H. Complexity and Universality in the Long-Range Order of Words. In Creativity and Universality in Language; Degli Esposti, M., Altmann, E.G., Pachet, F., Eds.; Springer: Cham, Germany, 2016; pp. 27-41. [CrossRef]
  20. Futrell, R.; Mahowald, K.; Gibson, E. Quantifying Word Order Freedom in Dependency Corpora. In Proceedings of the Third International Conference on Dependency Linguistics; Uppsala University Press: Uppsala, Sweden, 2015; pp. 91-100.
  21. Koplenig, A.; Meyer, P.; Wolfer, S.; Müller-Spitzer, C. The Statistical Trade-off Between Word Order and Word Structure-Large- Scale Evidence for the Principle of Least Effort. PLoS ONE 2017, 12, e0173614. [CrossRef]
  22. Piantadosi, S.T.; Tily, H.; Gibson, E. Word Lengths Are Optimized for Efficient Communication. Proc. Natl. Acad. Sci. USA 2011, 108, 3526-3529. [CrossRef]
  23. Mahowald, K.; Fedorenko, E.; Piantadosi, S.T.; Gibson, E. Info/Information Theory: Speakers Choose Shorter Words in Predictive Contexts. Cognition 2013, 126, 313-318. [CrossRef]
  24. Ferrer-i-Cancho, R.; Bentz, C.; Seguin, C. Compression and the Origins of Zipf's Law of Abbreviation. arXiv 2015, arXiv:1504.04884.
  25. Kanwal, J.; Smith, K.; Culbertson, J.; Kirby, S. Zipf's Law of Abbreviation and the Principle of Least Effort: Language users optimise a miniature lexicon for efficient communication. Cognition 2017, 165, 45-52. [CrossRef]
  26. Bentz, C.; Verkerk, A.; Kiela, D.; Hill, F.; Buttery, P. Adaptive Communication: Languages with More Non-Native Speakers Tend to Have Fewer Word Forms. PLoS ONE 2015, 10, e0128254. [CrossRef]
  27. Kalimeri, M.; Constantoudis, V.; Papadimitriou, C.; Karamanos, K.; Diakonos, F.K.; Papageorgiou, H. Word-length Entropies and Correlations of Natural Language Written Texts. J. Quant. Linguist. 2015, 22, 101-118. [CrossRef]
  28. Ehret, K.; Szmrecsanyi, B. An Information-Theoretic Approach to Assess Linguistic Complexity. In Complexity, Isolation, and Variation; Baechler, R., Seiler, G., Eds.; De Gruyter: Berlin, Germany, 2016; pp. 71-94. [CrossRef]
  29. Hernández-Gómez, C.; Basurto-Flores, R.; Obregón-Quintana, B.; Guzmán-Vargas, L. Evaluating the Irregularity of Natural Languages. Entropy 2017, 19, 521. [CrossRef]
  30. Bentz, C.; Alikaniotis, D.; Cysouw, M.; Ferrer-i Cancho, R. The Entropy of Words-Learnability and Expressivity across More than 1000 Languages. Entropy 2017, 19. [CrossRef]
  31. Febres, G.; Jaffe, K. Quantifying Structure Differences in Literature Using Symbolic Diversity and Entropy Criteria. J. Quant. Linguist. 2017, 24, 16-53. [CrossRef]
  32. Chang, M.C.; Yang, A.C.C.; Stanley, H.E.; Peng, C.K. Measuring Information-Based Energy and Temperature of Literary Texts. Phys. A Stat. Mech. Appl. 2017, 468, 783-789. [CrossRef]
  33. Dro żd ż, S.; Oświe ¸cimka, P.; Kulig, A.; Kwapie ń, J.; Bazarnik, K.; Grabska-Gradzi ńska, I.; Rybicki, J.; Stanuszek, M. Quantifying Origin and Character of Long-Range Correlations in Narrative Texts. Inf. Sci. 2016, 331, 32-44. [CrossRef]
  34. Zipf, G.K. Human Behavior and the Principle of Least Effort; Addison-Wesley Press: Cambridge, MA, USA, 1949.
  35. Ferrer i Cancho, R.; Solé, R. Least Effort and the Origins of Scaling in Human Language. Proc. Natl. Acad. Sci. USA 2003, 100, 788-791. [CrossRef] [PubMed]
  36. Gold, B.P.; Pearce, M.T.; Mas-Herrero, E.; Dagher, A.; Zatorre, R.J. Predictability and Uncertainty in the Pleasure of Music: A Reward for Learning? J. Neurosci. 2019, 39, 9397-9409. [CrossRef] [PubMed]
  37. Koelsch, S.; Vuust, P.; Friston, K. Predictive Processes and the Peculiar Case of Music. Trends Cogn. Sci. 2019, 23, 63-77. [CrossRef] [PubMed]
  38. Guillory, J. Canonical and Non-canonical: A Critique of the Current Debate. ELH 1987, 54, 452-483. [CrossRef]
  39. Even-Zohar, I. Polysystem Studies. Poet. Today 1990, 11, 9-26. [CrossRef]
  40. Underwood, T.; Sellers, J. The Long Durée of Literary Prestige. Mod. Lang. Q. 2016, 77, 321-344. [CrossRef]
  41. Gerlach, M.; Font-Clos, F. A Standardized Project Gutenberg Corpus for Statistical Analysis of Natural Language and Quantitative Linguistics. Entropy 2020, 22, 126. [CrossRef]
  42. Green, C. Introducing the Corpus of the Canon of Western Literature: A Corpus for Culturomics and Stylistics. Lang. Lit. 2017, 26, 282-299. [CrossRef]
  43. Bloom, H. The Western Canon: The Books and School of the Ages; Harcourt: New York, NY, USA, 1994.
  44. Reagan, A.J.; Mitchell, L.; Kiley, D.; Danforth, C.M.; Dodds, P.S. The Emotional Arcs of Stories Are Dominated by Six Basic Shapes. EPJ Data Sci. 2016, 5, 31. [CrossRef]
  45. Qi, P.; Zhang, Y.; Zhang, Y.; Bolton, J.; Manning, C.D. Stanza: A Python Natural Language Processing Toolkit for Many Human Languages. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics: System Demonstrations; Association for Computational Linguistics: Stroudsburg, PA, USA, 2020; pp. 101-108. [CrossRef]
  46. Smith, C. Modes of Discourse. The Local Structure of Texts; Cambridge University Press: Cambridge, UK, 2003.
  47. Eisen, M.; Ribeiro, A.; Segarra, S.; Egan, G. Stylometric analysis of Early Modern period English plays. Digit. Scholarsh. Humanit. 2017, 33, 500-528. [CrossRef]
  48. Segarra, S.; Eisen, M.; Ribeiro, A. Authorship Attribution Through Function Word Adjacency Networks. IEEE Trans. Signal Process. 2015, 63, 5464-5478. [CrossRef]
  49. Brown, P.; Eisen, M.; Segarra, S.; Ribeiro, A.; Egan, G. How the Word Adjacency Network Algorithm Works. Digit. Scholarsh. Humanit. 2021. [CrossRef]
  50. Pincus, S.M. Approximate Entropy as a Measure of System Complexity. Proc. Natl. Acad. Sci. USA 1991, 88, 2297-2301. [CrossRef]
  51. Li, X.; Cui, S.; Voss, L. Using Permutation Entropy to Measure the Electroencephalographic Effects of Sevoflurane. Anesthesiology 2008, 109, 448-456. [CrossRef]
  52. Hayashi, K.; Shigemi, K.; Sawa, T. Neonatal Electroencephalography Shows Low Sensitivity to Anesthesia. Neurosci. Lett. 2012, 517, 87-91. [CrossRef]
  53. Lee, G.; Fattinger, S.; Mouthon, A.L.; Noirhomme, Q.; Huber, R. Electroencephalogram Approximate Entropy Influenced by Both Age and Sleep. Front. Neuroinformatics 2013, 7, 33. [CrossRef]
  54. Richman, J.; Moorman, J. Physiological Time-Series Analysis Using Approximate Entropy and Sample Entropy. Am. J. Physiol. Heart Circ. Physiol. 2000, 278, H2039-H2049. [CrossRef]
  55. Costa, M.; Goldberger, A.L.; Peng, C.K. Multiscale Entropy Analysis of Biological Signals. Phys. Rev. E 2005, 71, 021906. [CrossRef]
  56. Ahmed, M.; Mandic, D. Multivariate Multiscale Entropy: A Tool for Complexity Analysis of Multichannel Data. Phys. Rev. Stat. Nonlinear Soft Matter Phys. 2011, 84, 061918. [CrossRef]
  57. Makowski, D.; Pham, T.; Lau, Z.J.; Brammer, J.C.; Lespinasse, F.; Pham, H.; Schölzel, C.; Chen, S.H.A. NeuroKit2: A Python Toolbox for Neurophysiological Signal Processing. Behav. Res. Methods 2021, 53, 1689-1696. [CrossRef]
  58. Zar, J.H. Biostatistical Analysis, 5 ed.; Pearson: Upper Saddle River, NJ, USA, 2010.
  59. Dietterich, T.G. Approximate Statistical Tests for Comparing Supervised Classification Learning Algorithms. Neural Comput. 1998, 10, 1895-1923. [CrossRef]
  60. van Cranenburgh, A.; Ketzan, E. Stylometric Literariness Classification: The Case of Stephen King. In Proceedings of the 5th Joint SIGHUM Workshop on Computational Linguistics for Cultural Heritage, Social Sciences, Humanities and Literature; Association for Computational Linguistics: Stroudsburg, PA, USA, 2021; pp. 189-197.
  61. Menzerath, P.; de Oleza, J. Spanische Lautdauer. Eine experimentelle Untersuchung; de Gruyter: Berlin, Germany, 1928.
  62. Menzerath, P. Die Architektonik des deutschen Wortschatzes; Dümmler: Bonn, Germany, 1954.
  63. Altmann, G. Prolegomena to Menzerath's law. Glottometrika 1980, 2, 1-10.
  64. Semple, S.; i Cancho, R.F.; Gustison, M.L. Linguistic laws in biology. Trends Ecol. Evol. 2020, 37, 53-66. [CrossRef]
  65. Sellis, D. menzerath: Explore Data Following The Menzerath-Altmann Law. R Package Version 0.1.2. 2022. Available online: http://cran.r-project.org/web/packages/mvnfast/vignettes/mvnfast.html (accessed on 8 February 2022).
  66. Cortez, P.; Embrechts, M.J. Using Sensitivity Analysis and Visualization Techniques to Open Black Box Data Mining Models. Inf. Sci. 2013, 225, 1-17. [CrossRef]
  67. Blei, D.M.; Ng, A.Y.; Jordan, M.I. Latent Dirichlet Allocation. J. Mach. Learn. Res. 2003, 3, 993-1022.
  68. Kernot, D. Can Three Pronouns Discriminate Identity in Writing? In Data and Decision Sciences in Action; Springer: Cham, Switzerland, 2018; pp. 397-411. [CrossRef]
  69. Yu, B. An Evaluation of Text Classification Methods for Literary Study. Lit. Linguist. Comput. 2008, 23, 327-343. [CrossRef]
  70. Qureshi, M.R.; Ranjan, S.; Rajkumar, R.; Shah, K. A Simple Approach to Classify Fictional and Non-Fictional Genres. In Proceedings of the Second Workshop on Storytelling; Association for Computational Linguistics: Florence, Italy, 2019; pp. 81-89.
  71. Grebenkina, M.; Brachmann, A.; Bertamini, M.; Kaduhm, A.; Redies, C. Edge-Orientation Entropy Predicts Preference for Diverse Types of Man-Made Images. Front. Neurosci. 2018, 12, 678. [CrossRef]
  72. Stanischewski, S.; Altmann, C.S.; Brachmann, A.; Redies, C. Aesthetic Perception of Line Patterns: Effect of Edge-Orientation Entropy and Curvilinear Shape. i-Perception 2020, 11. [CrossRef] [PubMed]
  73. Kraus, N. The Joyful Reduction of Uncertainty: Music Perception as a Window to Predictive Neuronal Processing. J. Neurosci. 2020, 40, 2790-2792. [CrossRef]
  74. Salimpoor, V.N.; Zald, D.H.; Zatorre, R.J.; Dagher, A.; McIntosh, A.R. Predictions and the Brain: How Musical Sounds Become Rewarding. Trends Cogn. Sci. 2015, 19, 86-91. [CrossRef] [PubMed]

Related papers

Entropy and Divergence in a Modern Fiction Corpus
Hugh Craig

2010

The application of statistical methods to style is now well accepted in author attribution. It has found less favour in broader stylistic description. Louis Milic’s pioneering quantitative work from the 1960s on the style of Jonathan Swift was vigorously contested by Stanley Fish, an attack which may well have had the effect of curbing enthusiasm for this kind of work. The other important exemplar is John Burrows’ book on Jane Austen from 1987. I am not aware of any subsequent books of this kind.

View PDFchevron_right
Comparative Analysis of Preference in Contemporary and Earlier Texts Using Entropy Measures
Volker Gast

Entropy

Research in computational textual aesthetics has shown that there are textual correlates of preference in prose texts. The present study investigates whether textual correlates of preference vary across different time periods (contemporary texts versus texts from the 19th and early 20th centuries). Preference is operationalized in different ways for the two periods, in terms of canonization for the earlier texts, and through sales figures for the contemporary texts. As potential textual correlates of preference, we measure degrees of (un)predictability in the distributions of two types of low-level observables, parts of speech and sentence length. Specifically, we calculate two entropy measures, Shannon Entropy as a global measure of unpredictability, and Approximate Entropy as a local measure of surprise (unpredictability in a specific context). Preferred texts from both periods (contemporary bestsellers and canonical earlier texts) are characterized by higher degrees of unpredicta...

View PDFchevron_right
ENTROPY ANALYSIS OF WORD-LENGTH SERIES OF NATURAL LANGUAGE TEXTS: EFFECTS OF TEXT LANGUAGE AND GENRE
Vassilios Constantoudis

International Journal of Bifurcation and Chaos, 2012

We estimate the n-gram entropies of natural language texts in word-length representation and find that these are sensitive to text language and genre. We attribute this sensitivity to changes in the probability distribution of the lengths of single words and emphasize the crucial role of the uniformity of probabilities of having words with length between five and ten. Furthermore, comparison with the entropies of shuffled data reveals the impact of word length correlations on the estimated n-gram entropies.

View PDFchevron_right
Comparative Computational Analysis of Global Structure in Canonical, Non-Canonical and Non-Literary Texts
Volker Gast

ArXiv, 2020

This study investigates global properties of literary and non-literary texts. Within the literary texts, a distinction is made between canonical and non-canonical works. The central hypothesis of the study is that the three text types (non-literary, literary/canonical and literary/non-canonical) exhibit systematic differences with respect to structural design features as correlates of aesthetic responses in readers. To investigate these differences, we compiled a corpus containing texts of the three categories of interest, the Jena Textual Aesthetics Corpus. Two aspects of global structure are investigated, variability and self-similar (fractal) patterns, which reflect long-range correlations along texts. We use four types of basic observations, (i) the frequency of POS-tags per sentence, (ii) sentence length, (iii) lexical diversity in chunks of text, and (iv) the distribution of topic probabilities in chunks of texts. These basic observations are grouped into two more general cate...

View PDFchevron_right
Entropy analysis of natural language written texts
Vassilios Constantoudis

Physica A: Statistical Mechanics and its Applications, 2010

The aim of the present work is to investigate the relative contribution of ordered and stochastic components in natural written texts and examine the influence of text category and language on these. To this end, a binary representation of written texts and the generated symbolic sequences are examined by the standard block entropy analysis and the Shannon and Kolmogorov entropies are obtained. It is found that both entropies are sensitive to both language and text category with the text category sensitivity to follow almost the same trends in both languages (English and Greek) considered. The values of these entropies are compared with those of stochastically generated symbolic sequences and the nature of correlations present in this representation of real written texts is identified.

View PDFchevron_right

Related topics

  • Mathematics
  • Computer Science
  • Medicine

    • Cited by

    Comparative Analysis of Preference in Contemporary and Earlier Texts Using Entropy Measures
    Volker Gast

    Entropy

    Research in computational textual aesthetics has shown that there are textual correlates of preference in prose texts. The present study investigates whether textual correlates of preference vary across different time periods (contemporary texts versus texts from the 19th and early 20th centuries). Preference is operationalized in different ways for the two periods, in terms of canonization for the earlier texts, and through sales figures for the contemporary texts. As potential textual correlates of preference, we measure degrees of (un)predictability in the distributions of two types of low-level observables, parts of speech and sentence length. Specifically, we calculate two entropy measures, Shannon Entropy as a global measure of unpredictability, and Approximate Entropy as a local measure of surprise (unpredictability in a specific context). Preferred texts from both periods (contemporary bestsellers and canonical earlier texts) are characterized by higher degrees of unpredicta...

    View PDFchevron_right
    580 California St., Suite 400
    San Francisco, CA, 94104
    © 2025 Academia. All rights reserved