Skip to content Skip to navigation
University of Warwick
  • Study
  • |
  • Research
  • |
  • Business
  • |
  • Alumni
  • |
  • News
  • |
  • About

University of Warwick
Publications service & WRAP

Highlight your research

  • WRAP
    • Home
    • Search WRAP
    • Browse by Warwick Author
    • Browse WRAP by Year
    • Browse WRAP by Subject
    • Browse WRAP by Department
    • Browse WRAP by Funder
    • Browse Theses by Department
  • Publications Service
    • Home
    • Search Publications Service
    • Browse by Warwick Author
    • Browse Publications service by Year
    • Browse Publications service by Subject
    • Browse Publications service by Department
    • Browse Publications service by Funder
  • Help & Advice
University of Warwick

The Library

  • Login
  • Admin

Shannon entropy as a robust estimator of Zipf's Law in animal vocal communication repertoires

Tools
- Tools
+ Tools

Kershenbaum, Arik, Demartsev, Vlad, Gammon, David E., Geffen, Eli, Gustison, Morgan L., Ilany, Amiyaal and Lameira, Adriano R. (2021) Shannon entropy as a robust estimator of Zipf's Law in animal vocal communication repertoires. Methods in Ecology and Evolution, 12 (3). pp. 553-564. doi:10.1111/2041-210X.13536 ISSN 2041-210X.

[img]
Preview
PDF
WRAP-Shannon-entropy-robust-estimator-Zipfs-Law-animal-Lameira-2020.pdf - Accepted Version - Requires a PDF viewer.

Download (1917Kb) | Preview
Official URL: http://dx.doi.org/10.1111/2041-210X.13536

Request Changes to record.

Abstract

1.Information complexity in animals is an indicator of advanced communication and an intricate socio‐ecology. Zipf's Law of least effort has been used to assess the potential information content of animal repertoires, including whether or not a particular animal communication could be ‘language‐like’. As all human languages follow Zipf's law, with a power law coefficient (PLC) close to −1, animal signals with similar probability distributions are postulated to possess similar information characteristics to language. However, estimation of the PLC from limited empirical datasets (e.g. most animal communication studies) is problematic because of biases from small sample sizes.
2.The traditional approach to estimating Zipf's law PLC is to find the slope of a log–log rank‐frequency plot. Our alternative option uses the underlying equivalence between Shannon entropy (i.e. whether successive elements of a sequence are unpredictable, or repetitive) and PLC. Here, we test whether an entropy approach yields more robust estimates of Zipf's law PLC than the traditional approach.
3.We examined the efficacy of the entropy approach in two ways. First, we estimated the PLC from synthetic datasets generated with a priori known power law probability distributions. This revealed that the estimated PLC using the traditional method is particularly inaccurate for highly stereotyped sequences, even at modest repertoire sizes. Estimation via Shannon entropy is accurate with modest sample sizes even for repertoires with thousands of distinct elements. Second, we applied these approaches to empirical data taken from 11 animal species. Shannon entropy produced a more robust estimate of PLC with lower variance than the traditional method, even when the true PLC is unknown. Our approach for the first time reveals Zipf's law operating in the vocal systems of multiple lineages: songbirds, hyraxes and cetaceans.
4.As different methods of estimating the PLC can lead to misleading results in real data, estimating the balance of a communication system between simplicity and complexity is best performed using the entropy approach. This provides a more robust way to investigate the evolutionary constraints and processes that have acted on animal communication systems, and the parallels between these processes and the evolution of language.

Item Type: Journal Article
Subjects: Q Science > QL Zoology
Divisions: Faculty of Science, Engineering and Medicine > Science > Psychology
Library of Congress Subject Headings (LCSH): Animal communication, Animal behavior, Social behavior in animals, Information theory in biology, Zipf's law, Entropy (Information theory)
Journal or Publication Title: Methods in Ecology and Evolution
Publisher: Wiley-Blackwell Publishing Ltd.
ISSN: 2041-210X
Official Date: March 2021
Dates:
DateEvent
March 2021Published
1 December 2020Available
11 November 2020Accepted
Volume: 12
Number: 3
Page Range: pp. 553-564
DOI: 10.1111/2041-210X.13536
Status: Peer Reviewed
Publication Status: Published
Reuse Statement (publisher, data, author rights): "This is the peer reviewed version of the following article: Kershenbaum, Arik, Demartsev, Vlad, Gammon, David E., Geffen, Eli, Gustison, Morgan L., Ilany, Amiyaal and Lameira, Adriano R. (2021) Shannon entropy as a robust estimator of Zipf's Law in animal vocal communication repertoires. Methods in Ecology and Evolution, which has been published in final form at http://dx.doi.org/10.1111/2041-210X.13536. This article may be used for non-commercial purposes in accordance with Wiley Terms and Conditions for Use of Self-Archived Versions."
Access rights to Published version: Open Access (Creative Commons)
Date of first compliant deposit: 17 December 2020
Date of first compliant Open Access: 1 December 2021

Request changes or add full text files to a record

Repository staff actions (login required)

View Item View Item

Downloads

Downloads per month over past year

View more statistics

twitter

Email us: wrap@warwick.ac.uk
Contact Details
About Us