Skip to main content

ORIGINAL RESEARCH article

Front. Vet. Sci.
Sec. Animal Behavior and Welfare
Volume 11 - 2024 | doi: 10.3389/fvets.2024.1442634

Automated Landmark-Based Cat Facial Analysis and its Applications

Provisionally accepted
  • 1 University of Haifa, Haifa, Israel
  • 2 Ariel University, Ariel, Israel
  • 3 Small Animal Clinic, University of Veterinary Medicine Hanover Foundation, Hannover, Germany
  • 4 Cats Protection (United Kingdom), London, United Kingdom
  • 5 São Paulo State University, São Paulo, São Paulo, Brazil
  • 6 University of Lincoln, Lincoln, England, United Kingdom

The final, formatted version of the article will be published soon.

    Facial landmarks, widely studied in human affective computing, are beginning to gain interest in the animal domain. Specifically, landmark-based geometric morphometric methods have been used to objectively assess facial expressions in cats, focusing on pain recognition and the impact of breed-specific morphology on facial signaling. These methods employed a 48-landmark scheme grounded in cat facial anatomy. Manually annotating these landmarks, however, is a labor-intensive process, deeming it impractical for generating sufficiently large amounts of data for machine learning purposes and for use in applied real-time contexts with cats. Our previous work introduced an AI pipeline for automated landmark detection, which showed good performance in standard machine learning metrics. Nonetheless, the effectiveness of fully automated, end-to-end landmark-based systems for practical cat facial analysis tasks remained underexplored. In this paper we develop AI pipelines for three benchmark tasks using two previously collected datasets of cat faces. The tasks include automated cat breed recognition, cephalic type recognition and pain recognition. Our fully automated end-to-end pipelines reached accuracy of 75% and 66% in cephalic type and pain recognition respectively, suggesting that landmark-based approaches hold promise for automated pain assessment and morphological explorations.

    Keywords: Artificial inteligence, Facial landmark, cat behavior, cat morphology, pain assessment

    Received: 02 Jun 2024; Accepted: 11 Nov 2024.

    Copyright: © 2024 Martvel, Lazebnik, Feighelstein, Meller, Shimshoni, Finka, Luna, Mills, Volk and Zamansky. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

    * Correspondence: Anna Zamansky, University of Haifa, Haifa, Israel

    Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.