Skip to main content
Animal Frontiers: The Review Magazine of Animal Agriculture logoLink to Animal Frontiers: The Review Magazine of Animal Agriculture
. 2026 Jan 9;16(2):51–62. doi: 10.1093/af/vfaf060

Toward smart health monitoring: multimodal sensing and intelligent disease diagnosis in poultry and livestock

Juncheng Ma 1,2, Xiao Yang 3,4, Yu Liu 5,6, Peiguang Xin 7,8, Qin Tong 9,10, Chao Liang 11,12, Ligen Yu 13, Aiqiao Liu 14, Chaoyuan Wang 15,16,✉
PMCID: PMC13171237  PMID: 42137891

Implications.

  • Multimodal sensing provides valuable data and knowledge for intelligent disease diagnosis.

  • Intelligent disease diagnosis is evolving from text-based understanding toward multimodal fusion and knowledge-driven reasoning.

  • Future efforts should prioritize devices for definite disease diagnosis and diagnostic frameworks integrating prescription generation for intelligent decision support.

Introduction

Health management of livestock and poultry production is critical for ensuring food safety, animal welfare, and production sustainability. Farm scales expanded rapidly in China over the last two decades. For example, the capacity of a single laying hen house increased from thousands to hundreds of thousands. Large-scale farm typically refers to an annual slaughtered volume of >100,000 birds or >50,000 pigs. As such, the prevention and control of animal diseases have become increasingly complex. For instance, African Swine Fever (ASF), which can have a mortality rate of up to 100%, exemplifies the devastating impact of animal epidemics. The largest ASF outbreak in China in 2018 led to the death of 43.46 million pigs, causing an estimated US$14.5 billion in indirect economic losses (You et al., 2021). However, many poultry and livestock farms often suffer from limited diagnostic infrastructures and professional expertise. Veterinarians are usually responsible for multiple farms, which may increase the risk of cross-infection and substantial economic loss. In addition, the shortage of licensed veterinarians further increases the difficulty of timely health management (Yang et al., 2025). Recent advances in artificial intelligence (AI) and smart sensing offer promising solutions and enable automated health monitoring and intelligent diagnostic systems, which marks a crucial step toward the digital transformation of livestock health management.

The evolution of intelligent disease diagnosis has progressed through three milestones, ie, the Database Matching System (DMS), the Expert System (ES), and the Large Language Model (LLM). The DMS, originating in the 1960s, marked the beginning of intelligent diagnosis. It functions by calculating similarity scores through keyword matching and weighted symptom scoring to suggest suspected diseases. While effective for common, well-documented diseases, the DMS accuracy declines in cases involving atypical symptoms, co-infections, or emerging diseases (Houe et al., 2011). Today, database-driven systems are incorporated into cloud-based diagnostic platforms and veterinary knowledge graphs, continuing to serve as useful tools for rapid, simple, and low-cost screening on small- and medium-scale farms. Building upon the DMS, the ES are developed to emulate specialists' reasoning processes through if-then rules. The MYCIN system, introduced by Stanford University in the 1970s for diagnosing human infectious diseases, exemplified this approach (Saeidnia and Nilashi, 2025). In animal management, for example, the ES has been used to diagnose diseases such as blue ear in pigs, Newcastle disease in poultry, respiratory disease in dairy cattle. While these systems provide interpretable reasoning chains, they lack self-learning capability and adaptability, making them less effective for complex or uncertain scenarios. By the 2020s, the field has transitioned from rule-based reasoning to data-driven learning. The advent of LLMs such as Generative Pre-trained Transformer (GPT) and Pathways Language Model (PaLM) leverages massive datasets and deep learning architectures to autonomously acquire knowledge and detect subtle correlations across modalities (Jin et al., 2025). Although LLMs exhibited broad coverage and strong cross-domain integration ability, their “black-box” nature limits interpretability and complicates the validation of knowledge sources.

Effective intelligent diagnosis in poultry and livestock health relies fundamentally on the reliability of sensed data. Traditional approaches have often relied on single-modality data due to its simplicity, cost-effectiveness, and ease of deployment. While these approaches can provide meaningful insights under controlled conditions, and form the basis of early database matching and expert system-based diagnostics, they suffer from limitations in robustness and accuracy due to environmental interference, noise, or biological variability. For instance, infrared thermal imaging may misinterpret surface heat changes caused by airflow as fever, and RGB cameras may struggle to estimate body weight under poor lighting or occlusion (Liu et al., 2023).

To overcome these constraints, recent research emphasizes multimodal sensing as a powerful approach by integrating heterogeneous data sources. The advantages of multimodal sensing over single-modality approaches are threefold. First, redundancy increases resilience, allowing one modality to compensate when another is compromised. Second, complementarity allows each sensor to contribute unique insights to the same health indicator. Third, robustness is achieved through integrating multiple data streams, enabling diagnostic models to generalize across varying farm environments and animal populations.

Therefore, this review will focus on the applications of multimodal fusion in health information perception of farm animals, summarizing recent achievements in physiological condition assessment, behavior recognition and abnormal sound analysis. Afterwards, multimodal fusion-based technologies of diagnosis models will be introduced (Figure 1). Finally, the challenges and limitations of intelligent diagnosis of livestock and poultry, along with future perspectives, will be discussed to provide insights into the revolution of farm animal health management.

Figure 1.

For image description, please refer to the figure legend and surrounding text.

Multimodal sensing and intelligent disease diagnosis in poultry and livestock. The deep-learning based disease diagnosis model was adapted from Yang (2025). LLM donated Large Language Model.

Multimodal Sensing for Animal Health Monitoring

General pipelines of multimodal fusion

Multimodal sensing enhances animal health monitoring by automatic physiological condition assessment, behavior recognition and abnormal sound analysis. As sensors become increasingly common in livestock and poultry farms, multiple data modalities can be collected simultaneously. Typically, information contained in different data modalities varies and is specific to particular scenarios. However, in farm environments, the application scenario may pose challenges due to many factors, such as changing illumination, background noise, and limited image resolutions, making it unreliable to rely on a single data modality for decision-making (Yin et al., 2023; Ma et al., 2025). Multi-modality fusion integrates multiple sources of data, such as environmental factors, images, and audio, providing a more comprehensive understanding of the environment in livestock and poultry farms compared with a single data modality and enabling more accurate results in challenging farming environments (Kalamkar, 2023; Tang et al., 2023). Therefore, it is necessary to employ multimodal fusion to enhance the animal health monitoring and disease diagnosis. According to the fusion level, the deep learning-based multimodal data fusion can be divided into data-level fusion, feature-level fusion, and decision-level fusion (Tang et al., 2023), as shown in Figure 2.

Figure 2.

For image description, please refer to the figure legend and surrounding text.

Multimodal fusion framework, taking RGB-D fusion as an example (Fu et al., 2022). (a) Early-fusion. (b) Late-fusion. (c) Middle-fusion. CNN donated Convolutional Neural Network, and Concat donated concatenate‌.

Image-based multimodal sensing

Among the sensors used in livestock and poultry farms, cameras are one of the most widely used devices significantly contributing to the non-contact perception and visible ­livestock management by computer vision (Li et al., 2022a). Generally, image modalities used in computer vision for livestock ­management include Red-Green-Blue (RGB), depth (Figure 3), and thermal (Figure 4) images. Given the low cost and high accessibility, RGB images are one of the most common image modalities, offering rich color and texture information with a high spatial resolution (Ma et al., 2023). As a result, RGB images are widely adopted in various applications in livestock and poultry farms. Nevertheless, the long-existing challenges inherent in complicated farming conditions, such as changing illumination and clutter backgrounds (Lamping et al., 2022; Li et al., 2022a), need to be addressed before the RGB image-based methods can achieve improved performance (Liu et al., 2022).

Figure 3.

For image description, please refer to the figure legend and surrounding text.

Paired RGB (left) and Depth (right) images (He et al., 2023). A Microsoft Azure Kinect DK camera was adopted to simultaneously collect the paired RGB-D images. The camera was horizontal to the ground at a height of 2.3 m above the feeding passageway.

Figure 4.

For image description, please refer to the figure legend and surrounding text.

Paired thermal (top) and RGB (bottom) images of six different regions on pig body surface (Xie et al., 2023). A: forehead, eyes, and nose. B: ear root, and back. C: anus. The thermal and visible light images could be obtained at the same time by using an infrared thermal imaging camera.

Recent advancements in imaging technology and hardware have made depth images readily available through consumer-level RGB-D cameras, effectively complementing the RGB images. In a depth image, each pixel represents the distance from the camera to the corresponding object, which favors the 3D reconstruction of animals (Li et al., 2022b). Furthermore, depth images provide shape information, which helps extract animal objects from clutter backgrounds (Xu et al., 2022). In most cases, depth images are combined with RGB images since RGB images can remedy the defects of coarse resolution and details (Liu et al., 2022; He et al., 2023). Typically, RGB images have high spatial resolution along with rich color and texture information (Ma et al., 2023), whereas they are highly susceptible to illumination variations and lack structure information (Liu et al., 2022; Xu et al., 2022). In contrast, depth images are robust to illumination changes and provide substantial shape and 3D structure details (Xu et al., 2022; He et al., 2023), while they lack fine object details (Liu et al., 2022; He et al., 2023). The RGB-D fusion leverages the complementary strengths of both modalities, enabling a more comprehensive understanding of animal health and improving the estimation of physiological traits, such as pig body weight (He et al., 2023), body size (Li et al., 2022b), posture (Xu et al., 2023) and appearance (Lamping et al., 2022).

Thermal images can also serve as a complementary modality, especially under low illumination and complex background conditions due to the robustness against lighting variations (Wu et al., 2023). Thermal images measure the animal surface temperature (Cai et al., 2023; Xie et al., 2023), which is a key indicator of animal health and welfare (Cai et al., 2023). Consequently, thermal images are widely used in livestock and poultry farms to detect animal temperature and diseases (Xie et al., 2023). Additionally, thermal images can also aid in extracting animals from clutter backgrounds, as animals typically have higher temperatures than objects in the backgrounds (Zhong and Yang, 2022). Although thermal images have shown great potential in livestock and poultry farms, the high cost of the thermal infrared camera significantly hinders their use. Besides, image alignment is also required for fusion between RGB and thermal images. Notably, in applications where thermal images are used to measure animal surface temperatures, the accuracy may be influenced by the ambient temperature and humidity, measuring distance and angle, and emissivity of measuring parts (Xie et al., 2023).

Audio-based multimodal sensing

In addition to camera, acoustic sensors offer a valuable means of linking animal vocalizations to health, welfare, and environmental impact (Ma et al., 2025). In livestock and poultry farms, acoustic technologies have been developed to detect a multitude of traits and behaviors, such as coughing (Shen et al., 2022; Ma et al., 2025), body weight (Fontana et al., 2017), diseases (Cuan et al., 2020), and feeding behavior (Liao et al., 2022). Given the complicated acoustic environment in livestock and poultry farms (Shen et al., 2022; Ma et al., 2025), the sensing models relying solely on acoustic features may not achieve satisfactory accuracy. Instead, fusing the acoustic features with other powerful features can improve the detection accuracy (Shen et al., 2022; Ma et al., 2025), as shown in Figure 5. Although promising results have been reported (Shen et al., 2022; Ma et al., 2025), it is worth noting that the features mentioned above are derived from the same data as the acoustic features. Therefore, the fusion of acoustic data and other data modalities is yet to be explored.

Figure 5.

For image description, please refer to the figure legend and surrounding text.

Structure of the multimodal pig audio representation and fusion framework (Ma et al., 2025). A was a given audio clip, A1 and A2 were two randomly cropped segments, A2′ was the spectral representation of A2. z1 and p1 were the output of A1, z2 and p2 were the output of A2′, Stop grad indicated the stop gradient operation and MLP donated multilayer perceptron.

Intelligent Disease Diagnosis in Poultry and Livestock

Deep learning-based intelligent disease diagnosis

Traditional diagnostic methods relying on manual observation and laboratory testing often suffer from low efficiency, high costs, and limited accuracy. With the advancement in natural language processing, computer vision, audio signal analysis, and knowledge graph, researchers (Hoang et al., 2023; Mustapoevich et al., 2023; Wang et al., 2024; Yu et al., 2024; Li et al., 2025) have developed intelligent diagnostic models that integrate multimodal and knowledge-driven approaches to improve accuracy, interpretability, and responding speed.

Text-based intelligent diagnosis models form the foundation of this field. Yu et al. (2024) developed a Bidirectional encoder representation from transformers-Bidirectional long short-term memory network-Conditional random field (BERT-BiLSTM-CRF) model that effectively handled sparse domain texts with an F1 Score (a widely used performance metric in machine learning) of 96.38%. Wang et al. (2024) integrated BERT semantic vectors with knowledge embeddings to analyze 11,401 laying-hen cases, significantly improving diagnostic accuracy in complex textual contexts. Similar knowledge-driven text learning methods have also shown robustness in scenes where the number of training samples was limited (Wang et al., 2023). Although these models offer strong semantic comprehension, they are still limited by issues such as data imbalance, text ambiguity, and poor generalization (Yang et al., 2025).

To overcome the limitations of unimodal diagnosis model, multimodal diagnosis models that integrate linguistic and visual information provide a feasible solution. Li et al. (2025) designed an RGB-guided depth-image restoration network for dairy-cow monitoring, enhancing image completeness and data quality. Yang et al. (2025) developed a multimodal swine disease model that integrates CNN and BERT through cross-modal attention, improving Area Under Curve (AUC) by 6.8%. The Text-guided fusion network for swine diagnosis (TGFN-SD) further advanced this approach by dynamically regulating visual feature extraction through semantic guidance, achieving a macro-F1 score of 94.4%. Although challenges remain in data labeling, multimodal synchronization, and computational cost, these studies demonstrate that integrating image and text data enhances robustness and reduces diagnostic ambiguity.

The inclusion of audio signals, such as respiration, coughing, and vocalization, provides additional information for real-time disease diagnosis. Mustapoevich et al. (2023) applied fuzzy-logic reasoning to cattle diseases, demonstrating the potential of non-visual data in identifying metabolic disorders. Yang (2025) incorporated cough and breathing sounds into a tri-modal model for pigs and used a CNN-Transformer architecture to fuse sound, image, and text features (Figure 6), achieving an AUC of 0.943 in respiratory disease detection. While these models enable early diagnosis, they still require standardized data acquisition and noise-robust preprocessing to ensure reliability.

Figure 6.

For image description, please refer to the figure legend and surrounding text.

Diagnostic model structure of Yang (2025). ViT donated vision Transformer.

Knowledge graph-based models incorporate structured reasoning and domain knowledge into intelligent diagnosis. Wang et al. (2024) proposed the bidirectional encoder representation from transformers-laying hens disease knowledge graph (BERT-LHDKG) model (Figure 7) for laying-hen disease diagnosis. The model integrated knowledge triplets (h, r, t) into BERT’s embedding layers and enhances feature extraction with BiLSTM, achieving a macro-F1 score of 94.01%, and outperforming ERNIE-BiLSTM by 2.19%. Similarly, Hoang et al. (2023) introduced the LiteralKG model, which incorporated attribute-aware embeddings for companion-animal disease reasoning. These frameworks establish explainable links between textual data and biological knowledge, allowing cross-species disease reasoning and improved interpretability.

Figure 7.

For image description, please refer to the figure legend and surrounding text.

Diagnostic model structure of BERT-LHDKG (Wang et al., 2024).

Overall, research progress shows a clear trajectory from text-based understanding toward multimodal fusion and knowledge-enhanced reasoning. Despite significant advances, challenges remain in dataset scale, synchronization across modalities, and noise interference. Building large-scale multimodal datasets and embedding causal reasoning into diagnostic systems will be crucial for achieving interpretable and reliable intelligent diagnosis for livestock and poultry diseases.

LLM-based intelligent disease diagnosis

Recent advances in LLMs such as GPT (Radford et al., 2018) and LLaMA (Touvron et al., 2023) have led to remarkable ­progress in reasoning, contextual understanding, and multimodal integration. As a result, livestock and poultry disease diagnosis is shifting from rule-based systems to data-driven, knowledge-augmented AI frameworks. However, adapting LLMs from general conversational contexts to veterinary and livestock health domains presents significant challenges, including limited domain-specific data, complex symptom overlaps across multiple species, and the need for interpretable and trustworthy predictions.

Early explorations by Coleman and Moore (2024) marked the first attempts to evaluate general large language models (LLMs), such as ChatGPT-3.5 and GPT-4, within a veterinary context. The results showed that GPT-4 achieved a mean accuracy of 77% on veterinary examination questions, outperforming GPT-3.5 (55%), yet still lagging behind veterinary students (86%). This result highlighted a crucial limitation that general LLMs lack the domain precision and contextual reliability required for professional veterinary diagnosis despite their strong linguistic and general reasoning abilities. With the advancement of agent-based technologies, research has shifted from improving individual model reasoning toward developing collaborative, workflow-oriented architectures. Frameworks such as MetaGPT (Hong et al., 2024) exemplify this trend. Following this direction, Mairittha et al. (2025) proposed a multi-agent AI framework for swine disease detection, integrating query classification, disease-specific reasoning, and retrieval-augmented generation (RAG). Dedicated disease agents were engaged in multi-stage questioning, ie, general, external, and specific symptom collection, before reaching a consensus through confidence-weighted decision fusion. This design enables adaptive, multi-turn diagnostic dialogue, simulating virtual veterinary consultations and achieving diagnostic accuracy above 90%. The proposed “confidence-weighted fusion” mechanism marks a shift from single-step inference to dynamic cooperative reasoning, where multiple agents collaborate to generate evidence-based conclusions. Recognizing that many livestock diseases manifest through visual and textual cues, subsequent research emphasized multimodal intelligence. Wen et al. (2025) proposed an intelligent diagnostic framework for porcine gastrointestinal infectious diseases, integrating textual symptom analysis with anatomical image interpretation. The system employed a multi-scale TextCNN for textual features, and an improved Mask R-CNN for lesion segmentation. Then, the model ensembled classifiers such as Random Forest and XGBoost for decision fusion. Remarkably, ChatGPT was leveraged to expand textual datasets sixfold, enriching linguistic variability and improving model generalization. The multimodal fusion achieved an overall accuracy of 87.6%, surpassing both text-only and image-only models. The results demonstrating that cross-modal feature integration combined with LLM-based data augmentation can substantially enhance diagnostic robustness in veterinary applications.

Most recently, research has advanced toward knowledge-grounded and explainable large models. Xiong et al. (2025) developed the SheepDoctor (Figure 8), the first knowledge-graph-enhanced large language model for sheep disease diagnosis. Built upon LLaMA2–13B with LoRA fine-tuning, SheepDoctor integrated a structured veterinary knowledge graph containing over 1,900 triples of disease–symptom–treatment relationships. Each user query was semantically aligned with relevant knowledge triples using BERT-based retrieval before being processed by the LLM, enabling contextualized and evidence-supported responses. The system demonstrated superior performance to general models such as GPT-4o and Kimi, and maintained high generalization when confronted with unseen diseases (F1 = 78.15%). Beyond accuracy, SheepDoctor introduced traceable, interpretable diagnostic reasoning, bridging the gap between statistical generation and symbolic veterinary knowledge.

Figure 8.

For image description, please refer to the figure legend and surrounding text.

The framework of SheepDoctor (Xiong et al., 2025). The current version of the figure was a translation, as the original model answering output of SheepDoctor was in Chinese.

The above studies highlight a clear trend of evolution from general LLM evaluation to domain-specialized, knowledge-augmented intelligence. The field has progressed from single-model inference to multi-agent reasoning, from unimodal to multimodal learning, and toward interpretable, knowledge-grounded frameworks. Collectively, these advances will transform veterinary and livestock health management from text understanding to holistic, multimodal, and knowledge-driven intelligent disease diagnosis.

Challenges and Limitations

Despite remarkable progress, intelligent diagnosis of poultry and livestock diseases still faces several critical challenges (Figure 9). First, the collection and annotation of large-scale, multimodal, and high-quality datasets remain a major bottleneck (Ma et al., 2025). Health-related data often require expert interpretation, which is labor-intensive, time-consuming, and prone to be inconsistent (Esteva et al., 2019; Ma et al., 2025). Abnormal or diseased samples are particularly scarce due to the low incidence of outbreaks and the rapid culling strategies typically adopted in commercial production systems. Moreover, disease records are rarely made publicly available owing to concerns over data privacy and biosecurity, limiting data sharing and model training. Second, high stocking densities are common in modern intensive livestock and poultry production systems, making precise individual health monitoring, such as physiological condition assessment, behavior recognition, and abnormal sound analysis, extremely challenging. Finally, advanced sensing technologies such as infrared imaging, depth cameras can be prohibitively expensive for small- and medium-scale farms, reducing the feasibility of large-scale applications. Besides, the generalization and cross-farm adaptability of the perception and diagnostic models remain challenging. Differences in animal breeds, management systems, and environmental conditions introduce both intra- and inter-species variability, undermining model robustness and transferability (Ma et al., 2025).

Figure 9.

For image description, please refer to the figure legend and surrounding text.

Challenges of intelligent diagnosis of poultry and livestock diseases.

Future Perspectives

The development of cost-efficient and non-invasive sensing technologies is essential for the large-scale deployment of intelligent diagnostic systems. The integration of edge computing and energy-efficient IoT devices can further reduce operational costs while enabling real-time, on-farm diagnostics that are accessible to small- and medium-sized producers. In addition, since many diseases share similar physiological or behavioral manifestations, transforming abnormal and suspected cases into confirmed diagnoses remains a major challenge and a critical milestone for further research. For example, intelligent interpretation of pathological images and the development of rapid pathogen detection devices may help with disease confirmation. Beyond detection, incorporating prescription generation into diagnostic frameworks represents the next step toward intelligent decision support, allowing systems to not only identify diseases but also recommend targeted treatments and management strategies. This evolution will transform smart livestock health management from a reactive to a proactive, autonomous, and precision-oriented paradigm.

Conclusion

Advancements in AI are reshaping poultry and livestock health management. Given the complex farming environments, multimodal sensing, which holds significant advantages of robustness and high accuracy compared with single data modalities, has shown significant potential in animal physiological condition assessment, behavior recognition and abnormal sound analysis, providing valuable data and knowledge for intelligent disease diagnosis. With the collaboration of LLMs and edge intelligence, intelligent disease diagnosis is entering a new era characterized by multimodal fusion and knowledge-enhanced reasoning, enabling real-time monitoring and precision management for animal health. However, data scarcity and cross-farm variability persist, necessitating more robust intelligent diagnosis models. Future efforts should prioritize devices for definite disease diagnosis and diagnostic frameworks integrating prescription generation for intelligent decision support.

Acknowledgments

We wish to acknowledge the National Science and Technology Major Project (2021ZD0113801), National Center of Technology Innovation for Pigs (NCTIP-XD/B16), the Young Scientists Fund of the National Natural Science Foundation of China (32302803), the 2115 Talent Development Program of China Agricultural University and Chinese Universities Scientific Fund (2025RC031), and China Postdoctoral Science Foundation (2023M743791) for the funding support of this research for the funding support of this research. This manuscript was invited for submission by the European Federation of Animal Science. The views expressed in this publication are those of the author(s) and do not necessarily reflect the views or policies of the European Federation of Animal Science, the journal, or the publisher.

Conflict of interest statement. The authors declare no real or perceived conflicts of interest.

Author Biographies

graphic file with name vfaf060ilf1.jpg

Juncheng Ma received a Ph.D. in Agricultural Engineering from China Agricultural University in 2016. He worked as an associate researcher with Chinese Academy of Agricultural Science from 2016 to 2023. Currently, he works as a researcher with College of Water Resources and Civil Engineering, China Agricultural University. He is a recipient of Young Elite Scientists Sponsorship Program by China Association for Science and Technology. He has extensive experience in intelligent perception of multimodal information for livestock and poultry, and intelligent disease diagnosis, developing the intelligent perception approach for behavior and physiological traits in complex farm environments. He has published more than 30 peer-reviewed papers.

graphic file with name vfaf060ilf2.jpg

Xiao Yang is an Assistant Professor in the Department of Agricultural Structure and Bioenvironmental Engineering at the College of Water Resources and Civil Engineering, China Agricultural University. She received her Ph.D. from the Department of Animal Science at University of Tennessee. Her research focuses on the development of precision livestock farming technologies and intelligent systems for modern animal production. Her major research areas include smart sensor–based monitoring of poultry behavior, machine-vision–enabled health assessment, automatic welfare evaluation, and early-warning systems for disease detection. Dr Yang has served as the principal investigator (PI) or co-PI on several competitive research projects, including grants from the National Natural Science Foundation of China, China Postdoctoral Science Foundation, etc. She has published more than 20 peer-reviewed research articles and conference proceedings, and contributed to the editing of four books chapters. She also involved on the development of national and industry standards on livestock production of China. Her work aims to advance data-driven, automated, and sustainable livestock farming by integrating sensing technologies, artificial intelligence, and engineering solutions to improve animal health, welfare, and production efficiency.

graphic file with name vfaf060ilf3.jpg

Liu Yu earned a Ph.D. in agricultural bio-environment and energy engineering from the China Agricultural University in 2022. She once conducted postdoctoral research in agricultural engineering at the Beijing Academy of Agriculture and Forestry Sciences. Since 2024, she has been an associate professor in agricultural bio-environment and building engineering department of China Agricultural University, mainly engaged in research on precision animal husbandry, including livestock health breeding environment and intelligent equipment, air quality and biosecurity engineering for livestock farms, and epidemic prevention measures. She has extensive experience in intelligent diagnosis models and systems for typical livestock and poultry diseases, as well as intelligent epidemic disease early warning. She also contributed to the development and application of innovative pollutant real-time measurement techniques, especially for the odor concentration in livestock and poultry farms.

graphic file with name vfaf060ilf4.jpg

Peiguang Xin is currently a Ph.D. candidate in Agricultural Bio-environment and Energy Engineering at the College of Water Resources and Civil Engineering, China Agricultural University, with long-term research focusing on multimodal intelligent perception and health monitoring of livestock and poultry. The research centers on precision management and early disease warning of growing–finishing pigs. The author has participated in several research projects, including a subproject of the national “Science and Technology Innovation 2030—New Generation Artificial Intelligence” Major Program and a key R&D project of the Ningxia Hui Autonomous Region, taking responsibility for multimodal data acquisition, core algorithm design, and prototype system development. The main research interests include joint weight–posture modeling, intelligent weight estimation under multi-posture conditions, and pen-wise group matching-based individual identification. The author has published one high-level journal paper on livestock and poultry sound detection and has applied for two Chinese invention patents related to group-housed pig weight estimation methods.

graphic file with name vfaf060ilf5.jpg

Qin Tong is an Associate Professor at the Department of Agricultural Buildings and Environmental Engineering, College of Water Resources and Civil Engineering. PhD from the Royal Veterinary College, University of London, and recipient of the Marie Curie Young Researcher Fellowship. Participated in two EU Seventh Framework Program projects. Mainly engaged in teaching and research on precision livestock farming, animal behavior and welfare. Principal investigator of two projects funded by the National Natural Science Foundation, and four subprojects under the National Key R&D Program, including one key project of China-UK AgriTech Challenge. Conducted extensive innovative research in lighting incubation of poultry, inspection and spray immunization robotic equipment in poultry house, and published over 40 research papers.

graphic file with name vfaf060ilf6.jpg

Chao Liang is an Associate Professor at the College of Water Resources and Civil Engineering, China Agricultural University. He is a recipient of the National Postdoctoral Innovative Talent Support Program, and serves as a Council Member of the Animal Husbandry Engineering Branch of the Chinese Society of Agricultural Engineering and a Youth Editorial Board Member of the journal Building Simulation. His long-term research and teaching focus on precision control of livestock and poultry breeding environments, energy conservation and carbon reduction in livestock housing, and smart farming and robotics. Over the past five years, he has led or participated in over 10 research projects, and has published more than 20 academic papers as first or corresponding author in top journals and has applied for/been granted over 10 patents.

graphic file with name vfaf060ilf7.jpg

Ligen Yu earned a Ph.D. in Agricultural Biological Environment and Energy Engineering from the China Agricultural University in 2013. He has worked for the Information Technology Research Center, Beijing Academy of Agriculture and Forestry Sciences, and since 2018 has been an Associate Researcher in the National Engineering Research Center for Agricultural Information Technology. Currently, he serves as the Deputy Director of the Department of Animal Husbandry and Information‌. Ligen Yu has extensive experience in animal audio perception recognition, intelligent disease diagnosis and early warning technology for livestock and poultry. He has also contributed to the development and application of innovative farming technology for animals.

graphic file with name vfaf060ilf8.jpg

Aiqiao Liu earned a postgraduate degree in 2009. She has been deeply engaged in the agriculture and animal husbandry industry for over three decades, consistently focusing on innovation in agricultural science and technology. By leveraging biotechnology to strengthen the industrial foundation, she has led the team in successfully breeding the “Jinghong, Jingfen, and Jingbai” laying hens and the “Wode series” broilers, contributing to a leap forward in China poultry breeding industry. Driving industrial transformation through digital intelligence technology, she pioneered the smart layer “industrial internet platform.” By deeply integrating information technology with biotechnology, she has established a new digital economy ecosystem for the poultry industry, providing comprehensive solutions for its digital and intelligent transformation and promoting high-quality development of the sector.

graphic file with name vfaf060ilf9.jpg

Chaoyuan Wang is a full professor of the Department of Agricultural Structure and Bioenvironmental Engineering, College of Water Resources and Civil Engineering, China Agricultural University. He is currently serving the deputy director of the Key Laboratory of Agricultural Engineering in Structure and Environment, Ministry of Agricultural and Rural Affairs of China, and chairman of the Animal Husbandry Engineering Branch of the Chinese Society of Agricultural Engineering (CSAE). Dr Wang’s research interests include animal housing and environment control, air quality and energy management in animal production, intelligent sensing of animal behavior and physiology, as well as smart diagnostics and early warning systems for animal diseases. He has published over 140 journal articles and 60 conference papers/abstracts, contributed to the editing of 20 books and chapters.

Contributor Information

Juncheng Ma, Department of Agricultural Structure and Bioenvironmental Engineering, College of Water Resources and Civil Engineering, China Agricultural University, Beijing 100083, China; Key Laboratory of Agricultural Engineering in Structure and Environment, Ministry of Agriculture and Rural Affairs, Beijing 100083, China.

Xiao Yang, Department of Agricultural Structure and Bioenvironmental Engineering, College of Water Resources and Civil Engineering, China Agricultural University, Beijing 100083, China; Key Laboratory of Agricultural Engineering in Structure and Environment, Ministry of Agriculture and Rural Affairs, Beijing 100083, China.

Yu Liu, Department of Agricultural Structure and Bioenvironmental Engineering, College of Water Resources and Civil Engineering, China Agricultural University, Beijing 100083, China; Key Laboratory of Agricultural Engineering in Structure and Environment, Ministry of Agriculture and Rural Affairs, Beijing 100083, China.

Peiguang Xin, Department of Agricultural Structure and Bioenvironmental Engineering, College of Water Resources and Civil Engineering, China Agricultural University, Beijing 100083, China; Key Laboratory of Agricultural Engineering in Structure and Environment, Ministry of Agriculture and Rural Affairs, Beijing 100083, China.

Qin Tong, Department of Agricultural Structure and Bioenvironmental Engineering, College of Water Resources and Civil Engineering, China Agricultural University, Beijing 100083, China; Key Laboratory of Agricultural Engineering in Structure and Environment, Ministry of Agriculture and Rural Affairs, Beijing 100083, China.

Chao Liang, Department of Agricultural Structure and Bioenvironmental Engineering, College of Water Resources and Civil Engineering, China Agricultural University, Beijing 100083, China; Key Laboratory of Agricultural Engineering in Structure and Environment, Ministry of Agriculture and Rural Affairs, Beijing 100083, China.

Ligen Yu, Research Center of Information Technology, Beijing Academy of Agriculture and Forestry Sciences, Beijing 100097, China.

Aiqiao Liu, Beijing WOD-Botron Information Technology Co., Ltd, Beijing 101200, China.

Chaoyuan Wang, Department of Agricultural Structure and Bioenvironmental Engineering, College of Water Resources and Civil Engineering, China Agricultural University, Beijing 100083, China; Key Laboratory of Agricultural Engineering in Structure and Environment, Ministry of Agriculture and Rural Affairs, Beijing 100083, China.

Author Contributions

Juncheng Ma (Conceptualization, Visualization, Writing—original draft, Writing—review & editing), Xiao Yang (Conceptualization, Visualization, Writing—original draft), Yu Liu (Conceptualization, Writing—original draft, Writing—review & editing), Peiguang Xin (Conceptualization, Writing—original draft, Writing—review & editing), Qin Tong (Conceptualization), Chao Liang (Conceptualization), Ligen Yu (Conceptualization), Aiqiao Liu (Conceptualization), and Chaoyuan Wang (Conceptualization, Writing—review & editing)

Literature Cited

  1. Cai Z., Cui J., Yuan H., Cheng M.  2023. Application and research progress of infrared thermography in temperature measurement of livestock and poultry animals: a review. Comput. Electron. Agric. 205:107586. doi: 10.1016/j.compag.2022.107586 [DOI] [Google Scholar]
  2. Coleman M.C., Moore J.N.  2024. Two artificial intelligence models underperform on examinations in a veterinary curriculum. J. Am. Vet. Med. Assoc. 262:692–697. doi: 10.2460/javma.23.12.0666 [DOI] [PubMed] [Google Scholar]
  3. Cuan K., Zhang T., Huang J., Fang C., Guan Y.  2020. Detection of avian influenza-infected chickens based on a chicken sound convolutional neural network. Comput. Electron. Agric. 178:105688. doi: 10.1016/j.compag.2020.105688 [DOI] [Google Scholar]
  4. Esteva A., Robicquet A., Ramsundar B., Kuleshov V., DePristo M., Chou K., Cui C., Corrado G., Thrun S., Dean J.  2019. A guide to deep learning in healthcare. Nat. Med. 25(1):24–29. doi: 10.1038/s41591-018-0316-z [DOI] [PubMed] [Google Scholar]
  5. Fontana I., Tullo E., Carpentier L., Berckmans D., Butterworth A., Vranken E., Norton T., Berckmans D., Guarino M.  2017. Sound analysis to model weight of broiler chickens. Poult. Sci. 96(11):3938–3943. doi: 10.3382/ps/pex215 [DOI] [PubMed] [Google Scholar]
  6. Fu K., Fan D.-P., Ji G.-P., Zhao Q., Shen J., Zhu C.  2022. Siamese network for RGB-D salient object detection and beyond. IEEE Trans. Pattern Anal. Mach. Intell. 44:5541–5559. doi: 10.1109/TPAMI.2021.3073689 [DOI] [PubMed] [Google Scholar]
  7. Gan Y.  2025. Research on intelligent diagnosis model for typical swine diseases based on multimodal learning. Dissertation, Tianjin Agricultural University. [Google Scholar]
  8. Yang G., Li Q., Zhao C.  2025. TGFN-SD: a text-guided multimodal fusion network for swine disease diagnosis. Artif. Intell. Agric. 15:266–279. doi:10.1016/j.aiia.2025.03.002 [Google Scholar]
  9. He W., Mi Y., Ding X., Liu G., Li T.  2023. Two-stream cross-attention vision Transformer based on RGB-D images for pig weight estimation. Comput. Electron. Agric. 212:107986. doi: 10.1016/j.compag.2023.107986 [DOI] [Google Scholar]
  10. Hong S., Zhuge M., Chen J., Zheng X., Cheng Y., Zhang C., Wang J., Wang Z., Yau S.K.S., Lin Z.  et al.  2024. MetaGPT: Meta programming for a multi-agent collaborative framework. The Twelfth International Conference on Learning Representations. Vienna, Austria. doi: 10.48550/arXiv.2308.00352 [DOI]
  11. Houe H., Gardner I.A., Nielsen L.R.  2011. Use of information on disease diagnoses from databases for animal health economic, welfare and food safety purposes: strengths and limitations of recordings. Acta Vet. Scand. 53(Suppl 1):S7. doi: 10.1186/1751-0147-53-S1-S7 [DOI] [PMC free article] [PubMed] [Google Scholar]
  12. Jin Y.-G., Wu G., Seo J.-W., Park S.-J., Hur S.-H., Aliyeva D., Park J.-H., Kim K.-M.J.I.A.  2025. AI Veterinary Assistance: Enhancing Clinical Decision-Making in Animal Healthcare. IEEE Access. 13:119292-119304. doi: 10.1109/ACCESS.2025.3587787 [DOI] [Google Scholar]
  13. Kalamkar S., Geetha Mary A.  2023. Multimodal image fusion: a systematic review. Decis. Anal. J. 9:100327. doi: 10.1016/j.dajour.2023.100327 [DOI] [Google Scholar]
  14. Lamping C., Derks M., Groot Koerkamp P., Kootstra G.  2022. ChickenNet—an end-to-end approach for plumage condition assessment of laying hens in commercial farms using computer vision. Comput. Electron. Agric. 194:106695. doi: 10.1016/j.compag.2022.106695 [DOI] [Google Scholar]
  15. Li Y., Dai X., Dai B., Song P., Wang X., Chen X., Li Y., Shen W.  2025. Cow depth image restoration method based on RGB guided network with modulation branch in the cowshed environment. Comput. Electron. Agric. 229:109773. doi: 10.1016/j.compag.2024.109773 [DOI] [Google Scholar]
  16. Li J., Green-Miller A.R., Hu X., Lucic A., Mahesh Mohan M.R., Dilger R.N., Condotta I.C.F.S., Aldridge B., Hart J.M., Ahuja N.  2022a. Barriers to computer vision applications in pig production facilities. Comput. Electron. Agric. 200:107227. doi: 10.1016/j.compag.2022.107227 [DOI] [Google Scholar]
  17. Li G., Liu X., Ma Y., Wang B., Zheng L., Wang M.  2022b. Body size measurement and live body weight estimation for pigs based on back surface point clouds. Biosyst. Eng. 218:10–22. doi: 10.1016/j.biosystemseng.2022.03.014 [DOI] [Google Scholar]
  18. Liao J., Li H., Feng A., Wu X., Luo Y., Duan X., Ni M., Li J.  2022. Domestic pig sound classification based on TransformerCNN. Appl. Intell. 53:4907–4923. doi: 10.1007/s10489-022-03581-6 [DOI] [Google Scholar]
  19. Yu L., Guo X., Zhao H., Yang G., Zhang J., Li Q.  2024. Text word segmentation of livestock and poultry diseases based on BERT-BiLSTM-CRF model. Trans. Chin. Soc. Agric. Mach. 55(2):287–295 (with English abstract). doi: 10.6041/j.issn.1000-1298.2024.02.028 [DOI] [Google Scholar]
  20. Liu Z., Cheng J., Liu L., Ren Z., Zhang Q., Song C.  2022. Dual-stream cross-modality fusion transformer for RGB-D action recognition. Knowl.-Based Syst. 255:109741. doi: 10.1016/j.knosys.2022.109741 [DOI] [Google Scholar]
  21. Liu J., Xiao D., Liu Y., Huang Y.  2023. A pig mass estimation model based on deep learning without constraint. Animals  13(8):1376. doi: 10.3390/ani13081376 [DOI] [PMC free article] [PubMed] [Google Scholar]
  22. Ma J., Li Z., Wang H., Xiao Y., Wang C.  2025. On field recognition of pig cough based on multimodal audio representation and fusion with contrastive learning. Comput. Electron. Agric. 238:110842. doi: 10.1016/j.compag.2025.110842 [DOI] [Google Scholar]
  23. Ma J., Liu B., Ji L., Zhu Z., Wu Y., Jiao W.  2023. Field-scale yield prediction of winter wheat under different irrigation regimes based on dynamic fusion of multimodal UAV imagery. Int. J. Appl. Earth Obs. Geoinformation. 118:103292. doi: 10.1016/j.jag.2023.103292 [DOI] [Google Scholar]
  24. Mairittha T., Sawanglok T., Raden P., Treesuk S.  2025. When pigs get sick: Multi-agent AI for swine disease detection. arXiv preprint. doi: 10.48550/arXiv.2503.15204 [DOI]
  25. Radford A., Narasimhan K., Salimans T., Sutskever I.  2018. Improving language understanding by generative pre-training. Preprint at https://paperswithcode.com/paper/improving-language-understanding-by.
  26. Saeidnia H.R., Nilashi M.  2025. From MYCIN to MedGemma: a historical and comparative analysis of healthcare AI evolution. InfoSci. Trend. 2:18–28. doi: 10.61186/ist.202502.06.02 [DOI] [Google Scholar]
  27. Shen W., Ji N., Yin Y., Dai B., Tu D., Sun B., Hou H., Kou S., Zhao Y.  2022. Fusion of acoustic and deep features for pig cough sound recognition. Comput. Electron. Agric. 197:106994. doi: 10.1016/j.compag.2022.106994 [DOI] [Google Scholar]
  28. Wang S., Tong Q., Liu Y., Li Q., Wang C., Gao R., Yu L., Li H.  2024. An intelligent diagnosis model for Laying-Hen diseases integrating text and knowledge graph. Trans. Chin. Soc. Agric. Eng. (TSCAE)  40(17):265–272. doi: 10.11975/j.issn.1002-6819.202405021 (with English abstract). [DOI] [Google Scholar]
  29. Tang Q., Liang J., Zhu F.  2023. A comparative review on multi-modal sensors fusion based on deep learning. Signal Process. 213:109165. doi: 10.1016/j.sigpro.2023.109165 [DOI] [Google Scholar]
  30. Turimov M. D., Muhamediyeva T. D., Safarova U. L., Primova H., Kim W.  2023. Improved cattle disease diagnosis based on fuzzy logic algorithms. Sensors. 23:2107. doi: 10.3390/s23042107 [DOI] [PMC free article] [PubMed] [Google Scholar]
  31. Hoang V. T., Nguyen T. S., Lee S., Lee J., Nguyen L. V., Lee O. J.  2023. Companion Animal Disease Diagnostics based on Literal-aware Medical Knowledge Graph Representation Learning. IEEE Access, 11:114238- 114249. doi:10.1109/ACCESS.2023.3324046 [Google Scholar]
  32. Wang H., Shen W., Zhang Y., Gao M., Zhang Q., A X., Du H., Qiu B.  2023. Diagnosis of dairy cow diseases by knowledge-driven deep learning based on the text reports of illness state. Comput. Electron. Agric. 205:107564. doi: 10.1016/j.compag.2022.107564. [DOI] [Google Scholar]
  33. Wen H., Shi H., Yu J., Fan Z., Dai H., Jiang L., Song Q.  2025. An intelligent diagnostic method for porcine gastrointestinal infectious diseases based on multimodal AI and large language model. Front. Vet. Sci. 12:1660745. doi: 10.3389/fvets.2025.1660745 [DOI] [PMC free article] [PubMed] [Google Scholar]
  34. Wu J., Zhou W., Qian X., Lei J., Yu L., Luo T.  2023. MENet: lightweight multimodality enhancement network for detecting salient objects in RGB-thermal images. Neurocomputing (Amst)  527:119–129. doi: 10.1016/j.neucom.2023.01.024 [DOI] [Google Scholar]
  35. Xie Q., Wu M., Bao J., Zheng P., Liu W., Liu X., Yu H.  2023. A deep learning-based detection method for pig body temperature using infrared thermography. Comput. Electron. Agric. 213:108200. doi: 10.1016/j.compag.2023.108200 [DOI] [Google Scholar]
  36. Xiong J., Zhou Y., Tian F., Ni F., Zhao L.  2025. SheepDoctor: a knowledge graph enhanced large language model for sheep disease diagnosis. Smart Agric. Technol. 11:101001. doi: 10.1016/j.atech.2025.101001 [DOI] [Google Scholar]
  37. Xu Z., Tian F., Zhou J., Zhou J., Bromfield C., Lim T.T., Safranski T.J., Yan Z., Calyam P.  2023. Posture identification for stall-housed sows around estrus using a robotic imaging system. Comput. Electron. Agric. 211:107971. doi: 10.1016/j.compag.2023.107971 [DOI] [Google Scholar]
  38. Xu J., Zhou S., Xu A., Ye J., Zhao A.  2022. Automatic scoring of postures in grouped pigs using depth image and CNN-SVM. Comput. Electron. Agric. 194:106746. doi: 10.1016/j.compag.2022.106746 [DOI] [Google Scholar]
  39. Yin Y., Ji N., Wang X., Shen W., Dai B., Kou S., Liang C.  2023. An investigation of fusion strategies for boosting pig cough sound recognition. Comput. Electron. Agric. 205:107645. doi: 10.1016/j.compag.2023.107645 [DOI] [Google Scholar]
  40. You S., Liu T., Zhang M., Zhao X., Dong Y., Wu B., Wang Y., Li J., Wei X., Shi B.  2021. African swine fever outbreaks in China led to gross domestic product and economic losses. Nat. Food  2(10):802–808. doi: 10.1038/s43016-021-00362-1 [DOI] [PubMed] [Google Scholar]
  41. Zhong Z, Yang J.  2022. A novel pig-body multi-feature representation method based on multi-source image fusion. Measurement  204:111968. doi: 10.1016/j.measurement.2022.111968 [DOI] [Google Scholar]

Articles from Animal Frontiers: The Review Magazine of Animal Agriculture are provided here courtesy of Oxford University Press

RESOURCES