Summary
The importance of data archiving, data sharing, and public access to data has received considerable attention. Awareness is growing among scientists that collaborative databases can facilitate these activities.
We provide a detailed description of the collaborative life history database developed by our Working Group at the National Evolutionary Synthesis Center (NESCent) to address questions about life history patterns and the evolution of mortality and demographic variability in wild primates.
Examples from each of the seven primate species included in our database illustrate the range of data incorporated and the challenges, decision-making processes, and criteria applied to standardize data across diverse field studies. In addition to the descriptive and structural metadata associated with our database, we also describe the process metadata (how the database was designed and delivered) and the technical specifications of the database.
Our database provides a useful model for other researchers interested in developing similar types of databases for other organisms, while our process metadata may be helpful to other groups of researchers interested in developing databases for other types of collaborative analyses.
Keywords: population ecology, evolutionary biology, bioinformatics, data archiving, data sharing, database development
Introduction
The accumulation of long-term ecological data over the past several decades, and increasing recognition of the need for broad collaborative research efforts, present new challenges as well as opportunities for the scientific community. The design and curation of databases that can accommodate the complex, dynamic data sets typical of ecological research pose a practical hurdle because of the enormous range of data that is often involved. In some cases, these data sets are historic and not yet digitized, but of great potential value nonetheless. More frequently the data sets are contemporary, and are completely or partially digitized, but in non-standardized ways. Inadequacies in the development and maintenance of these data sets may make them largely inaccessible for the kinds of synthetic, collaborative analyses that many ecological questions require (Michener 2006).
Incorporating data from multiple studies that span diverse species and observational conditions into integrated databases for comparative analyses is even more difficult to achieve because differences in data collection and sampling methods across studies must first be reconciled, and a standard vocabulary must be developed based on common criteria. Identifying and standardizing this vocabulary can be an arduous process that relies on the expertise of investigators with sufficient familiarity with the long-term studies to understand and explain the nuances in their data sets (Nelson 2009). Yet, although the benefits of archiving, sharing, and increasing public access to biological and ecological data have received considerable attention in the literature (e.g., Arzberger et al. 2004; Parr & Cummings 2005; Piwowar et al. 2008; Schofield et al. 2009; Toronto International Data Release Workshop 2009), there are still only a small number of published examples that describe how synthetic, integrated databases are created and used (e.g., Ellison et al. 2006; Even et al. 2006; Jones et al. 2008).
Here we describe the development, design and implementation of the Primate Life History Database (PLHD), a product of a larger collaborative endeavor jointly funded by the National Evolutionary Synthesis Center (NESCent) and the National Center for Ecological Analysis and Synthesis (NCEAS). The PLHD incorporates individual, longitudinal life history data from long-term field studies of wild primates into a synthetic database for comparative analyses. We present the descriptive and structural metadata associated with this database, as well as the process metadata (i.e., a description of how the dataset was designed and delivered). In addition to reviewing the content of the database and its underlying rationale, we discuss the criteria we employed to standardize data from seven different field studies, and we provide examples from the database to illustrate its design and technical specifications and the range of data included.
Our scientific motivation for the endeavor lies in our shared interests in comparative analyses of primate life histories, and specifically, in the application of data from wild populations to address questions about the evolutionary ecology of life histories. Age at first reproduction, fertility, longevity, and other variables that influence both fitness and population dynamics fluctuate in response to local ecological, social, and demographic conditions. Understanding this variability offers insights not only into life history evolution, but also into the conservation and management of endangered species and the ecological impacts of global climate change (Strier et al. 2006).
Primates are long-lived compared to most other mammals, and the decades of research required to document their individual life histories make these longitudinal data irreplaceable resources. Yet, despite widespread recognition of the value of these data, primate researchers, like other ecologists, often lack the expertise and resources to construct the kinds of databases that facilitate data sharing and access, and that are needed to protect data from the information loss that can occur over time because of inadequate curation or maintenance (Michener 2006; Jones et al. 2008). Our database provides a useful model for other researchers interested in developing similar life history databases for other organisms. At the same time, the description of the process by which we developed our database may be helpful to other groups of researchers interested in developing databases for other types of collaborative analyses.
Methods
Our collaboration involved a multi-stage process. The first stage involved setting the agenda for the development of the PLHD (described in Strier et al. 2006). This initial stage led to the formation of the core collaborative group, the Working Group, which included three sets of researchers. (1) Researchers representing seven ongoing field studies of wild primates ranging from 24–45 years in duration (Alberts, Altmann, Brockman, Cords, Fedigan, Pusey, Stoinski, Strier). (2) Two evolutionary ecologists with a particular interest in demography (Bronikowski, Morris). (3) Two NESCent informatics specialists (Lapp, Liu). The PLHD was developed by our Working Group over the course of three 4–5 day meetings held at NESCent in August 2007, January 2008, and August 2008.
The species represented by the seven field studies are taxonomically diverse. They include one indrid (Verreaux’s sifaka, Propithecus verreauxi, research ongoing for 24 years), two New World monkeys (white-faced capuchin, Cebus capucinus, and northern muriqui, Brachyteles hypoxanthus, studies ongoing for 25 and 27 years, respectively), two Old World monkeys (yellow baboons, Papio cynocephalus, 37 years, and blue monkeys, Cercopithecus mitis, 29 years), and two great apes (eastern chimpanzees, Pan troglodytes schweinfurthii, 45 years, and mountain gorillas, Gorilla beringei beringei, 41 years). All populations are wild, and with a few exceptions, no provisioning or interventions have occurred. Exceptions include veterinary intervention and historical provisioning in the chimpanzee population (i.e., almost daily from 1964–1967 and 1990–1996 for different communities, after which it was reduced and terminated altogether in 2000; Wrangham 1974; Goodall 1986; Pusey et al. 2008), veterinary intervention in the gorilla population (Mudakikwa et al. 2001), occasional access to human-related foods by the blue monkeys (Cords & Chowdhury, In press), and one instance in which researchers rescued an infant muriqui and returned her to her mother (Nogueira et al. 1994).
Development of the database itself occurred in two parallel processes. One process involved intensive discussion among the primate researchers to design a shared terminology of attributes that would capture the relevant life history data for all seven species in a standardized manner. The goal was to permit us to address two central questions; one about the evolution of mortality across species and by sex, and the other about patterns of demographic variation across species. Decisions about which data attributes to include and their relationships to one another were fairly straightforward, but defining the meaning and constraints of each attribute operationally, in ways that made biological sense for all species and that accounted for differences among studies, required painstaking consideration. At the same time, the informaticians conferred with the researchers to design a database that presented the data as a series of three “views,” or virtual tables that represent organized, systematic abstractions of the underlying database. The three main views that resulted were: Biography (Supporting Information (SI), Table 1); Fertility Intervals (hereafter, Fertility; SI, Table 2); and Study Population (SI, Table 3).
Biography includes all live-born individuals (females and males) in our study populations, and is the core of our database. In the aggregate, Biography includes data that permit us to calculate the lifespan for each individual (and to identify both left-truncated and right-censored records, i.e., cases in which individuals were already alive at the onset of observations or still alive when observations ceased, respectively). Because it also includes the identity of the mother for each individual (if known), we can use it to calculate fertility for each mother identified in the database as well. Fertility identifies, for each female, any interruptions in continuous observations that could have resulted in missed live births. Together, Biography and Fertility allow the user to determine the sequence and number of live births that each mother experienced during her lifetime (see Database Content, below, for more details). The Study Population view designates a distinctive code for each study, which is used to identify the study for each individual in the Biography and Fertility views.
The database was populated in large batch uploads from spreadsheet-formatted data (see below under Database design). A web-based graphical user interface was also developed to enable data editing and entry by individual researchers and their collaborators. This interface is flexible yet comprehensive, and allows various levels of access control. For instance, while the database administrators have read and write access to all of the data, other users of the database can be limited to read-only (search) access to one or some or all of the studies, or can be given edit privileges to one or several studies. This arrangement allows the administrators to grant appropriate access to each working group member (i.e., each PI has read and write access to their own data, but only read access to others’ data). It also allows research personnel from each study to gain access to that study’s data (but not to data from other studies), even if they did not participate in the working group directly. Only the administrators can create users, and grant study-specific read or write access.
Because all members of the Working Group would have access to the entire database, we developed a Memorandum of Understanding (MOU) at our first meeting (http://demo.plhdb.org). We agreed that PIs could add their own collaborators as users of the database for the species with which they work, but access to the entire database is currently limited to the Working Group members who have signed our MOU.
Database Content
Our intention was to have a fairly simple set of relational tables that reflects the individual-based nature of our data. That is, for each study, the individual animal is the unit of analysis, and hence the set of all individual animals’ life history data comprise the data of interest. Biography has one row for each of the 3,351 individuals across the seven studies. Each of the 17 columns pertains to a life history variable or estimates or ranges of error of these variables (SI, Table 1).
Measuring individual (as opposed to population-level) fertility represents a special challenge in studies of wild animals, because unlike longevity (measured as the interval between the birth and the death or disappearance of a known individual), individual fertility (measured, in our case, as the interval between recorded live births) will be inaccurately estimated if even short gaps in observation result in missed births. For this reason, we recognized the need to identify, for each female in each study, the periods during which we were reasonably sure we had captured all births, and equivalently, the periods during which we were not able to rule out the possibility that a birth and death of an infant had occurred during a gap in observations. Fertility captures this information (SI, Table 2).
In addition, in Study Population we provide information about each study (location, species, etc). Study Population contains one row for each study (N=7; SI, Table 3), identified by a unique, arbitrarily assigned number and to which all individuals represented in the other views for each study are linked.
Data Standardization
We designed the relational database to permit us to address specific questions about the evolution of primate life histories, such as whether species and sexes age at similar rates (Bronikowski et al. In prep.) and whether population growth is more sensitive to female fertility versus infant or adult survival (Morris et al. In prep.). This meant identifying the variables most critical to our analyses and then reconciling variability in data coding, observation schedules, and confidence intervals for estimated dates to ensure that our criteria for assigning values were uniform and comparable across studies. Differences in the behavior of the animals and in logistical conditions resulted in variation in data coding systems both within individual studies and between the studies in the database. These sources of variation necessitated the development of a common vocabulary, established among Working Group members, which would ensure that terms were used the same way across studies. The common vocabulary is encompassed by the terms defined below. These terms fall into three different logical units, one belonging to the biographical properties of an animal (Biography), one belonging to the fertility properties of an animal (Fertility), and one belonging to the study population in which the animal lives (Study Population).
Contents of Biography
StudyID
Each of the different study populations, representing different species in our database, was assigned a distinct ID code.
AnimID
Because all of the data were individual-based, and the individual was the unit of analysis in all studies, the ID of each animal (typically an abbreviated code) in each study population was the fundamental unit of information around which all the data were organized. All individuals in each of the studies were unambiguously identifiable by their distinct physical characteristics or, in one case (sifaka), by tagged collars and ear-notches. Habituation to human observers facilitated the recognition of individuals. Within each study, there was a one-to-one relationship between an animal's ID code and the identity of an actual animal in each study population. However, AnimID was not a unique field; animals in different studies might share an AnimID (for instance, study 2 and study 5 both have an animal with AnimID = ‘AFR’). Consequently, it is the combination of AnimID and StudyID that produces a unique identifier for each animal in the database.
AnimName
We included a column for the full name of each animal whenever these had been assigned. This was included for completeness, and to enhance the ability of individual researchers to confirm the accuracy of all records associated with that individual.
BirthGroup and BGCertainty
Our life history analyses were aimed primarily at species-level differences. However, the social nature of primates in general, and the variation in their dispersal patterns in particular, led us to include a column for specifying the social group into which an animal was born (BirthGroup) and the researcher’s confidence in this assignment (BGCertainty). These variables will permit us to collectively or individually evaluate whether the group of birth contributes to life history variance.
Sex
Because many life history variables (e.g., age at maturity, dispersal, life span) are known to be sex-specific, we distinguished each individual in our database by sex (M or F). Occasionally, neonates that were born alive have died before researchers were able to assign a sex; hence ‘U’ (for unknown) was an allowed value in this column.
MomID
This attribute corresponds to the AnimID of an individual’s mother, when it was known. No value was assigned for individuals whose mothers were unknown. MomID allows us, in combination with Fertility (see below) to measure fertility for each mother recorded in the database. Also, by associating each individual with his or her mother’s AnimID, when known, we can evaluate how individual survivorship (and female fertility) relate to birth sequence and maternal age. As is the case with AnimID, MomID must be used in combination with StudyID to identify a unique mother.
FirstBorn
Because age at first reproduction is a critical life history marker, we distinguished whether individuals were known to be their mother’s first offspring.
Birthdate, BDMin, BDMax
Birth dates, and estimates of the range of possible dates in which the birth could have occurred (BDMin and BDMax), are the key to estimating individual ages, and therefore necessary for all analyses of life histories. In some cases, continuity in field personnel and cohesive grouping patterns facilitated daily or near-daily monitoring of all subjects, and the range of days over which Birthdate could be estimated was small. When a mother was observed on sequential days, first without an infant and subsequently with an infant, the Birthdate and BDmax were usually recorded as occurring on the second day, with the BDmin corresponding to either the first or second day depending on the study. In other cases, either gaps in observations or the tendency of individuals to travel widely made it difficult for observers to monitor all individuals regularly. Birthdate estimates in these circumstances were less precise, and the difference between BDMin and BDMax was much greater.
Some Birthdate entries, including those for animals that were already present at the onset of observations of their population or social group, were necessarily estimated on the basis of the individual’s visible size or developmental characteristics. These birthdate assignments for adults tended to have larger intervals between BDmin and BDmax estimates than animals first seen as immatures, because there were often few, if any, visible differences between young, middle aged, or older adult animals. In these cases, the range of possible birth dates assigned (BDMin and BDMax) depended on the researchers’ confidence in their estimates. Birth dates were estimated based on a variety of traits in different species, including dental wear patterns at the time of capture/tagging (used in sifaka), or visible physical similarities with adults of known ages (used in most studies). In the case of females, some species exhibit visible signs of parity, and researchers used these signs to estimate Birthdate and BDmin and BDmax from the average (± sd) age ranges known for nulliparous and primiparous females in their study populations. Nonetheless, there were often still very large ranges of possible birth dates for some individuals; by having this information in the database we could decide whether or not to include particular individuals in specific analyses.
BDDist
In a further effort to increase precision in birth date estimates, we assigned a birthdate distribution (BDDist) of Normal (N) when we considered the most likely birthdate to be closer to Birthdate than to BDMin or BDMax, and of Uniform (U) when any birthdate between BDMin and BDMax (including Birthdate) was equally likely. A normal distribution of the estimated birthdate was assigned if BDMin and BDMax represented ± 2 standard deviations from the most likely Birthdate. Uniform distributions were assigned if the probability distribution was truncated at either BDMin or BDMax. For example, a new infant observed after a 30 day gap in observation of its mother would result in the infant’s BDMin on the last day its mother had been observed and a BDMax 30 days later when it was first observed. Based on the infant’s size and development upon first observation relative to other known infants in the study population, the researcher may have had good reasons to estimate the infant’s Birthdate at either the midpoint of BDMin and BDMax, or else closer to either BDMin or BDMax. If estimated at the midpoint, then BDDist could be either Normal or Uniform, but if not at the midpoint, the BDDist would necessarily be assigned as Uniform.
Entrydate and Entrytype
Identifying the date at which individuals entered their respective study populations allowed us to differentiate uncensored observations from left-censored observations for survival analyses. Individuals were considered to enter their respective study populations at the time at which they could be individually identified and close observations on them began. In most cases this corresponded to their birth. However, some individuals immigrated into the study populations some time after their birth, and in these cases Entrydate corresponded to immigration date (or to confirmed AnimID via tagging in sifaka). Finally, all studies included individuals that were present at the onset of the study itself or when close observations were initiated on new groups in the study population; in these cases Entrydate corresponded to the onset of the study or the individual’s inclusion in the study population.
Entrytype specified each of the four possible ways in which a subject could have entered the study population: birth (B); immigration (I); start of confirmed AnimID (C); and initiation of close observation (O). Although births and immigrations were easily assigned, investigators differed in their designations of C and O. For example, in some cases an animal had been recognizable and familiar to the researchers based on occasional or opportunistic sightings before close observation began. In most cases, these animals only entered the database when they immigrated (I) into one of the established study groups. However, in other cases, they entered the database because systematic observations were initiated on their group; in this case, either C or O could have been used. Each researcher described her assignments of C and/or O in their User’s documentation, but these entry types are functionally equivalent in terms of analyses, and should be treated as such by database users.
Departdate and DepartdateError
The last date on which an animal was observed in the study population is the Departdate. However, not all animals were equally visible to observers on a daily basis, and observation schedules varied across the different studies and over time and between groups within studies. To capture the variation in the reliability of Departdates between and within the different studies, we calculated the DepartdateError, which reflects the time between Departdate (last date observed) and the first time that an animal was confirmed missing (e.g., when observations resumed and all individuals present could be expected to be re-encountered). DepartdateError was expressed as a fraction of a year (number of days divided by number of days in a year), and was >0 whenever the number of days between Departdate and retrospective confirmed missing date was >15 days. In some studies, members of the study population did not live in cohesive groups, making it difficult to specify an expected lag to re-sighting and a corresponding DepartdateError. In cases when DepartdateError could not be calculated, its value was missing.
DepartType
Similar to Entrytype, we distinguished four DepartTypes: death (D); emigration (E); permanent disappearance (P); and the end of observation (O), which means that the individual was still present at the most recent census date. Observations of deaths and the recovery of identifiable corpses in most primate habitats are extremely rare, but we nonetheless required strong circumstantial evidence, such as visibly poor health or other mortality risks, or violations of population-specific behavior patterns, before assigning D. For example, the sudden permanent disappearance of an animal of the typically non-dispersing sex for that population could have been assigned a DepartType of D, even in the absence of a corpse or other circumstantial evidence. If the animal that disappeared was a member of the dispersing sex, then D was allowed when the disappearance occurred before the youngest known dispersal age in that population, subject to the researchers’ expert opinion. Additional information, such as locations associated with high risk, were also considered when assigning D in the absence of observed death or identifiable corpse.
D was never assigned based solely on inferred risks associated with age, and E was never assigned solely on the basis of the disappearance of an individual at the appropriate age and sex for dispersal. To assign E, researchers had to be confident that the individual had emigrated even if its subsequent fate was not known. All disappearances that could not be attributed to D or E were assigned P in the database. In demographic analyses, P, E and O all function to signal right-censored observations. The four types of DepartTypes are equivalent to StopType in Fertility.
Contents of Fertility
StudyID
See Biography.
AnimID
See Biography.
Startdate and Stopdate
The most difficult task in constructing the Fertility view was the development of standardized criteria for what constituted sufficiently continuous observations of a female to merit inclusion of that period, versus gaps in observations that would be long enough to have possibly resulted in a missed birth record. Each row in Fertility corresponded to one uninterrupted period of observation on a female (an interval during which no possible births would have been missed). Each female for which at least one such uninterrupted period was obtained was represented by one or more rows in Fertility. In addition to the variation in the observation schedules for each study, some of the primates in our database are elusive and impossible to monitor on a daily basis. Each of the primatologists provided detailed documentation about the criteria they applied.
Starttype and Stoptype
See Entrytype and Departype in Biography; these correspond to Starttype and Stoptype in Fertility, where they defined the beginning and end of each uninterrupted period of observation during which no possible births would have been missed, as described above.
Contents of Study Population
StudyID
See Biography.
CommonName
We used the names most commonly used in the literature for each species, although we recognize that conventions on common names differ regarding the use of English versus indigenous names in different parts of the world.
SciName
We provided the scientific names for each species, as their Latin genus and species names. Although taxonomic assignments of some of the species in our database are undergoing reassessment, we used the scientific names identified by each PI as the best current designation. Subspecies designations were included in some cases to distinguish recognized biogeographical variants.
SiteID
Each study population in the database was identified by the name of the park or reserve in which it occurs and by which it is known in the current literature.
Owners
Name(s) of individual(s) and/or organization that control access to the data. Owners were either the principal investigators or the designated representatives of the study populations’ research groups. Owners were included to identify the key contact individuals for the life history data from each study population.
Latitude/Longitude
Because SiteIDs have the potential to change with new political or conservation initiatives, we included the latitudinal and longitudinal coordinates for each study site. These coordinates were given in degrees, to the nearest thousandth.
Design and Deployment of the Database and User Interface
We designed the database on the premise that the common vocabulary developed by the Working Group and the three views corresponding to the logical units would serve as a well-defined standard interface, both for accepting and delivering data to and from the database, and for programming user-facing applications. We implemented the standard interface as three database views, one corresponding to each of the three logical units of the terminology (Biography, Fertility, and Study Population), that sit on top of a physical, normalized data model. The attributes of each view are the terms that comprise the respective logical unit of our terminology. Database views, by definition, present the data for browsing, querying, and retrieval; we also made them support the full set of CRUD (Create, Retrieve, Update, Delete) data manipulation operations by implementing code that executes within the database server (called ‘stored procedures’) and translates between the underlying normalized data model and the standard interface views.
The physical data model powering the three database views essentially follows a 3rd normal form model of the logical entities represented by the common vocabulary in the database (for a description and discussion of relational database normal forms, see Date 2004, Kent 1983). Specifically, the normalized entities include: Individual (the individual animal); Individual_Relationship (parent-child links between individuals); Study (a population of individuals); Site (the geographic site of a study); Observation (biographical events of a given type at a specified time, such as birth, death, or emigration); and RecordingPeriod (a period of time that starts and ends with an observation, such as the observed fertility interval of a female individual). Furthermore, the normalized model includes two additional tables, CVTerm and CVTerm_Relationship, which hold a controlled vocabulary designating the specific type and meaning of the data stored in each row of various tables, such as the type of observation (in table Observation), or the type of relationship (in table Individual_Relationship). The CVTerm_Relationship table relates terms to super-classes that allow a client application, such as the web-application we developed, to obtain the allowable terms (types) for a particular super-class. This in turn allows the application to validate input data for allowable types, for instance the types of start dates and end dates of biographies and fertility intervals. For example, 'permanent_disappearance' is a term designating the type of an observation, and is one of the subtypes of the super-class 'end_of_recording', but not a subtype of 'start_of_recording'. The web application uses this to offer 'permanent_disappearance' as an option only for end dates but not for start dates.
The database was implemented in the PostgreSQL relational database engine, which is open-source and freely available. We wrote stored procedures in the PL/pgSQL database programming language, natively supported by PostgreSQL, to encapsulate the necessary business logic behind look-up, create, and update data operations in an application programming interface (API). The API enables client code to obtain a record by supplying identifying attributes (such as AnimID and StudyID for an individual), and a parameter that dictates whether the API will simply try to locate and return the record, to create it first if it cannot find it, or to update it first if it can find it. The database views combine data from several tables in the underlying model, making the data from some tables appear multiple times (called “de-normalization” in database theory). Thus, the views cannot directly allow data manipulation operations (create, update, and delete). We therefore used a combination of the PostgreSQL-specific capability of “rules” and standard database triggers to support these operations. The PostgreSQL rules re-route data manipulation operations executed against the database views to PL/pgSQL stored procedures that use the PL/pgSQL API described above. To facilitate bulk import of spreadsheet-formatted data, we implemented tables specifically designated for this purpose; these tables mirror the spreadsheet templates agreed upon by the scientists of the Working Group. The COPY FROM command, which is built into PostgreSQL, populates a destination table from the rows of an input data file in spreadsheet (CSV) format. We then wrote PL/pgSQL database triggers to intercept incoming rows of data and re-route them through the PL/pgSQL API to the physical normalized relational tables.
Together, these components allowed us to present the data within the database so that it was fully compliant with the terminology and the logical units that were agreed-upon and understood by the Working Group scientists. At the same time, our approach utilizes the database engine’s capabilities of enforcing basic constraints on the data and preventing data redundancy through a normalized relational model. It also provides an API for client application programmers, which encapsulates the business logic of data look-up and manipulation within the database itself, guaranteeing that all client access passes through the same business logic.
Our approach also allows those participants of the working group who are comfortable with desktop database tools, such as MS Access, to connect directly to the database and browse, query, and manipulate the data in the tool of their choice. In addition to supporting direct access, we constructed a web-based user interface application that supports browsing all rows of all tables to which the user is granted access. It also supports adding to and editing biography and fertility observation records, as well as building custom queries and downloading the results as reports for subsequent import into analysis programs. Viewing and editing privileges are controlled by the user authorization module described above, and granted on a per-study basis. Only users with administrative privileges can add users and change user privileges.
The web-application was implemented in the Java programming language using the Spring application framework and Hibernate for mapping application data objects to records in the relational database. This mapping fully utilizes the database view API described above, and hence is agnostic to the actual physical data model being used. The web-application also utilizes the controlled vocabulary term component of the database to provide values for the input fields about biographical events (such as Entrytype, or Departtype, as described above), and at the same time restricts input to those terms that are valid for a given event type (for example, Immigration is not permitted for a Departtype, whereas Emigration is permitted).
The schema definition and all other source code, including the PL/PgSQL database code, and the source code for the web-application are freely available under GNU Public License (see http://www.gnu.org/licenses/gpl.html). In addition, we have created a live instance of the database and application at http://demo.plhdb.org, which is populated with representative sample records from each study represented among the Working Group participants. All source code can be downloaded or browsed at http://github.com/plhdb/plhdb or http://sf.net/projects/plhdb.
Use of the Database
One of the immediate analytical goals for the database was the construction of life tables and the analysis of ages at death. An ideal individual was one for whom Birthdate was known to within a fraction of a year, Entrytype was birth, Sex was determined, and Departdate was known to within a fraction of a year. This was true for the majority of data. Individuals of unknown sex were excluded from these analyses, but because most of these were animals that died within a few days of birth, their exclusion would impact our calculations of infant mortality. Similarly, individuals who were present as adults when observations began could have a several year difference between their Birthdate minimum and maximum, resulting in a wide age range at death even if Departdate was known precisely and DepartType was death.
Below we provide a few examples of how the database, as shown in Tables 1 and 2 and live at http://demo.plhdb.org, can be used to calculate three standard life history parameters: Age at first reproduction; Lifetime reproductive success of females; and Interbirth interval.
Table 1.
Sample data from the PLHD Biography (also available live at http://demo.plhdb.org).1.
StudyId | AnimId | AnimName | Birth Group |
Birth Group Certainty |
Sex | MomId | First Born |
Birthdate | BDMin | BDMax | BD Dist |
Entry Date | Entry Type |
Depart Date | Depart Date Error |
Depart Type |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
1 | BRIS | Brisa | Matão | C | F | BR | Y | 2-Sep-89 | 15-Aug-89 | 20-Sep-89 | U | 20-Sep-89 | B | 27-Sep-07 | null | D |
1 | BRAH | Brahma | Matão | C | F | BR | N | 14-Aug-93 | 14-Aug-93 | 14-Aug-93 | N | 14-Aug-93 | B | 14-Dec-08 | 0 | O |
1 | BRS | Brasa | Matão | C | F | BR | N | 4-Jul-96 | 4-Jul-96 | 4-Jul-96 | N | 5-Jul-96 | B | 17-Feb-99 | 0 | D |
1 | BRE | Brenda | Matão | C | F | BR | N | 29-May-99 | 29-May-99 | 29-May-99 | N | 29-May-99 | B | 10-Apr-02 | 0 | D |
1 | BRN | Branca | Matão | C | F | BR | N | 20-Jul-02 | 20-Jul-02 | 20-Jul-02 | N | 20-Jul-02 | B | 20-Apr-04 | 0 | D |
1 | BN | Breno | Matão | C | M | BR | N | 2-Aug-04 | 22-Jul-04 | 14-Aug-04 | U | 14-Aug-04 | B | 14-Jun-05 | 0 | D |
1 | BM | Bruma | Matão | C | F | BR | N | 14-Apr-06 | 12-Apr-06 | 17-Apr-06 | U | 17-Apr-06 | B | 17-Dec-08 | 0 | O |
1 | BER | Bera | Matão | C | F | BR | N | 16-Jun-08 | 15-Jun-08 | 16-Jun-08 | U | 16-Jun-08 | B | 17-Dec-08 | 0 | O |
1 | BRL-J | Brasil | Jaó | C | M | BRAH | Y | 19-Aug-02 | 18-Aug-02 | 20-Aug-02 | N | 20-Aug-02 | B | 17-Dec-08 | 0 | O |
1 | BR | Bruna | Matão | U | F | BS | U | 15-Mar-82 | 13-Dec-81 | 14-Jun-82 | U | 25-Jun-83 | O | 17-Dec-08 | 0 | O |
1 | NI | Nilo | Matão | U | M | NY | U | 15-Mar-82 | 13-Dec-81 | 14-Jun-82 | U | 25-Jun-83 | O | 17-Dec-08 | 0 | O |
2 | DOT | DOTTY | 1 | C | F | ALT | N | 21-Jun-73 | 21-Jun-73 | 21-Jun-73 | N | 21-Jun-73 | B | 25-Feb-01 | 0 | D |
2 | DUD | DUDU | 1 | C | F | DOT | N | 5-Jul-83 | 5-Jul-83 | 5-Jul-83 | N | 5-Jul-83 | B | 18-Jun-05 | 0 | D |
2 | DRO | DRONGO | 1.1 | C | F | DUD | Y | 13-Sep-89 | 13-Sep-89 | 13-Sep-89 | null | 13-Sep-89 | B | 31-Dec-08 | 0 | O |
2 | DEL | DELTA | 1.1 | C | M | DUD | N | 2-Aug-91 | 2-Aug-91 | 2-Aug-91 | null | 2-Aug-91 | B | 2-Apr-96 | 0.027 | P |
2 | LIB | LIBERTY | 2 | C | M | LEL | N | 28-Sep-92 | 28-Sep-92 | 28-Sep-92 | N | 28-Sep-92 | B | 9-Nov-06 | 0 | P |
2 | NUT | NUTTY | 1.1 | C | F | NAD | Y | 17-Aug-95 | 17-Aug-95 | 17-Aug-95 | N | 17-Aug-95 | B | 26-Dec-06 | 0 | O |
2 | NJU | NJUGU | 2.1 | C | M | NIG | N | 29-Oct-97 | 29-Oct-97 | 29-Oct-97 | N | 29-Oct-97 | B | 27-Dec-06 | 0 | O |
2 | ALT | ALTO | 1 | C | F | null | U | 23-Feb-59 | 24-Feb-55 | 22-Feb-63 | N | 1-Aug-71 | O | 21-May-76 | 0 | D |
2 | STU | STU | 1 | C | M | null | U | 1-Jul-67 | 1-Jul-66 | 30-Jun-68 | N | 1-Aug-71 | O | 9-Nov-87 | 0 | P |
2 | KUS | KUSH | 4 | C | M | null | U | 21-Aug-69 | 22-Aug-67 | 21-Aug-71 | N | 25-Dec-78 | I | 30-Jun-90 | 0 | D |
2 | ROC | ROCKY | 9 | C | M | null | U | 19-Oct-84 | 20-Oct-81 | 19-Oct-87 | N | 21-Dec-93 | I | 5-Jul-03 | 0.022 | P |
2 | PRU | PRUDY | 2 | C | F | PIN | N | 31-Jan-82 | 31-Jan-82 | 31-Jan-82 | N | 31-Jan-82 | B | 3-Jul-04 | 0 | D |
3 | Ambo | Amboseli | Twn | C | F | Ambe | N | 8-Feb-05 | 8-Feb-05 | 8-Feb-05 | U | 8-Feb-05 | B | 28-Nov-06 | 0 | D |
3 | Diam | Diamond | Tw | C | F | Dd | N | 29-Aug-95 | 29-Aug-95 | 29-Aug-95 | U | 29-Aug-95 | B | 31-Dec-08 | 0 | O |
3 | Worm | Worm | G | C | F | HookF | N | 15-Feb-94 | 31-Jan-94 | 1-Mar-94 | U | 19-Aug-94 | B | 28-Oct-95 | 0.63 | O |
3 | Linc | Lincoln | Gs | C | M | Lily | N | 30-Apr-04 | 30-Apr-04 | 30-Apr-04 | U | 30-Apr-04 | B | 9-Jan-06 | 0 | D |
3 | Mick | Mickey | Gn | C | M | Mixu | N | 23-Apr-01 | 22-Apr-01 | 24-Apr-01 | U | 24-Apr-01 | B | 19-Jun-08 | 0 | E |
3 | Clow | Clownface | T | C | M | Nit | Y | 15-Feb-82 | 31-Jan-82 | 1-Mar-82 | U | 1-Mar-82 | B | 16-Aug-01 | 0 | P |
3 | Rose | Rose | T | U | F | null | U | 15-Feb-65 | 18-Feb-55 | 13-Feb-75 | U | 25-Jan-80 | C | 21-Jul-92 | 0.17 | D |
3 | Plat | Plato | Tw | C | M | Pans | Y | 20-Mar-02 | 20-Mar-02 | 21-Mar-02 | U | 21-Mar-02 | B | 2-Mar-06 | 0 | D |
3 | Blaz | Blaze | Tw | C | F | Ray | N | 1-Mar-94 | 1-Feb-94 | 31-Mar-94 | U | 1-Aug-94 | B | 31-Dec-08 | 0 | O |
3 | Tip | Tip | Gn | C | M | Tap | N | 28-Jan-98 | 27-Jan-98 | 30-Jan-98 | U | 30-Jan-98 | B | 27-Jul-08 | 0 | P |
4 | AQ | AQUA | MT | C | F | AP | N | 4-Apr-92 | 16-Mar-92 | 22-Apr-92 | N | 21-Apr-92 | B | 25-Jun-03 | null | D |
4 | AL | ATLAS | KK | C | M | AT | Y | 25-Sep-67 | 17-Sep-67 | 2-Oct-67 | N | 2-Oct-67 | B | 14-Jan-99 | 0 | D |
4 | CAD | CADBURY | KK | C | M | CD | N | 29-Oct-98 | 14-Oct-98 | 12-Nov-98 | N | 13-Nov-98 | B | 1-Jul-01 | 0.07 | D |
4 | DM | DOMINIE | KK | C | F | DO | Y | 1-Nov-72 | 17-Oct-72 | 15-Nov-72 | N | 15-Nov-72 | B | 12-Sep-95 | 0 | E |
4 | FB | FABEN | KK | U | M | FLO | U | 2-Jul-47 | 2-Jul-45 | 1-Jul-49 | N | 26-Jul-63 | C | 6-Sep-75 | null | D |
4 | FG | FIGAN | KK | U | M | FLO | N | 2-Jul-53 | 2-Jul-52 | 2-Jul-53 | U | 17-May-63 | C | 20-Jul-82 | null | D |
4 | FF | FIFI | KK | U | F | FLO | N | 2-Jul-58 | 2-Jul-57 | 2-Jul-59 | N | 2-Jul-63 | C | 1-Sep-04 | 0.04 | D |
4 | FT | FLINT | KK | C | M | FLO | N | 1-Mar-64 | 1-Mar-64 | 13-Apr-64 | N | 15-Apr-64 | B | 17-Sep-72 | 0 | D |
4 | FM | FLAME | KK | C | F | FLO | N | 24-Aug-68 | 24-Aug-68 | 24-Aug-68 | N | 25-Aug-68 | B | 2-Feb-69 | 0.02 | D |
4 | JM | JIMI | KK | C | M | JO | N | 30-Jun-81 | 11-Feb-81 | 15-Nov-81 | N | 17-Nov-81 | B | 23-Sep-85 | 0 | P |
4 | GB | GOBLIN | KK | C | M | ML | Y | 6-Sep-64 | 6-Sep-64 | 6-Sep-64 | N | 7-Sep-64 | B | 24-Aug-04 | 0 | D |
4 | FLO | FLO | null | C | F | null | U | 2-Jul-19 | 3-Jul-14 | 30-Jun-24 | N | 15-May-63 | C | 21-Aug-72 | 0 | D |
4 | MB | MADAM B | null | C | F | null | U | 2-Jul-45 | 3-Jul-40 | 1-Jul-47 | U | 15-Aug-63 | C | 19-Sep-75 | 0 | D |
4 | JO | JOANNE | null | C | F | null | U | 2-Jul-56 | 3-Jul-54 | 2-Jul-58 | N | 16-Nov-78 | I | 23-Sep-85 | 0 | P |
4 | SW | SPARROW | null | C | F | null | U | 2-Jul-58 | 2-Jul-56 | 1-Jul-60 | N | 15-Sep-71 | I | 31-Dec-08 | 0 | O |
5 | MAG | Maggie | Group 5 | C | F | EFF | N | 15-Jun-80 | 31-May-80 | 30-Jun-80 | U | 30-Jun-80 | B | 31-Dec-08 | 0 | O |
5 | SAM | Samvura | Group 5 | C | M | MAG | Y | 20-May-89 | 20-May-89 | 20-May-89 | U | 20-May-89 | B | 12-Oct-91 | 0 | D |
5 | UMO | Umubano2 | Group 5 | C | M | MAG | N | 15-Feb-93 | 31-Jan-93 | 1-Mar-93 | U | 1-Mar-93 | B | 27-Dec-93 | 0 | D |
5 | RUK | Rukundo | Pablo | C | M | MAG | N | 7-Nov-94 | 23-Oct-94 | 22-Nov-94 | U | 22-Nov-94 | B | 31-Dec-08 | 0 | O |
5 | TMR | Twemere | Pablo | C | F | MAG | N | 1-Dec-98 | 1-Dec-98 | 1-Dec-98 | U | 1-Dec-98 | B | 18-Mar-99 | 0.12 | D |
5 | AFR | Afrika | Pablo | C | F | MAG | N | 20-Apr-00 | 20-Apr-00 | 20-Apr-00 | U | 20-Apr-00 | B | 31-Dec-08 | 0 | O |
5 | TBA | Turibamwe | Pablo | C | M | MAG | N | 25-Sep-03 | 25-Sep-03 | 25-Sep-03 | U | 25-Sep-03 | B | 31-Dec-08 | 0 | O |
5 | I61 | Infant 61 | Pablo | C | M | MAG | N | 8-Oct-06 | 8-Oct-06 | 8-Oct-06 | U | 8-Oct-06 | B | 13-Nov-06 | 0 | D |
5 | I71 | Infant 71 | Bwenge | C | U | MAG | N | 23-Dec-07 | 23-Dec-07 | 23-Dec-07 | U | 23-Dec-07 | B | 24-Dec-07 | 0 | D |
5 | I84 | Infant 84 | Bwenge | C | F | MAG | N | 9-Dec-08 | 9-Dec-08 | 9-Dec-08 | U | 9-Dec-08 | B | 24-Dec-08 | 0 | D |
6 | 80 | null | VV | C | F | 20 | U | 15-Jul-85 | 15-Jul-85 | 15-Jul-85 | U | 15-Jul-85 | B | 15-Sep-08 | 0.08 | D |
6 | 80-1 | null | VV | C | M | 80 | Y | 15-Jul-90 | 15-Jul-90 | 15-Jul-90 | U | 15-Jul-90 | B | 14-Nov-90 | 0 | D |
6 | 199 | null | VV | C | M | 80 | N | 15-Jul-92 | 15-Jul-92 | 15-Jul-92 | U | 15-Jul-92 | B | 11-Dec-97 | 0 | D |
6 | 80-2 | null | VV | C | U | 80 | N | 15-Jul-94 | 15-Jul-94 | 15-Jul-94 | U | 15-Jul-94 | B | 15-Jul-94 | 0.08 | D |
6 | 80-3 | null | VV | C | U | 80 | N | 15-Jul-95 | 15-Jul-95 | 15-Jul-95 | U | 15-Jul-95 | B | 22-Dec-95 | 0.08 | D |
6 | 80-4 | null | VV | C | U | 80 | N | 3-Jul-96 | 3-Jul-96 | 3-Jul-96 | U | 3-Jul-96 | B | 3-Jul-96 | 0.08 | D |
6 | 314 | null | VV | C | F | 80 | N | 1-Aug-97 | 1-Aug-97 | 1-Aug-97 | U | 1-Aug-97 | B | 15-Dec-08 | 0 | O |
6 | 467 | null | VV | C | M | 80 | N | 7-Jul-01 | 7-Jul-01 | 7-Jul-01 | U | 7-Jul-01 | B | 15-Oct-08 | 0 | O |
6 | 483 | null | VV | C | M | 80 | N | 23-Jul-04 | 23-Jul-04 | 23-Jul-04 | U | 23-Jul-04 | B | 15-Jul-07 | 0.08 | D |
6 | 86-1 | null | CS | C | U | 86 | Y | 15-Jul-93 | 15-Jul-93 | 15-Jul-93 | U | 15-Jul-93 | B | 15-Jul-93 | 0.08 | D |
6 | 86-2 | null | PP | C | U | 86 | N | 15-Jul-94 | 15-Jul-94 | 15-Jul-94 | U | 15-Jul-94 | B | 15-Jul-94 | 0.08 | D |
6 | 9146 | null | PP | C | M | 86 | N | 19-Jul-95 | 19-Jul-95 | 19-Jul-95 | U | 19-Jul-95 | B | 15-Dec-08 | 0 | O |
6 | 86-3 | null | PP | C | U | 86 | N | 30-Jul-96 | 30-Jul-96 | 30-Jul-96 | U | 30-Jul-96 | B | 30-Jul-96 | 0.08 | D |
6 | 86-4 | null | PP | C | U | 86 | N | 15-Jul-97 | 15-Jul-97 | 15-Jul-97 | U | 15-Jul-97 | B | 8-Dec-97 | 0.08 | D |
6 | 86-5 | null | PP | C | U | 86 | N | 9-Jul-99 | 9-Jul-99 | 9-Jul-99 | U | 9-Jul-99 | B | 9-Jul-99 | 0.08 | D |
6 | 403 | null | PP | C | F | 86 | N | 17-Jul-00 | 17-Jul-00 | 17-Jul-00 | U | 17-Jul-00 | B | 15-Dec-08 | 0 | O |
6 | 86-6 | null | PP | C | U | 86 | N | 11-Jul-01 | 11-Jul-01 | 11-Jul-01 | U | 11-Jul-01 | B | 31-Jan-02 | 0.08 | D |
6 | 497 | null | PP | C | F | 86 | N | 15-Jul-02 | 15-Jul-02 | 15-Jul-02 | U | 15-Jul-02 | B | 15-Dec-08 | 0 | O |
6 | 86-7 | null | PP | C | U | 86 | N | 31-Jul-03 | 31-Jul-03 | 31-Jul-03 | U | 31-Jul-03 | B | 31-Jul-03 | 0.08 | D |
6 | 576 | null | PP | C | M | 86 | N | 10-Jul-05 | 10-Jul-05 | 10-Jul-05 | U | 10-Jul-05 | B | 15-Dec-08 | 0 | O |
6 | 86-8 | null | PP | C | U | 86 | N | 3-Aug-06 | 3-Aug-06 | 3-Aug-06 | U | 3-Aug-06 | B | 2-Oct-06 | 0.08 | D |
7 | CT-- | Chutney | LV | C | F | BLAN | N | 2-Aug-99 | 2-Aug-99 | 2-Aug-99 | N | 2-Aug-99 | B | 31-Dec-08 | 0 | O |
7 | KATH | Kathy Lee | LV | C | F | GR-- | U | 1-Apr-89 | 30-Dec-88 | 1-Jul-89 | N | 25-Mar-90 | O | 31-Dec-08 | 0 | O |
7 | ALIE | Alien | LV | C | M | KATH | Y | 2-Jan-96 | 2-Jan-96 | 2-Jan-96 | N | 15-Jan-96 | B | 20-Feb-04 | 0.04 | P |
7 | MAYO | Mayo | LV | C | F | KATH | N | 2-May-98 | 2-May-98 | 2-May-98 | N | 2-May-98 | B | 15-Jul-04 | 0 | D |
7 | NOSE | Nose | null | null | M | null | U | 1-Jan-83 | 1-Jan-81 | 31-Dec-84 | U | 15-Jan-93 | I | 16-Sep-07 | 0.04 | P |
7 | SUND | Sundance | null | null | M | null | U | 1-Jan-83 | 1-Jan-81 | 31-Dec-84 | U | 15-Feb-93 | I | 15-Sep-99 | 0.08 | E |
7 | DARK | Dark | null | null | F | null | U | 1-Jan-87 | 1-Jan-86 | 1-Jan-88 | N | 15-Jan-97 | I | 27-May-98 | 0.08 | P |
7 | TRIC | Trickle | null | null | M | null | U | 1-Jan-89 | 2-Jan-88 | 1-Jan-90 | N | 15-Dec-96 | O | 9-Nov-02 | 0.12 | P |
7 | WEIR | Weirdo | null | null | M | null | U | 1-Jan-94 | 2-Jan-92 | 1-Jan-96 | U | 15-Mar-04 | I | 31-Dec-08 | 0 | O |
7 | CARM | Carmen | LV | C | F | SPLO | N | 1-Jan-89 | 1-Oct-88 | 2-Apr-89 | N | 25-Mar-90 | O | 15-Jul-96 | 0.21 | D |
The rows in this table represent a subset of data from PLHD Biographhy, and were selected to illustrate the range of variation in entries. For example, we show cases in which Birthdate is known exactly (e.g., StudyId=1, AnimID=BRAH) or has a wide span due to different factors such as the researcher's inability to estimate Birthdate more precisely for an adult female who was present when the study began (e.g., StudyId=1, AnimID=BS) or because the mother was rarely seen (e.g., StudyID=4, AnimID=JIMI). Data are sorted here by StudyID, then MomID, then Birthdate, as described in the text.
Table 2.
Sample data from the PLHD Fertility (also available live at http://demo.plhdb.org). 1
StudyId | AnimId | Start Date | Start Type | Stop Date | Stop Type |
---|---|---|---|---|---|
1 | BM | 17-Apr-06 | B | 17-Dec-08 | O |
1 | BR | 25-Jun-83 | O | 16-Jul-84 | O |
1 | BR | 28-Jun-86 | C | 17-Dec-08 | O |
1 | BRAH | 14-Aug-93 | B | 26-Jan-99 | E |
1 | BRE | 29-May-99 | B | 10-Apr-02 | D |
1 | BRIS | 20-Sep-89 | B | 13-Nov-95 | E |
1 | BRN | 20-Jul-02 | B | 20-Apr-04 | D |
1 | NY | 25-Jun-83 | O | 16-Jul-84 | O |
1 | NY | 28-Jun-86 | C | 17-Dec-08 | O |
2 | ALT | 1-Aug-71 | O | 21-May-76 | D |
2 | DOT | 21-Jun-73 | B | 31-Dec-89 | O |
2 | DOT | 1-Jan-96 | O | 25-Feb-01 | D |
2 | DUD | 5-Jul-83 | B | 31-Dec-89 | O |
2 | DUD | 8-Jun-90 | O | 5-Jul-90 | O |
2 | DUD | 2-Jan-95 | O | 17-Jan-95 | O |
2 | DUD | 1-Jan-96 | O | 18-Jun-05 | D |
2 | NUT | 17-Aug-95 | B | 26-Dec-06 | O |
2 | PRU | 31-Jan-82 | B | 3-Jul-04 | D |
3 | Ambo | 8-Feb-05 | B | 28-Nov-06 | D |
3 | Blaz | 8-Jun-97 | O | 31-Dec-08 | O |
3 | Diam | 8-Jun-97 | O | 31-Dec-08 | O |
3 | Rose | 25-Jan-80 | C | 11-Apr-81 | O |
4 | AQ | 21-Apr-92 | B | 25-Jun-03 | D |
4 | DM | 15-Nov-72 | B | 31-Jan-92 | E |
4 | FLO | 15-May-63 | C | 21-Aug-72 | D |
4 | JO | 23-Jul-80 | I | 11-Feb-81 | O |
4 | JO | 17-Nov-81 | C | 25-Mar-84 | O |
4 | JO | 11-Sep-85 | C | 23-Sep-85 | P |
4 | MB | 15-Aug-63 | C | 19-Sep-75 | D |
4 | SW | 15-Sep-71 | I | 31-Dec-08 | O |
5 | AFR | 30-Apr-00 | B | 31-Dec-08 | O |
5 | MAG | 30-Jun-80 | B | 17-Jun-97 | O |
5 | MAG | 29-Sep-98 | O | 31-Dec-08 | O |
6 | 80 | 15-Jul-85 | B | 15-Sep-08 | D |
6 | 86 | 15-Jul-85 | B | 15-Dec-08 | O |
7 | CARM | 25-Mar-90 | O | 1-Jul-91 | O |
7 | CARM | 1-Feb-92 | O | 1-Oct-95 | O |
7 | CARM | 1-Dec-95 | O | 15-Jul-96 | D |
7 | CT-- | 2-Aug-99 | B | 1-Oct-99 | O |
7 | CT-- | 1-Jan-00 | O | 1-Aug-00 | O |
7 | CT-- | 1-Jan-01 | O | 1-Sep-04 | O |
7 | CT-- | 1-Jan-04 | O | 31-Dec-08 | O |
7 | DARK | 15-Jan-97 | I | 1-Aug-97 | O |
7 | DARK | 1-Jan-98 | O | 27-May-98 | P |
7 | KATH | 25-Mar-90 | O | 1-Jul-91 | O |
7 | KATH | 1-Feb-92 | O | 1-Oct-95 | O |
7 | KATH | 1-Dec-95 | O | 1-Aug-96 | O |
7 | KATH | 1-Dec-96 | O | 1-Aug-97 | O |
7 | KATH | 1-Jan-98 | O | 1-Oct-99 | O |
7 | KATH | 1-Jan-00 | O | 1-Aug-00 | O |
7 | KATH | 1-Jan-01 | O | 1-Sep-04 | O |
7 | KATH | 1-Jan-05 | O | 31-Dec-08 | O |
7 | MAYO | 2-May-98 | B | 1-Oct-99 | O |
7 | MAYO | 1-Jan-00 | O | 1-Aug-00 | O |
7 | MAYO | 1-Jan-01 | O | 15-Jul-04 | D |
The rows in this table represent a subset of data from PLHD Fertility, and were selected to illustrate the range of variation in entries. For example, we show cases in which a female’s fertility was monitored from her birth to death without interruptions (e.g., StudyId=2, AnimID=PRU) or with interruptions (e.g., StudyId=7, AnimID=MAYO).
Age at first reproduction
Determining a female’s age at first reproduction is facilitated by the “First Born,” “Mom ID,” and “StudyID” columns in Biography (Table 1). We first pull out the first-born offspring (indicated by “Y” in “First Born”) for each mother for whom this record exists, then find the mother’s date of birth by searching for her entry in Biography, and finally compute her age as the difference between the birth date of her firstborn offspring and her own birth date. For example, we can see that AnimID=BRAH in StudyID=1 (born on 14-Aug-1993) was 3292 days (9.01 years) old when her firstborn offspring, AnimID=BRL-J, was born (on 19-Aug-2002). Note that age at first reproduction can be determined entirely from data in Biography, without reference to Fertility. In this example, the birthdates of both BRAH and BRL-J were known to within 0–2 days, as indicated by BDMin and BDMax. Including the ranges of possible birthdates in the database permits researchers to evaluate whether or not to include all individuals in particular analyses.
Lifetime reproductive success
One life history component we would often like to know is a female’s lifetime reproductive success. We can easily determine all known live-born offspring of a female by searching for all entries for that female in the “Mom ID” column of Biography. But for those offspring to represent all of the female’s offspring requires that she be born and die during the study and that her fertility be observed throughout her entire lifetime. This will not be true if the female’s reproductive period: 1) was right-censored (i.e., observation of her reproduction ended before she died); 2) was left-censored (i.e., the beginning portion of her reproductively mature period was not observed); or 3) includes intermediate gaps.
Right-censoring of reproduction occurs for animals still alive at the most recent census date (indicated by a DepartType of “O” and a Depart Date at the most recent census date for a study), such as AnimID=BR in Study 1 or MAG in Study 5, who may still give birth to more offspring in the future. Left-censoring of reproduction occurs for females who were present at the beginning of the study and were judged to have been old enough at that time that they might have given birth to offspring before the study began. One example is AnimID=Rose in Study 3, whose “Start Type” in Fertility is “C”. Another example is AnimID=FLO in Study 4. None of FLO’s five offspring in Biography are listed as her firstborn because it could not be determined whether she had given birth prior to her entry into the study. Note that FLO has a wide range of possible birth dates, as is frequently true of individuals such as FLO, who entered the study as an adult with confirmed AnimID and Entrytype=C, and of individuals, such as AnimID=DARK in Study 7, who entered the study by immigration (Entrytype=I).
Finally, lifetime reproductive success cannot be determined with certainty for females with gaps during which their fertility was not observed, as indicated by multiple entries for a female in Fertility (for example, AnimID=KATH in Study 7). An example of a female whose entire reproductive output is captured in the database is AnimID=80 in Study 6, who was born and died during the study, has an identified firstborn (80-1), and has a single entry in Fertility that begins with her birth and ends with her death (Table 2).
Interbirth interval
Like lifetime reproductive success, determining the interval between successive births requires information from both Biography and Fertility. We first sort Biography by “Study ID”, “Mom ID”, and “Birth Date”, in that order. All of the recorded offspring of a female will now appear in birth order as a group of successive rows in Biography with the same entry in the “Mom ID” column. But to be sure that adjacent rows represent successive siblings, we must first check to see that the two offspring were born in the same fertility interval for the mother (otherwise, additional offspring might have been born during a period when the mother’s fertility was not being observed, and thus be missing from Biography). We determine this by searching over all rows for the mother (by her AnimID) in Fertility, checking to see if the birthdates of both offspring are after the “Start Date” and before the “Stop Date” of the same fertility interval. If so, then the interbirth interval is simply the difference between the birth dates of the two (now confirmed to be successive) offspring. An example of two successive offspring are BRS and BRE from Study 1, who were born during their mother’s (BR’s) second fertility interval (Table 2). The interval between their births is 1056 days or 2.89 years. In contrast, we cannot reliably compute an interbirth interval using the birth dates of DRO and DEL from Study 2, even though they are the two offspring of DUD with the closest birth dates in Biography, because they were not born during the same fertility interval for DUD (DRO was born in DUD’s first interval in Fertility, but DEL was born during a period when DUD’s fertility was not being intensively monitored; that is, it does not fall into any of DUD’s fertility intervals in Fertility).
Discussion
The major strength of the PLHD resides in the high quality data that result from the development of the common vocabulary for the various data types, and the consequent standardization of variable data from multiple long-term field studies. The result is a truly comparative database, in which terms are defined by common criteria across disparate species and studies. Comparative databases with well-defined common vocabularies are now well-developed and heavily used in genomics research, and these often represent large-scale collaborative efforts. However, such collaborative efforts to develop common vocabularies and shared databases are relatively unusual for studies of life history and behavior (Nelson 2009). A common vocabulary and standardization are necessary for comparative analyses that focus on questions pertaining to the actual variation in primate life histories instead of on the potential sources of error that can arise when divergent datasets without such stringent standardization are compared.
The design of the PLHD facilitates routine updates and management of the data that populate the current database. Currently, our Working Group members have agreed that we will notify the rest of the group whenever we update our data, which we can do at any time although annual updates are probably most useful. The Departdate associated with any animal for which DepartType=O corresponds to the last date on which data for that individual were updated, making it easy to keep track of updates.
The PLHD also has the potential to expand with comparable life history data from additional studies over time, provided that the data are individual-based and can conform to the common vocabulary that we have developed. For example, the criteria we established for the continuity of observations in Fertility may be prohibitive for researchers whose data rely almost exclusively on annual censuses, unless the study species are exclusively and narrowly seasonal breeders, as is the case for the sifaka in our database. Nonetheless, researchers working on other populations or taxa may find our Biography view to be a model for organizing data. The minimal criteria for conforming to the model are identifiable individuals censused repeatedly in a study population. Even data collected during single annual censuses can conform to this model.
The structure of both Fertility and Biography can be adapted with some minor adjustments to address different kinds of questions for different kinds of animals. For example, Fertility is designed to identify gaps in observations or other circumstances that affect the probability of detecting an event during a particular time period for a particular animal. In demographic studies, these will usually be fertility events, but the general approach could be extended to other types of events. Similarly, although the structure of Biography is best suited for species that produce a single young with each birth, species that routinely produce litters can be accommodated by assigning each individual a separate row, similar to our treatment of the occasional cases of twins in the PLHD. Among animals that rear their young in crèches or dens, the number of live births may not be known and the closest equivalent to our criterion of “live birth” for inclusion in the database might be “emerging young.” Communal rearing could present a greater challenge if mother-offspring relationships cannot be assigned as reliably as they can for animals that typically produce single offspring. Additional columns could be included to differentiate individuals within and between litters in these cases.
The creation of the PLHD represents an essential positive response to the increasingly important challenge of developing collaborative models of data sharing. Such models must encourage researchers to share their data with others in a manner that enhances scientific progress, but at the same time protects the researchers’ interests and their ability to continue to obtain funding for their research. This is particularly important in the case of long-term field data that require decades to collect. For these types of data, continued funding (typically awarded in 3–5 year increments at most) depends heavily upon the researchers’ ability to argue for the novelty and uniqueness of the hypotheses they will be able to test (and hence on their ability to restrict access to their unpublished data). Thus, two important components of promoting a “culture” of collaboration between data producers and data users, (e.g., The Toronto Statement; Toronto International Data Release Workshop 2009) will be (1) recognizing that it will be important for data producers to maintain some control over access to the data they produce, and (2) commitments on the part of funding agencies to both data producers and data users to provide long-term support of the databases themselves.
The longitudinal ecological data that comprise the PLHD have taken decades to accumulate. The PLHD provides a secure repository for the preservation and management of these irreplaceable data. Preserving these data for posterity is not only important for endangered species, but also for all populations whose ecosystems are under increasing pressures from encroaching human activities and are being altered by global climate change.
Supplementary Material
Acknowledgments
We are grateful to both the National Evolutionary Synthesis Center (NESCent) and the National Center for Ecological Analysis and Synthesis (NCEAS) for jointly funding our project on the Evolutionary Ecology of Primate Life Histories, and for hosting additional meetings of our working group to refine and work with the PLHD in January 2009 and November 2009, respectively. We also thank all of the government and funding agencies that have provided permissions and financial support for our field studies, and the many students, colleagues, and field assistants and data technicians who have contributed to the collection and management of the long-term data now preserved in the PLHD. Study-specific acknowledgments can be found at http://demo.plhdb.org. We appreciate the comments of anonymous reviewers on the first version of this manuscript.
References
- Arzberger P, Schroeder P, Beaulieu A, Bowker G, Casey K, Laaksonen L, Moorman D, Uhlir P, Wouters P. An international framework to promote access to data. Science. 2004;303:1777–1778. doi: 10.1126/science.1095958. [DOI] [PubMed] [Google Scholar]
- Cook RB, Olson RJ, Kanciruk P, Hook LA. Best practices for preparing ecological data sets to share and archive. Bulletin of the Ecological Society of America. 2000;82:138–141. [Google Scholar]
- Cords M, Chowdhury S. Life history of blue monkeys (Cercopithecus mitis stuhlmanni) in the Kakamega Forest, Kenya. International Journal of Primatology. (In press) [Google Scholar]
- Date CJ. An Introduction to Database Systems. 8th ed. Reading, MA: Addison-Wesley; 2004. [Google Scholar]
- Ellison AM, Osterweil LJ, Clarke L, Hadley JL, Wise A, Boose E, Foster DR, Hanson A, Jensen D, Kuzeja P, Riseman E, Schultz H. Analytic webs support the synthesis of ecological data sets. Ecology. 2006;87:1345–1358. doi: 10.1890/0012-9658(2006)87[1345:awstso]2.0.co;2. [DOI] [PubMed] [Google Scholar]
- Even A, Shankaranarayanan G, Watts S. Enhancing decision making with process metadata: theoretical framework, research tool, and exploratory examination. hicss; Proceedings of the 39th Annual Hawaii International Conference on System Sciences; 2006. [accessed 27 December 2009]. p. 209a. (HICSS'06) Track 8. URL http://www2.computer.org/portal/web/csdl/doi/10.1109/HICSS.2006.152. [Google Scholar]
- Goodall J. The Chimpanzees of Gombe: Patterns of Behavior. Cambridge, MA: Belknap Press; 1986. [Google Scholar]
- Jones OR, Clutton-Brock T, Coulson T, Godfray HCJ. A web resource for the UK’s long-term individual based time-series (LITS) data. Journal of Animal Ecology. 2008;77:612–615. doi: 10.1111/j.1365-2656.2008.01382.x. [DOI] [PubMed] [Google Scholar]
- Kent W. A simple guide to five normal forms in relational database theory. Communications of the Association for Computing Machinery. 1983;26:120–125. [Google Scholar]
- Michener WK. Meta-information concepts for ecological data management. Ecological Informatics. 2006;1:3–7. [Google Scholar]
- Mudakikwa AB, Cranfield MR, Sleeman JM, Eilenberger U. Clinical medicine, preventive health care and research on mountain gorillas in the Virunga Volcanoes region. In: Robbins MM, Sicotte P, Stewart KJ, editors. Mountain Gorillas: Three Decades of Research at Karisoke. Cambridge: Cambridge University Press; 2001. pp. 341–360. [Google Scholar]
- Nelson B. Data sharing: empty archives. Nature. 2009;461:160–163. doi: 10.1038/461160a. [DOI] [PubMed] [Google Scholar]
- Nogueira C, Carvalho AR, Oliveira L, Veado EM, Strier KB. Recovery and release of an infant muriqui, Brachyteles arachnoides, at the Caratinga Biological Station, Minas Gerais, Brazil. Neotropical Primates. 1994;2:3–5. [Google Scholar]
- Parr CS, Cummings MP. Data sharing in ecology and evolution. Trends in Ecology and Evolution. 2005;20:362–363. doi: 10.1016/j.tree.2005.04.023. [DOI] [PubMed] [Google Scholar]
- Piwowar HA, Becich MJ, Bilofsky H, Crowley RS. Towards a data sharing culture: recommendations for leadership from academic health centers. PLoS Medicine. 2008;5(9):e183. doi: 10.1371/journal.pmed.0050183. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Pusey AE, Wilson MW, Collins DA. Human impacts, disease risk, and population dynamics in the chimpanzees of Gombe National Park, Tanzania. American Journal of Primatology. 2008;70:738–744. doi: 10.1002/ajp.20567. [DOI] [PubMed] [Google Scholar]
- Schofield PN, Bubela T, Weaver T, Portilla L, Brown SD, Hancock JM, Einhorn D, Tocchini-Valentini G, Hrabe de Angelis M, Rosenthal N. CASIMIR Rome Meeting participants. (2009) Post-publication sharing of data and tools. Nature. 461:171–173. doi: 10.1038/461171a. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Strier KB, Alberts S, Wright PC, Altmann J, Zeitlyn D. Primate life-history databank: setting the agenda. Evolutionary Anthropology. 2006;15:44–46. [Google Scholar]
- Toronto International Data Release Workshop. Prepublication data sharing. Nature. 2009;461:168–170. doi: 10.1038/461168a. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wrangham RW. Artificial feeding of chimpanzees and baboons in their natural habitat. Animal Behaviour. 1974;22:83–93. [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.