Skip to main content
[Preprint]. 2024 Apr 27:2024.04.25.24306380. [Version 1] doi: 10.1101/2024.04.25.24306380

Table 3:

Examples of relevant note text and manual annotation labels compared with GPT-4 and GPT-3.5 and relevant justification.

Manual Annotation GPT-4 Label GPT-3.5 Label Text selected from longer note by human abstractor Justification GPT-4 Justification GPT-3.5
Current instability Current instability Current instability She has been under a great deal of stress over the past year and recently became homeless. She and her boyfriend have moved to this area where she has family where she is now staying. The patient note mentions that the patient recently became homeless, indicating current housing instability. The patient is now staying with family, but this is likely a temporary arrangement given the recent homelessness and the reference to a halfway house, which is a form of transitional housing. There is no evidence in the note to suggest a history of housing instability prior to the current situation. The evidence shows that the patient recently became homeless and is currently facing housing instability. The patient’s history of frequent kidney stones and recent surgeries for kidney stones further suggests a lack of stable housing.
Current instability Past instability Current instability She was having many stressors at that time which included being kicked out of her mothers house and staying with ex BF The patient note mentions that the patient was kicked out of her mother’s house and was staying with her exboyfriend. This indicates a past instance of housing instability. However, the note does not provide current information about the patient’s housing situation, so it is unknown whether the patient is currently stably housed or not. The patient note mentions that the patient was kicked out of her mother’s house and was staying with her exboyfriend, which indicates current housing instability. Additionally, the patient’s active problem list includes depression, which can be associated with housing instability. However, there is no explicit evidence or mention of past housing instability, so it is unknown if the patient has a history of housing instability.
Current instability Current instability No housing noted, Current instability unknown She said she is staying at a motel The patient note mentions that the patient is currently staying at a motel, which indicates a form of housing instability. There is no evidence in the note to suggest that the patient has faced housing instability in the past. There is no explicit evidence or mention of the patient’s housing status in the note. The patient mentions staying at a motel, but it is unclear if this is a temporary situation or a stable housing arrangement. Therefore, the current housing stability is unknown.
Current instability Stably housed Current instability Pt reports she is living w/[redacted]; they are renting a house from [redacted]; he is a meth dealer. [Bf] has made arrangements to get them into a new living situation. She is very happy about this. The patient is currently living with [redacted], in a house they are renting. There is no evidence of housing instability at the moment. The boyfriend has made arrangements for a new living situation, which the patient is happy about. There is no mention of past housing instability. The evidence from the patient note indicates that [the patient] is currently facing housing instability. She is living in a rented house with [redacted], but the house is owned by [redacted] who is a meth dealer. Additionally, the note mentions that [the patient] is in the process of moving to [recacted] and has been applying for jobs. This indicates that her current housing situation is unstable. There is no evidence of past housing instability mentioned in the note.
Unknown Current instability Stably housed States lots of changes lately. Was in domestic violence. Daughters are [redacted] and living with parents for now. The patient note mentions that the patient’s daughters are currently living with her parents, which suggests that the patient is temporarily staying with family members. This is an indication of current housing instability. There is no evidence in the note to suggest a history of housing instability. The patient’s housing status is noted in the evidence. The patient is currently stably housed as she is living with her parents. There is no evidence of current or past housing instability.

Note: Certain sections of note text and evidence from GPT have been removed to protect patient privacy.