Table 1.

Annotation Guidelines

Symptom	Positive Examples	Negative Examples	Ambiguous Cases
Chest Pain or Discomfort	Chest: pain, pressure, tightness, ache, discomfort, heaviness, sitting on, burning, something not quite right Described as: sharp, dull, severe, mild, stabbing Acronyms: cp, sscp	any negation of a positive	The patient has had two episodes of chest pain in the past month. Patient denies chest pain today. → positive
Substernal CP	CP location: substernal, sternal, central, center, middle, left, anterior, precordial, epigastric, across CP quality that implies location: pressure, tightness, heaviness, sitting on, radiates to the left arm/shoulder Acronyms: sscp, ssc, ss, l, l ant	right anterior, right, another body part only (shoulder, neck, arm, jaw, leg)
CP Provoked by Exertion or Emotional Stress	Provocation: exertion, stress, walking, running, stairs, shoveling, mowing lawn, not specifically deemed negative	(w/out, w. out, without) positive OR (at/while) rest, laying down, night, sitting, standing up, washing dishes	with rest and exertion → positive
CP Relieved by Rest or Nitroglycerin	Palliation: rest, stopping, sitting, laying down, taking a few breaths	positive with time modifier that is excessively long (e.g. > 1hr)	relieved by rest or continuing to walk → positive
Shortness of Breath	Synonyms: shortness of breath, sob, dyspnea, any mention of breathing difficulty Acronym: sob	any negation of a positive
Dyspnea on Exertion	Defined with respect to dyspnea as exertional chest pain is defined with respect to chest pain. Acronym: doe