Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2014 May 8.
Published in final edited form as: Hepatology. 2011 Jul;54(1):344–353. doi: 10.1002/hep.24376

ENDPOINTS AND CLINICAL TRIAL DESIGN FOR NONALCOHOLIC STEATOHEPATITIS

Arun J Sanyal 1, Elizabeth M Brunt 2, David E Kleiner 3, Kris Kowdley 4, Naga Chalasani 5, Joel Lavine 6, Vlad Ratziu 7, Arthur McCullough 8
PMCID: PMC4014460  NIHMSID: NIHMS289374  PMID: 21520200

Abstract

Nonalcoholic fatty liver disease (NAFLD) is a common cause of chronic liver disease in the general population. Nonalcoholic steatohepatitis (NASH), the aggressive form of NAFLD, is associated with an increased risk of liver-related mortality and cardiovascular disease. Currently, a liver biopsy is the only generally acceptable method for the diagnosis of NASH and to assess its progression towards cirrhosis. While several treatments have shown evidence of efficacy in clinical trials of varying design, there are no approved treatments for NASH and published trials are often too divergent to allow meaningful comparisons. There is thus a lack of established non-invasive, point of care diagnostics and approved treatment on one hand and a substantial population burden of disease on the other. These provide the rationale to develop consensus on key endpoints and clinical trial design for NASH. This paper summarizes the consensus arrived at a meeting of the American Association for Study of Liver Diseases on the key endpoints and specific trial design issues that are germane for development of diagnostic biomarkers and treatment trials for NASH.

Keywords: nonalcoholic steatohepatitis, nonalcoholic fatty liver, cirrhosis, metabolic syndrome, insulin resistance, type 2 diabetes mellitus, steatosis, anti-oxidants, biomarkers, liver biopsy

Introduction

Nonalcoholic fatty liver disease (NAFLD) is the most common cause of chronic liver disease in most of the Western world (13). The clinical-histologic phenotype of the disease extends from nonalcoholic fatty liver (NAFL) to nonalcoholic steatohepatitis (NASH). NASH can progress to cirrhosis (4) and is also associated with an increased risk of cardiovascular mortality and type 2 diabetes mellitus (5, 6). Cirrhosis due to NASH increases the risk of hepatocellular carcinoma and NASH contributes substantially to the population burden of hepatocellular cancer (79).

There are many uncertainties in the diagnostic approaches, evaluation and management of NASH. The diagnosis currently requires a liver biopsy which is invasive, somewhat painful and may be associated with life-threatening complications in some individuals (10). Also, while several drugs have shown efficacy in clinical trials of varying design (1113), there are currently no approved therapies for NASH. There is thus a major public health need to develop diagnostic and therapeutic approaches that are widely applicable on one hand and a lack of such modalities on the other.

The American Association for Study of Liver Diseases (AASLD) convened a research workshop in 2009 to discuss the key questions that are critically important for advancement of the field, the specific populations that need to be treated and the goals of treatment for each of these populations. These were the basis for recommendations for trial design and development of endpoints for various types of clinical studies of NASH. Safety related issues and their relevance to trial design and endpoints were also discussed. This report summarizes the discussion and areas of consensus amongst the working group and has been updated to incorporate new data that have been published since this workshop was held. The objective is to provide guidance to investigators and regulators about issues related to clinical trial design and endpoints in clinical trials for NASH. This is not a clinical practice guideline but rather a general guidance document related to best practices in trial design and performance. However, wherever feasible, the level of evidence to support specific recommendations for endpoints is provided using the Grading of recommendations, assessment and evaluation (GRADE) system used for AASLD guidelines (14). In other sections, the best practices in trial design and execution are discussed based on expert opinion.

1. Case Definitions for clinical trials for NAFLD/NASH

A critical need in the field is to use standard nomenclature and uniform case definitions that will allow individual studies to be compared to others and permit meaningful analysis of groups of studies with similar objectives. The common nomenclature recommended for clinical studies are listed below (Table 1):

Table 1.

Diagnostic categories and associated histologic lesions: Pre-fibrotic NAFLD/NASH

Diagnosis Macrovesicular
Steatosis
Hepatocyte
ballooning
Zonality Lobular
Inflammation
Portal Inflammation*
Definite SH + (any degree) + (any degree) Zone 3 accentuation + (any degree) +/− (any degree)
Borderline Zone 3 + (any degree) Zone 3 + +/− (any degree)
Borderline Zone 1 + (any degree) Zone 1 or Panacinar +/− + (common, especially in the panacinar pattern of steatosis)/−
Not SH, with steatosis + (any degree) Any pattern +/− +/−
Not SH, without steatosis N/A +/− +/−

Portal inflammation that is “disproportionately present” compared to lobular lesions may be a harbinger of concurrent liver disease.

Fatty liver

This is defined by > 5% macrovesicular steatosis as evaluated by light microscopic examination of a hematoxylin and eosin stained liver section (4–5 μm thick) under a 10× objective lens.

NAFLD is characterized by predominantly macrovesicular steatosis and the presence of visible steatosis in > 5% of hepatocytes is generally accepted as a working definition of a fatty liver (15). Assessment of steatosis at higher degrees of magnification can lead to a higher estimate of the severity of steatosis and should be avoided.

Steatohepatitis

The minimal criteria for the diagnosis of steatohepatitis include the presence of > 5% macrovesicular steatosis, inflammation and liver cell ballooning, typically with a predominantly centrilobular (acinar zone 3) distribution in adults.

Steatohepatitis is not simply the presence of inflammation and steatosis but is a specific histologic entity as defined above (1518). Steatohepatitis is more likely to lead to cirrhosis than steatosis alone or steatosis with inflammation (19). The presence of Mallory Denk bodies is supportive but not required for the diagnosis of steatohepatitis (15). It is however recognized that some subjects may have an atypical distribution of changes and that children often have a different distribution of histologic findings compared to adults e.g. greater portal-based findings than in adults (20, 21). Based on this, it is recommended that steatohepatitis may be further classified as definite or borderline.

Definite steatohepatitis

This is defined by zone 3 accentuation of macrovesicular steatosis (any grade), hepatocellular ballooning (of any degree) and lobular inflammatory infiltrates (of any amount) (12, 15). Apoptotic bodies are commonly present in definite steatohepatitis. This lesion may or may not include portal inflammation, Mallory-Denk bodies (most often noted within ballooned hepatocytes), nonzonal patches of microvesicular steatosis and megamitochondria (most often noted in hepatocytes with microvesicular steatosis).

Borderline steatohepatitis

Biopsies with this diagnosis do not meet classical criteria for steatohepatitis as the lesions may be predominantly in acinar zone 3, but liver cell ballooning is not classic or is absent, and Mallory-Denk bodies are absent. In the zone 1 borderline pattern, steatosis is either periportal or panacinar; ballooning may be present, but is not classical, and Mallory-Denk bodies are not present. The other findings of definite steatohepatitis may or may not be present to varying degrees, but commonly, portal inflammation and portal fibrosis are present. Lobular inflammation is often less prominent than in definite steatohepatitis. This pattern has been more often seen in pediatric NAFLD (20). It is currently not known if this pattern is associated with a different natural history than those with definite steatohepatitis.

Disease Activity

  • It is recommended that the NAFLD activity score (NAS) be used to define and quantify disease activity

    Grade 1b.

Disease activity refers to the severity of ongoing liver injury as assessed by a liver biopsy. The NAS was developed by the NASH CRN to evaluate disease activity (15). It is based on the NASH CRN methodology for scoring the severity of steatosis (0–3), inflammation (0–3) and hepatocellular ballooning (0–2) (15). It has been shown that scores ≥ 4 are associated with increasing likelihood of having steatohepatitis (15). It is however emphasized that the presence of steatohepatitis can not be inferred from the NAS and requires an overall assessment of the presence and distribution of the individual histologic findings (22). The NAS is sensitive to change and is relatively reproducible (15); this allows it to be measured repeatedly over time in the same subject. It has however not been validated as a marker for likelihood of progression to cirrhosis or mortality.

Stage of disease

  • It is recommended that a validated method for the staging of NASH be used for assessment of changes in disease stage in clinical trials of NASH. The NASH CRN fibrosis staging system is one such system and is the most validated system currently available.

  • A liver biopsy is the recommended method for assessment of disease stage for phase 2 and 3 clinical trials.

This refers to the amount and pattern of fibrosis, as well as parenchymal architectural remodeling, or how far towards cirrhosis the disease has progressed. The NASH CRN fibrosis staging system is widely used and has been validated (15). It differs from other staging systems in that stage 1 is subdivided in to three sub-stages: stages 1a and 1b are zone 3, perisinusoidal and differ only by the character of the collagen deposition (delicate or dense, respectively) and 1c is portal or periportal (to represent the pediatric pattern). Thus, these substages do not represent disease progression, but rather varying degrees or distribution of fibrosis. The use of non-invasive biomarkers or quantitative morphometric methods is considered experimental and a liver biopsy is recommended for staging NASH at this time. This is discussed in greater detail in subsequent sections.

Additional recommendations for the histologic categorization of NAFLD (Table 2)

Table 2.

Best practices for histologic assessment of endpoints in NASH

2. Biopsy technique:
  • -

    Needle core biopsy preferred

  • -

    Biopsy should be obtained with a 16 or lower gauge needle

  • -

    A ≥ 2 cm long tissue core (≥ 10 portal tracts) represents optimal biopsy length

  • -

    Preferably obtain biopsy from right lobe. If left lobe biopsy used for entry, a left lobe biopsy should be used at end of study

3. Histologic technique:
  • -

    Use hematoxylin and eosin stain

  • -

    Use Masson trichrome stain for fibrosis assessment

  • -

    Central staining is ideal to minimize laboratory variability but may not be optimal

  • -

    Role of special stains and quantitative morphometry to assess fibrosis remain experimental

4. Review procedures:
  • -

    Use central review with at least 2 pathologists

  • -

    The same section used to assess eligibility should be used for final analysis

  • -

    Histological assessment should record-histologic phenotype (fatty liver, definite steatohepatitis etc), presence and severity of individual parameters (NASH CRN scoring system preferred), disease activity (NAS) and fibrosis stage. Portal inflammation should be scored separately from lobular inflammation

The quality of the histologic data obtained is affected by several factors such as the manner of procurement (intra-operative techniques may induce inflammation), the type of biopsy (needle core vs wedge) biopsy location, dimensions of the biopsy core and the inherent variability in the subjective assessment of liver histology (15, 23, 24). Ideally, a 2–3 cm core (with 10 evaluable portal tracts) of at least 16 gauge diameter from the right lobe should be obtained percutaneously to minimize such technical problems with histologic analysis of NASH (10, 25). Biopsies < 5 mm are discouraged and should not be considered for inclusion in trials. Given the intra- and inter-rater variability in assessment of liver biopsies (15, 23), a blinded central review of the liver biopsies by more than one pathologist is ideal. In the PIVENS trial, the sections used to assess eligibility and those used for the final analysis of the data were different and 17–26% of subjects failed to meet entry criteria based on central review of independent sections from the baseline biopsy used for the final analysis (12). It is therefore recommended that the sections used for assessment of eligibility be used for the baseline data for assessing the impact of treatment.

How to establish the non-alcoholic nature of the disease

  • A validated questionnaire to quantify and document the amount of alcohol consumption should be used in the context of clinical trials. (Recommendation can not be graded for evidence)

  • The alcohol consumption thresholds to define the “nonalcoholic” nature of the steatohepatitis include < 21 units of alcohol per week for men and 14 units of alcohol per week for women over a two year time frame prior to the baseline biopsy used to determine eligibility for a clinical trial (Grade 2b)

One drink "unit" or one standard drink is equivalent to a 12 ounce beer, a 4 ounce glass of wine, or a 1 ounce shot of hard liquor. There is a paucity of data to support one specific cutoff versus others and the recommendations are based on the rarity of clinically significant liver injury from alcohol intake at such levels (26). There are conflicting reports of the impact of small amounts of alcohol consumption on NASH-related outcomes (8, 27). Given the possibility that small amounts of alcohol intake may affect outcomes in NAFLD, the amount and pattern of alcohol consumption during the trial should be documented using established and validated questionnaires which are already available (2830).

2. Subpopulations of NAFLD and the types of studies required in these groups

NAFLD has several clinical-histologic phenotypes that have a varying clinical course. These include NAFL, fatty liver with modest inflammation alone, NASH with none or early stage disease (stage 0–2), NASH with advanced fibrosis or cirrhosis (stages 3–4), cryptogenic cirrhosis, decompensated cirrhosis and recurrent NASH after liver transplantation. These have been reviewed in the literature and will not be discussed at length here (1, 4, 19, 3134). There is broad consensus that the following groups should be targeted for treatment (in order of clinical and public health significance): (1) subjects with the greatest risk of progression to cirrhosis (2) subjects with cirrhosis (3) subjects with recurrent NASH after liver transplant.

2a. Studies in subjects at risk of progression to cirrhosis (Table 3)

Table 3.

Guidance on design and endpoints for clinical trials for NASH

1. Inclusions:
  • -

    presence of steatohepatitis (record definite or borderline)

  • -

    active disease (NAS ≥ 3 or 4)

  • -

    cytologic ballooning score of 1 or greater

  • -

    stratify for diabetes

  • -

    do not include subjects with cirrhosis in clinical trials to define efficacy for prevention of disease progression in subjects at risk of developing cirrhosis i.e. NASH (objectives of treatment in those with cirrhosis is different)

  • -

    Safety studies may include those with cirrhosis

2. Record at baseline and end of study:
  • -

    alcohol consumption (amount consumed in last 2–3 years, pattern of drinking and type of alcohol)

  • -

    dietary history (use a validated questionnaire)

  • -

    history of physical activity (use a validated questionnaire)

  • -

    body mass index

  • -

    waist circumference

  • -

    measures of insulin sensitivity (oral glucose tolerance test with simultaneous insulin measurement is acceptable, snap-shot measures of insulin-glucose relationship such as the homeostatic model are practical but may not be meaningful in diabetic subjects, a fasting insulin level can be used in non-diabetic subjects as a minimum standard)

  • -

    measures of systemic oxidative stress (4-OH nonenal, malonlydialdehyde etc)

  • -

    measure of glycemic control (Hgb A1c)

  • -

    liver enzymes and functions

  • -

    fasting lipid profile

  • -

    exploratory markers for non-invasive assessment of disease status

5. Management of confounders:
  • -

    record levels of alcohol consumption through the study

  • -

    provide practical but uniform diet and physical activity recommendations

  • -

    do not include subjects with > 10 lbs weight gain or loss in last 6 months

  • -

    do not include subjects who have undergone bariatric surgery in last 5 years

  • -

    include subjects on stable dose of hypolididemic drugs (if they are taking any) in trials

  • -

    include subjects with Hgb A1c ≤ 9 for diabetic subjects

  • -

    Avoid those taking drugs known to have potential activity against NASH prior to entry in to study

  • -

    Monitor all medication intake

6. Duration of study:
  • -

    12 months for those with histology as primary endpoint

  • -

    < 6 months duration may be reasonable for early phase proof of concept studies where tolerability of drug is the main objective of trial along with some evidence of efficacy.

  • -

    At least 12–24 months where fibrosis is considered a key endpoint

  • -

    Follow for at least 6 months after drug discontinuation to assess durability of response

  • Primary endpoint for treatment trials:
    • -
      Resolution of steatohepatitis with no worsening of fibrosis (Grade 1b)
    • -
      a minimum of 2 point improvement in NAS with at least one point improvement in more than one category and no worsening of fibrosis (Grade 2b).
    • -
      Improvement in steatosis by MR spectroscopy along with sustained improvement in ALT (for short-term phase 1 and 2 trials where a follow up biopsy is not practical) (Grade 2b).
  • Secondary endpoints for treatment trials (Evidence grade can not be provided for these):
    • -
      Individual histologic parameters
    • -
      Anthropometric measures
    • -
      Changes in insulin sensitivity and oxidative stress
    • -
      Changes in cardiovascular risk profile
    • -
      Quality of life
    • -
      Economic endpoints

The primary objective of treatment of NASH is to prevent liver-related mortality. Liver-related mortality is due mainly to the development of cirrhosis which takes ten to twenty years to develop (4). It is impractical to perform studies over this duration to identify treatment benefits due to the logistics of performing such studies. This necessitates the use of surrogate measures of avoidance of cirrhosis and thus liver-related mortality.

The hallmark of disease progression to cirrhosis is increasing fibrosis i.e. the disease stage. Other markers of risk of development of fibrosis include increasing age, BMI and type 2 diabetes mellitus (35). Also, subjects with steatohepatitis are more likely to develop cirrhosis and experience liver-related mortality than those with fatty liver alone or steatosis and inflamamtion (4, 19). Therefore, reversal of steatohepatitis with no worsening of fibrosis or actual improvement in fibrosis is a reasonable surrogate for prevention of cirrhosis and liver-related death. It follows that subjects with steatohepatitis, stratified for diabetes and including at least a subset with enough fibrosis to allow reliable assessment of change, should be enrolled in pivotal trials to demonstrate a decreased risk of development of cirrhosis. For obvious reasons, subjects with cirrhosis should not be included in such trials. A NAS ≥ 4 is another frequently used inclusion criterion. It allows assessment of change in the individual features of steatohepatitis. The predictive value of NAS for development of cirrhosis or liver-related mortality has not however been experimentally verified. Thus, a NAS alone should not be the sole inclusion criterion for inclusion in clinical trials. When used, it should be in conjunction with the histologic diagnosis of steatohepatitis.

The optimum duration of phase 2b and 3 trials remains under debate. Several clinical trials have shown that reversal of steatohepatitis and the individual features of steatohepatitis can improve as early as 6–12 months (36, 37). Fibrosis progresses slowly over years; conversely, it is generally believed that clinically significant improvement in fibrosis also takes longer than other features of NASH. While some studies performed for 2 years have failed to show improvement in fibrosis (12), this may reflect lack of activity of a given drug rather than a problem with duration of study. It is therefore recommended that trials that hope to demonstrate improvement in fibrosis should be at least of 1–2 years in duration. Also, subjects should be followed for 6 months after drug discontinuation to define the “off-response”.

The primary endpoint should be measurable, sensitive to change, clinically meaningful and be able to be quantified consistently. Given the relevance of steatohepatitis and fibrosis for the risk of developing cirrhosis which drives liver-related mortality (4, 19), reversal of steatohepatitis with at least no worsening of fibrosis should be considered as primary endpoints of clinical trials. It is worth noting that while steatohepatitis is more commonly associated with cirrhosis compared to fatty liver alone, it has not been experimentally verified that reversal of steatohepatitis prevents cirrhosis.

The NAS was developed as a measurable system which was also sensitive to change (15). It is not known how much improvement in NAS reflects a clinically significant decrease in the risk of developing cirrhosis or liver-related mortality. Also, the potential impact of improvement of various components of NAS e.g. steatosis versus inflammation on the risk of developing cirrhosis is unknown. With disease progression to cirrhosis, active lesions of steatohepatitis may also decrease (38, 39). Therefore, if NAS improvement is used as a primary endpoint, a minimum of 2-point improvement with contribution from more than one parameter and no worsening of fibrosis should be used to maximize clinical relevance and robustness of the findings.

For short-term studies (phase 1 and 2a) designed mainly to assess tolerability of new drugs and to look for futility signals to direct decisions regarding further development an improvement of hepatic steatosis by MR spectroscopy and a sustained improvement in AST and ALT may be used as an efficacy endpoint as well.

NASH is closely associated with obesity, dyslipidemia, type 2 diabetes mellitus, and increased cardiovascular morbidity and mortality. It is theoretically possible that specific treatments may have differential effects on NASH and its associated comorbidities. It is therefore important to capture information related to these in the form of secondary endpoints such as the severity of the individual histologic features of steatohepatitis, progression or regression of fibrosis, changes in body weight, body fat content and distribution, measures of insulin resistance and oxidative stress, glycemic indices, lipid profile and enumeration of adverse events. In addition, measures of fatigue and quality of life should be assessed.

2b. Special considerations for trials focused on diabetic subjects with NASH

T2DM poses special challenges for the design of clinical trials in NASH because many drugs used for glycemic control of diabetes are also used for the treatment of NASH. Also, the potential confounding effects of poor glycemic control on the hepatic lesions as well as the impact of changing the dose or type of anti-diabetic drugs are not well established. It is therefore recommended that in trials including diabetic subjects, the diabetes should be at least moderately well controlled (Hemoglobin A1c < 9) and subjects should have been on a stable dose of anti-diabetic medication for at least 3 months prior to entry. It is permissible for subjects to receive metformin, sulfonylureas and/or insulin for glycemic control. During the course of the study, if worsening glycemia requires a change to another agent that could potentially impact histologic outcome, the subjects should be taken out of the study and the frequency of such events noted as a secondary endpoint. Such cases are considered to be treatment failures in an intent-to-treat analysis. It is hoped that randomization will keep the frequency of such events similar in the two arms of the trial. In longer term studies in diabetic subjects, quantification of microalbuminuria, retinal changes and development of symptoms of neuropathy are additional key secondary endpoints.

2c: Clinical trials in subjects with cirrhosis

  • Primary endpoints:
    • -
      2 point increase in Child-Pugh score (Grade 1a)
    • -
      Development of clinical decompensation (ascites, encephalopathy, hepatocellular cancer, variceal hemorrhage) (Grade 1a)
    • -
      Increase in model for end-stage liver disease scores (Grade 1a)

In patients with cirrhosis resulting from NASH, histological progression becomes far less meaningful as an endpoint and the rate of progression to complications and liver failure takes precedence. Subjects with compensated cirrhosis e.g. Child-Pugh class A and B should be included in such trials. There isn’t enough data to make evidence-based recommendations about the MELD score criteria for inclusion and exclusion from clinical trials. It is worth noting though that if the scores are very low (< 10), the likelihood of clinical events in a 1–2 year time frame is low and will affect the sample size. On the other hand, if the MELD score is high (> 18), there will be a lot of clinical events and many subjects may undergo liver transplantation in the course of the trial. The key endpoints in this population include development of portal hypertension (measurement of hepatic venous pressure gradient, imaging or endoscopic findings), worsening Model for End Stage Liver Disease or Child Pugh Turcotte scores and clinical complications of cirrhosis such as variceal hemorrhage, ascites, encephalopathy and hepatocellular carcinoma and mortality. If an agent with the promise of reversal of cirrhosis is studied, the endpoints must be histologically verified and ideally accompanied by demonstrating improvement in the hepatic venous pressure gradient.

2d. Clinical trials in subjects with NASH following liver transplantation

The patient population with NAFLD developing after liver transplant represents a complex group including those in whom the disease is recurrent (based on known NASH pre-transplant) and those where it develops de-novo post transplant (34, 4042) The latter may include individuals with a pre-transplant diagnosis of cryptogenic cirrhosis – widely recognized to represent “burned out” NASH in the majority of patients (34, 42). Prevention of development of steatohepatitis and progression to graft failure are key endpoints in this population. Analysis of such endpoints may be confounded by the presence of the metabolic syndrome, use of specific immunosuppressive drugs, donor characteristics and the recipient’s pre-transplant diagnosis all of which must be accounted for in this population (43). Although the role of specific therapeutic agents remain relatively unexplored, the common presence of metabolic syndrome, overweight and obesity in patients following liver transplantation (44) indicates an urgent need for studies of lifestyle modification in this population with the key endpoints as listed above.

2e. Special considerations in trials involving children

  • Primary endpoints in clinical trials:
    • -
      Reversal of steatohepatitis (definite or borderline vs no steatohepatitis) Grade 1b
    • -
      Improvement in NAS of 2 points without worsening of fibrosis is recommended. Grade 2b.
    • -
      Improvement in hepatic steatosis (with imaging studies e.g. MR spectroscopy) along with persistent normalization of AST and ALT may be considered as an alternate endpoint especially in short-term trials focused on safety and proof of biologic effect (phase 1 and 2a trials).
      Grade 2b.

The assessment of liver histology as the primary endpoint in clinical trials of NASH in children exposes them to two liver biopsies. The histologic spectrum of NAFLD in children is also more variable than in adults (20, 45). Given the asymptomatic nature of the disease in most children with NASH, this poses obvious logistic and practical issues and underscores the need to develop non-invasive markers that can be used to assess outcomes in this population. The status of biomarker development in this population is not sufficiently mature to make recommendations about any specific one. Therefore, in pediatric trials, the entry criteria are still based on histology. Trials in children should assess histologic endpoints because the AST and ALT are not adequate surrogates of histologic activity (46, 47). Histologic endpoints in children are however not as well defined as in adults. Either reversal of steatohepatitis (definite or borderline vs no steatohepatitis) or an improvement in NAS of 2 points, both without worsening of fibrosis is recommended. Improvement in hepatic steatosis (with imaging studies e.g. MR spectroscopy) along with persistent normalization of AST and ALT may be considered as an alternate endpoint especially in early phase studies (phase 1 and 2a). It is however important again to note that this combination has not been studied as a formal biomarker of disease outcome and primarily represents clinical expedience.

3. Managing confounding variables in the course of clinical trials for NASH

Several factors can potentially confound analysis and interpretation of data in clinical trials for NASH. These include the baseline BMI, distribution of fat especially the waist circumference, glycemic control, diet including total calories, saturated fat, carbohydrates, choline and foods of varying glycemic index, physical activity, use of medications for diabetes, dyslipidemia and the amount of alcohol (even when modest) consumed. Some of these can be accounted for in the randomization process and need to be documented. It is also critically important to develop standard practices for diet and physical activities as well rules for the use of concomitant medications. The amount, nature and pattern of alcohol consumed, if any, during the course of the trial should also be documented using established validated questionnaires.

4. Non-invasive markers in clinical trials for NASH (Table 4)

Table 4.

Special considerations for trials on non-invasive biomarkers of disease in NASH

1. Key concepts:
  • -

    Reproducibility of results

  • -

    proper experimental design to protect against bias

  • -

    proper evaluation of algorithms/decision rules

2. Inclusions:
  • -

    include subjects that are relevant to the specific question to be answered

  • -

    include the entire spectrum of disease relevant to the population to be studied

  • -

    avoid having a population skewed towards mild or severe disease

3. Design issues:
  • -

    define populations included and excluded

  • -

    define rules for decision making consider creation of design matrix to evaluate confounders

  • -

    perform and report estimate of generalizable performance characteristics over a range of sampling effort.

4. Reporting standards:
  • -

    provide STARD or other similar documentation standards data

  • -

    provide data to allow independent assessment of diagnostic algorithms (define rules for decisions or provide source codes)

  • -

    provide information on predictive values of specific cutoffs in specific populations

  • -

    provide information on false negative and false positives at levels below and above low and high thresholds respectively

  • -

    provide data on proportion of subjects in the indeterminate range when test is applied to a population with full spectrum of disease

  • -

    provide error report for individual subjects who are misclassified and evaluate in context of design matrix to assess for additional confounders

There is currently considerable interest in the development of non-invasive biomarkers for (1) the diagnosis of NASH, (2) the fibrosis stage and (3) the effect of treatment of NASH. The currently available data on non-invasive markers are not robust enough to replace a liver biopsy for any of these indications. Existing standards for biomarker discovery such as those used by the early detection research network and the National Cancer Institute (http://cabig.nci.nih.gov/) provide guidance on standards for development of biomarkers and should be referred to before designing such studies.

The entry criteria for trials to develop biomarkers will depend on the specific indication a biomarker is being developed for. For example, studies to develop a biomarker for the diagnosis of NASH should include populations where the clinical possibility of NASH is entertained e.g. persistent elevation of liver enzymes without obvious cause etc. Similarly, studies of fibrosis biomarkers should include subjects with all stages of fibrosis to allow meaningful analysis. In all these studies, the biomarker must be compared to well-defined histologic findings. The endpoints should not only include the sensitivity, specificity and the predictive values in a given clinical setting but also the proportion of subjects in the population of interest who would have indeterminate values.

A key issue in the conduct of biomarker discovery studies is the avoidance of bias. Several reports provide guidance on how to avoid bias in such studies (48, 49). The generalizability of the results must be evaluated in rigorously performed independent validation studies in large, well characterized and independent cohorts in a variety of settings. Analogous to the CONSORT statement for clinical trial, the standards for reporting of diagnostic accuracy (STARD) document is recommended for the reporting of clinical trials of the use of non-invasive methods for assessment of disease status in NAFLD (50, 51). The STARD checklist provides guidance on what is to be reported and also offers recommendations on graphical representation of data.

5. Safety-related endpoints in NASH

Excess mortality in subjects with NASH is related to liver-related deaths, cardiovascular disease and non-hepatocellular cancers (3133). An ideal treatment for NASH should be one that that improves not only the liver disease, but also improves the risks of cardiovascular outcomes, development of diabetes and cancers. This is likely to be too high of a goal in the context of clinical trials designed to obtain approval for improvement in liver disease. However, in the context of pivotal trials for NASH, measures of cardiovascular health such as the fasting lipid profile including small density LDL and HDL subclass, carotid intimal thickness and markers of systemic and vascular inflammation e.g. c reactive protein should be measured to provide reassurance that there are no “alarm” signals.

Hepatic steatosis has been shown to be associated with increased susceptibility to endotoxin-mediated liver injury and may modulate sensitivity to acetaminophen-induced injury (52, 53); it is not known if this holds true for other forms of drug-induced liver injury. Recently, the FDA published a position paper that provides guidance to the pharmaceutical industry for the identification of the hepatotoxic potential of a compound in premarketing clinical trials. However NASH patients frequently have spontaneous fluctuations of liver enzymes and these rules may not fully apply in NASH. A proposal for identifying signals of hepatotoxicity and defining rules of discontinuation based on FDA recommendations and the specificities of NASH-induced liver disease is presented in Table 5 (5457).

Table 5.

A proposal for the diagnosis of potential hepatotoxicity in NASH trials

Suspected hepatotoxicity (stopping rules) during clinical trials
  • Increase in serum AST and/or ALT > 3 times the baseline value OR > 500 IU/L (on one reading unless the sample is hemolysed)

  • New onset jaundice (total bilirubin ≥ 3 mg/dl) that is not explained by Gilbert’s or hemolysis, irrespective of other liver biochemistries

  • Increase in serum AST and/or ALT < 3 times the baseline value but associated with symptoms (fatigue, nausea, vomiting)

Signals of hepatotoxic potential from clinical trials
  • An excess of aminotransferase elevations to > 3×baseline values when compared to the control group

  • Marked elevations of aminotransferases to 5×, 10×, or 20× baseline values in the test drug group and not seen (or less frequent) in the control group

  • One or more Hy’s law cases (serum bilirubin >2×ULN in a setting of pure hepatocellular injury with no other explanation) in the test drug group, accompanied by an overall increased incidence of aminotransferase elevations > 3×baseline in the test drug group compared to placebo.

It is likely that drug-drug interactions, off-target toxicity and facilitation of development of neoplasia will be rare events. Standardized definitions of “harms” and “clinical phenotypes” of toxicity would allow safety data from multiple trials to be combined, thus largely expanding the safety database and generating reliable large-scale evidence. It is recommended that robust post marketing surveillance through mechanisms similar to the Sentinel network be used to track rare side effects (58).

In summary, the field of NASH is evolving rapidly. Despite many advances in the understanding of the epidemiology and natural history of the disease and clear evidence that it contributes to the population burden of chronic liver disease, there are yet no approved therapies for this condition. It is hoped that the recommendations here will help both to stimulate additional clinical trials for the treatment of NASH and provide guidance to both regulators and investigators about key inclusion and exclusion criteria and specific endpoints that should be evaluated in the context of such trials.

Acknowledgments

This work was supported by the American Association for Study of Liver Diseases and represents the summary of the 2009 workshop on “Endpoints in Nonalcoholic Steatohepatitis” along with updated information where applicable. This work was also supported, in part, by the Intramural Research Program of the NIH, National Cancer Institute.

REFERENCES

  • 1.Ratziu V, Bellentani S, Cortez-Pinto H, Day C, Marchesini G. A position statement on NAFLD/NASH based on the EASL 2009 special conference. J Hepatol. 53:372–384. doi: 10.1016/j.jhep.2010.04.008. [DOI] [PubMed] [Google Scholar]
  • 2.Szczepaniak LS, Nurenberg P, Leonard D, Browning JD, Reingold JS, Grundy S, Hobbs HH, et al. Magnetic resonance spectroscopy to measure hepatic triglyceride content: prevalence of hepatic steatosis in the general population. Am J Physiol Endocrinol Metab. 2005;288:E462–E468. doi: 10.1152/ajpendo.00064.2004. [DOI] [PubMed] [Google Scholar]
  • 3.Browning JD, Szczepaniak LS, Dobbins R, Nuremberg P, Horton JD, Cohen JC, Grundy SM, et al. Prevalence of hepatic steatosis in an urban population in the United States: impact of ethnicity. Hepatology. 2004;40:1387–1395. doi: 10.1002/hep.20466. [DOI] [PubMed] [Google Scholar]
  • 4.Ekstedt M, Franzen LE, Mathiesen UL, Thorelius L, Holmqvist M, Bodemar G, Kechagias S. Long-term follow-up of patients with NAFLD and elevated liver enzymes. Hepatology. 2006;44:865–873. doi: 10.1002/hep.21327. [DOI] [PubMed] [Google Scholar]
  • 5.Targher G, Day CP, Bonora E. Risk of cardiovascular disease in patients with nonalcoholic fatty liver disease. N Engl J Med. 363:1341–1350. doi: 10.1056/NEJMra0912063. [DOI] [PubMed] [Google Scholar]
  • 6.Targher G, Bertolini L, Poli F, Rodella S, Scala L, Tessari R, Zenari L, et al. Nonalcoholic fatty liver disease and risk of future cardiovascular events among type 2 diabetic patients. Diabetes. 2005;54:3541–3546. doi: 10.2337/diabetes.54.12.3541. [DOI] [PubMed] [Google Scholar]
  • 7.Starley BQ, Calcagno CJ, Harrison SA. Nonalcoholic fatty liver disease and hepatocellular carcinoma: a weighty connection. Hepatology. 51:1820–1832. doi: 10.1002/hep.23594. [DOI] [PubMed] [Google Scholar]
  • 8.Ascha MS, Hanouneh IA, Lopez R, Tamimi TA, Feldstein AF, Zein NN. The incidence and risk factors of hepatocellular carcinoma in patients with nonalcoholic steatohepatitis. Hepatology. doi: 10.1002/hep.23527. [DOI] [PubMed] [Google Scholar]
  • 9.Fontana RJ, Sanyal AJ, Ghany MG, Lee WM, Reid AE, Naishadham D, Everson GT, et al. Factors that Determine the Development and Progression of Gastroesophageal Varices in Patients with Chronic Hepatitis C. Gastroenterology. doi: 10.1053/j.gastro.2010.02.058. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Rockey DC, Caldwell SH, Goodman ZD, Nelson RC, Smith AD. Liver biopsy. Hepatology. 2009;49:1017–1044. doi: 10.1002/hep.22742. [DOI] [PubMed] [Google Scholar]
  • 11.Belfort R, Harrison SA, Brown K, Darland C, Finch J, Hardies J, Balas B, et al. A placebo-controlled trial of pioglitazone in subjects with nonalcoholic steatohepatitis. N Engl J Med. 2006;355:2297–2307. doi: 10.1056/NEJMoa060326. [DOI] [PubMed] [Google Scholar]
  • 12.Sanyal AJ, Chalasani N, Kowdley KV, McCullough A, Diehl AM, Bass NM, Neuschwander-Tetri BA, et al. Pioglitazone, vitamin E, or placebo for nonalcoholic steatohepatitis. N Engl J Med. 362:1675–1685. doi: 10.1056/NEJMoa0907929. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Ratziu V, Charlotte F, Bernhardt C, Giral P, Halbron M, Lenaour G, Hartmann-Heurtier A, et al. Long-term efficacy of rosiglitazone in nonalcoholic steatohepatitis: results of the fatty liver improvement by rosiglitazone therapy (FLIRT 2) extension trial. Hepatology. 51:445–453. doi: 10.1002/hep.23270. [DOI] [PubMed] [Google Scholar]
  • 14.Guyatt GH, Oxman AD, Vist GE, Kunz R, Falck-Ytter Y, Alonso-Coello P, Schunemann HJ. GRADE: an emerging consensus on rating quality of evidence and strength of recommendations. BMJ. 2008;336:924–926. doi: 10.1136/bmj.39489.470347.AD. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Kleiner DE, Brunt EM, Van Natta M, Behling C, Contos MJ, Cummings OW, Ferrell LD, et al. Design and validation of a histological scoring system for nonalcoholic fatty liver disease. Hepatology. 2005;41:1313–1321. doi: 10.1002/hep.20701. [DOI] [PubMed] [Google Scholar]
  • 16.Brunt EM, Janney CG, Di Bisceglie AM, Neuschwander-Tetri BA, Bacon BR. Nonalcoholic steatohepatitis: a proposal for grading and staging the histological lesions. Am J Gastroenterol. 1999;94:2467–2474. doi: 10.1111/j.1572-0241.1999.01377.x. [DOI] [PubMed] [Google Scholar]
  • 17.Ludwig J, Viggiano TR, McGill DB, Oh BJ. Nonalcoholic steatohepatitis: Mayo Clinic experiences with a hitherto unnamed disease. Mayo Clin Proc. 1980;55:434–438. [PubMed] [Google Scholar]
  • 18.Neuschwander-Tetri BA, Caldwell SH. Nonalcoholic steatohepatitis: summary of an AASLD Single Topic Conference. Hepatology. 2003;37:1202–1219. doi: 10.1053/jhep.2003.50193. [DOI] [PubMed] [Google Scholar]
  • 19.Matteoni CA, Younossi ZM, Gramlich T, Boparai N, Liu YC, McCullough AJ. Nonalcoholic fatty liver disease: a spectrum of clinical and pathological severity. Gastroenterology. 1999;116:1413–1419. doi: 10.1016/s0016-5085(99)70506-8. [DOI] [PubMed] [Google Scholar]
  • 20.Schwimmer JB, Behling C, Newbury R, Deutsch R, Nievergelt C, Schork NJ, Lavine JE. Histopathology of pediatric nonalcoholic fatty liver disease. Hepatology. 2005;42:641–649. doi: 10.1002/hep.20842. [DOI] [PubMed] [Google Scholar]
  • 21.Brunt EM. Pathology of nonalcoholic fatty liver disease. Nat Rev Gastroenterol Hepatol. doi: 10.1038/nrgastro.2010.21. [DOI] [PubMed] [Google Scholar]
  • 22.Brunt EM, Kleiner D, Wilson L, Belt P, Neuschwander-Tetri BL NASH CRN. The NAS and the histopatholoic diagnosis of NASH: distinct clinicopathologic meanings. Hepatology. 2010 In press. [Google Scholar]
  • 23.Younossi ZM, Gramlich T, Liu YC, Matteoni C, Petrelli M, Goldblum J, Rybicki L, et al. Nonalcoholic fatty liver disease: assessment of variability in pathologic interpretations. Mod Pathol. 1998;11:560–565. [PubMed] [Google Scholar]
  • 24.Bedossa P, Carrat F. Liver biopsy: the best, not the gold standard. J Hepatol. 2009;50:1–3. doi: 10.1016/j.jhep.2008.10.014. [DOI] [PubMed] [Google Scholar]
  • 25.Larson SP, Bowers SP, Palekar NA, Ward JA, Pulcini JP, Harrison SA. Histopathologic variability between the right and left lobes of the liver in morbidly obese patients undergoing Roux-en-Y bypass. Clin Gastroenterol Hepatol. 2007;5:1329–1332. doi: 10.1016/j.cgh.2007.06.005. [DOI] [PubMed] [Google Scholar]
  • 26.Parrish KM, Dufour MC, Stinson FS, Harford TC. Average daily alcohol consumption during adult life among decedents with and without cirrhosis: the 1986 National Mortality Followback Survey. J Stud Alcohol. 1993;54:450–456. doi: 10.15288/jsa.1993.54.450. [DOI] [PubMed] [Google Scholar]
  • 27.Dunn W, Xu R, Schwimmer JB. Modest wine drinking and decreased prevalence of suspected nonalcoholic fatty liver disease. Hepatology. 2008;47:1947–1954. doi: 10.1002/hep.22292. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Reinert DF, Allen JP. The Alcohol Use Disorders Identification Test (AUDIT): a review of recent research. Alcohol Clin Exp Res. 2002;26:272–279. [PubMed] [Google Scholar]
  • 29.Perula de Torres LA, Fernandez-Garcia JA, Arias-Vega R, Muriel-Palomino M, Marquez-Rebollo E, Ruiz-Moral R. Validation of the AUDIT test for identifying risk consumption and alcohol use disorders in women. Aten Primaria. 2005;36:499–506. doi: 10.1016/S0212-6567(05)70552-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Epstein EE, Labouvie E, McCrady BS, Swingle J, Wern J. Development and validity of drinking pattern classification: binge, episodic, sporadic, and steady drinkers in treatment for alcohol problems. Addict Behav. 2004;29:1745–1761. doi: 10.1016/j.addbeh.2004.03.040. [DOI] [PubMed] [Google Scholar]
  • 31.Adams LA, Lymp JF, St Sauver J, Sanderson SO, Lindor KD, Feldstein A, Angulo P. The natural history of nonalcoholic fatty liver disease: a population-based cohort study. Gastroenterology. 2005;129:113–121. doi: 10.1053/j.gastro.2005.04.014. [DOI] [PubMed] [Google Scholar]
  • 32.Rafiq N, Bai C, Fang Y, Srishord M, McCullough A, Gramlich T, Younossi ZM. Long-term follow-up of patients with nonalcoholic fatty liver. Clin Gastroenterol Hepatol. 2009;7:234–238. doi: 10.1016/j.cgh.2008.11.005. [DOI] [PubMed] [Google Scholar]
  • 33.Sanyal AJ, Banas C, Sargeant C, Luketic VA, Sterling RK, Stravitz RT, Shiffman ML, et al. Similarities and differences in outcomes of cirrhosis due to nonalcoholic steatohepatitis and hepatitis C. Hepatology. 2006;43:682–689. doi: 10.1002/hep.21103. [DOI] [PubMed] [Google Scholar]
  • 34.Contos MJ, Cales W, Sterling RK, Luketic VA, Shiffman ML, Mills AS, Fisher RA, et al. Development of nonalcoholic fatty liver disease after orthotopic liver transplantation for cryptogenic cirrhosis. Liver Transpl. 2001;7:363–373. doi: 10.1053/jlts.2001.23011. [DOI] [PubMed] [Google Scholar]
  • 35.Angulo P, Keach JC, Batts KP, Lindor KD. Independent predictors of liver fibrosis in patients with nonalcoholic steatohepatitis. Hepatology. 1999;30:1356–1362. doi: 10.1002/hep.510300604. [DOI] [PubMed] [Google Scholar]
  • 36.Sanyal AJ, Mofrad PS, Contos MJ, Sargeant C, Luketic VA, Sterling RK, Stravitz RT, et al. A pilot study of vitamin E versus vitamin E and pioglitazone for the treatment of nonalcoholic steatohepatitis. Clin Gastroenterol Hepatol. 2004;2:1107–1115. doi: 10.1016/s1542-3565(04)00457-4. [DOI] [PubMed] [Google Scholar]
  • 37.Neuschwander-Tetri BA, Brunt EM, Wehmeier KR, Oliver D, Bacon BR. Improved nonalcoholic steatohepatitis after 48 weeks of treatment with the PPAR-gamma ligand rosiglitazone. Hepatology. 2003;38:1008–1017. doi: 10.1053/jhep.2003.50420. [DOI] [PubMed] [Google Scholar]
  • 38.Powell EE, Cooksley WG, Hanson R, Searle J, Halliday JW, Powell LW. The natural history of nonalcoholic steatohepatitis: a follow-up study of forty-two patients for up to 21 years. Hepatology. 1990;11:74–80. doi: 10.1002/hep.1840110114. [DOI] [PubMed] [Google Scholar]
  • 39.Caldwell SH, Lee VD, Kleiner DE, Al-Osaimi AM, Argo CK, Northup PG, Berg CL. NASH and cryptogenic cirrhosis: a histological analysis. Ann Hepatol. 2009;8:346–352. [PMC free article] [PubMed] [Google Scholar]
  • 40.Kim WR, Poterucha JJ, Porayko MK, Dickson ER, Steers JL, Wiesner RH. Recurrence of nonalcoholic steatohepatitis following liver transplantation. Transplantation. 1996;62:1802–1805. doi: 10.1097/00007890-199612270-00021. [DOI] [PubMed] [Google Scholar]
  • 41.McCaughan GW. Recurrence of nonalcoholic steatohepatitis (NASH) post-liver transplantation. Liver Transpl Surg. 1997;3:683. doi: 10.1002/lt.500030627. [DOI] [PubMed] [Google Scholar]
  • 42.Ong J, Younossi ZM, Reddy V, Price LL, Gramlich T, Mayes J, Boparai N. Cryptogenic cirrhosis and posttransplantation nonalcoholic fatty liver disease. Liver Transpl. 2001;7:797–801. doi: 10.1053/jlts.2001.24644. [DOI] [PubMed] [Google Scholar]
  • 43.Dumortier J, Giostra E, Belbouab S, Morard I, Guillaud O, Spahr L, Boillot O, et al. Non-alcoholic fatty liver disease in liver transplant recipients: another story of "seed and soil". Am J Gastroenterol. 105:613–620. doi: 10.1038/ajg.2009.717. [DOI] [PubMed] [Google Scholar]
  • 44.Pagadala M, Dasarathy S, Eghtesad B, McCullough AJ. Posttransplant metabolic syndrome: an epidemic waiting to happen. Liver Transpl. 2009;15:1662–1670. doi: 10.1002/lt.21952. [DOI] [PubMed] [Google Scholar]
  • 45.Carter-Kent C, Yerian LM, Brunt EM, Angulo P, Kohli R, Ling SC, Xanthakos SA, et al. Nonalcoholic steatohepatitis in children: a multicenter clinicopathological study. Hepatology. 2009;50:1113–1120. doi: 10.1002/hep.23133. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Patton HM, Lavine JE, Van Natta ML, Schwimmer JB, Kleiner D, Molleston J. Clinical correlates of histopathology in pediatric nonalcoholic steatohepatitis. Gastroenterology. 2008;135:1961–1971. e1962. doi: 10.1053/j.gastro.2008.08.050. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47.Neuschwander-Tetri BA, Clark JM, Bass NM, Van Natta ML, Unalp-Arida A, Tonascia J, Zein CO, et al. Clinical, laboratory and histological associations in adults with nonalcoholic fatty liver disease. Hepatology. doi: 10.1002/hep.23784. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48.Lyons-Weiler J. Standards of excellence and open questions in cancer biomarker research: an informatics perspective. Cancer Inform. 2005;1:1–7. [PMC free article] [PubMed] [Google Scholar]
  • 49.Whiting P, Rutjes AW, Reitsma JB, Glas AS, Bossuyt PM, Kleijnen J. Sources of variation and bias in studies of diagnostic accuracy: a systematic review. Ann Intern Med. 2004;140:189–202. doi: 10.7326/0003-4819-140-3-200402030-00010. [DOI] [PubMed] [Google Scholar]
  • 50.Bossuyt PM, Reitsma JB, Bruns DE, Gatsonis CA, Glasziou PP, Irwig LM, Moher D, et al. The STARD statement for reporting studies of diagnostic accuracy: explanation and elaboration. Ann Intern Med. 2003;138:W1–W12. doi: 10.7326/0003-4819-138-1-200301070-00012-w1. [DOI] [PubMed] [Google Scholar]
  • 51.Bossuyt PM, Reitsma JB, Bruns DE, Gatsonis CA, Glasziou PP, Irwig LM, Lijmer JG, et al. Towards complete and accurate reporting of studies of diagnostic accuracy: the STARD initiative. AJR Am J Roentgenol. 2003;181:51–55. doi: 10.2214/ajr.181.1.1810051. [DOI] [PubMed] [Google Scholar]
  • 52.Yang SQ, Lin HZ, Lane MD, Clemens M, Diehl AM. Obesity increases sensitivity to endotoxin liver injury: implications for the pathogenesis of steatohepatitis. Proc Natl Acad Sci U S A. 1997;94:2557–2562. doi: 10.1073/pnas.94.6.2557. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 53.Ito Y, Abril ER, Bethea NW, McCuskey MK, McCuskey RS. Dietary steatotic liver attenuates acetaminophen hepatotoxicity in mice. Microcirculation. 2006;13:19–27. doi: 10.1080/10739680500383423. [DOI] [PubMed] [Google Scholar]
  • 54.Kaplowitz N, Aw TY, Simon FR, Stolz A. Drug-induced hepatotoxicity. Ann Intern Med. 1986;104:826–839. doi: 10.7326/0003-4819-104-6-826. [DOI] [PubMed] [Google Scholar]
  • 55.Danan G. Definitions and assessment criteria of acute drug-induced hepatitis. Conclusions of an International Consensus Meeting. Gastroenterol Clin Biol. 1991;15:845–848. [PubMed] [Google Scholar]
  • 56.Zimmerman HJ, Ishak KG. General aspects of drug-induced liver disease. Gastroenterol Clin North Am. 1995;24:739–757. [PubMed] [Google Scholar]
  • 57.Norris W, Paredes AH, Lewis JH. Drug-induced liver injury in 2007. Curr Opin Gastroenterol. 2008;24:287–297. doi: 10.1097/MOG.0b013e3282f9764b. [DOI] [PubMed] [Google Scholar]
  • 58.Platt R, Wilson M, Chan KA, Benner JS, Marchibroda J, McClellan M. The new Sentinel Network--improving the evidence of medical-product safety. N Engl J Med. 2009;361:645–647. doi: 10.1056/NEJMp0905338. [DOI] [PubMed] [Google Scholar]

RESOURCES