Abstract
When mechanical factors underlie growth, development, disease or healing, they often function through local regions of tissue where deformation is highly concentrated. Current optical techniques to estimate deformation can lack precision and accuracy in such regions due to challenges in distinguishing a region of concentrated deformation from an error in displacement tracking. Here, we present a simple and general technique for improving the accuracy and precision of strain estimation and an associated technique for distinguishing a concentrated deformation from a tracking error. The strain estimation technique improves accuracy relative to other state-of-the-art algorithms by directly estimating strain fields without first estimating displacements, resulting in a very simple method and low computational cost. The technique for identifying local elevation of strain enables for the first time the successful identification of the onset and consequences of local strain concentrating features such as cracks and tears in a highly strained tissue. We apply these new techniques to demonstrate a novel hypothesis in prenatal wound healing. More generally, the analytical methods we have developed provide a simple tool for quantifying the appearance and magnitude of localized deformation from a series of digital images across a broad range of disciplines.
Keywords: strain localization, texture correlation, material failure
1. Introduction
Analysis of images to detect and quantify spatial variations in deformation is critical for understanding morphogenesis [1], wound healing [2], tissue mechanics [3–5] and structural mechanics [6]. A standard approach for such analysis involves estimating displacement fields inferred by comparing images of the same system taken at different times or under different conditions [7,8]. The most broadly used technique involves matching image intensities over a grid of regions of a sample before and after the sample is deformed [8,9], then differentiating the resulting displacement fields numerically to estimate the tensor of strains that describes the spatial distribution of deformation. Displacement field estimation can be improved dramatically for large deformations through the Lucas–Kanade (LK) algorithm that applies and optimizes a ‘warping function’ to the undeformed image before matching it to an undeformed image [7,10–12]. Strain fields estimated through these approaches underlie much of cell mechanics [13–16], using a technique that compares images of a deformable medium contracted by cells to images of the same medium after deactivation or removal of the cells. The framework is fast and well established for most mechanical loads that isolated cells apply to their surroundings [17], and similar approaches have been used to study collective cell motion [18], tissue morphogenesis [1] and tissue mechanics [3–5].
However, these methods are subject to large errors when strain is high or localized. Specifically, small inaccuracies in displacement estimation become amplified through the numerical differentiation needed to estimate strain fields [7–9]. Minor mistracking of a single displacement can lead to an artefact that is typically indistinguishable from a region of concentrated strain. Although accuracy can be improved by incorporating a mathematical model that describes how a specific tissue deforms into the image matching [19,20], such techniques cannot be applied to a tissue whose properties are not known a priori.
We therefore developed a simple ‘Direct Deformation Estimation’ algorithm (DDE) that circumvents the need to estimate displacement fields before estimating strain fields, and thus avoids the inaccuracies associated with displacement mapping artefacts. We also developed an associated metric that distinguishes local concentration of strain from errors in the calculation of deformation. We call this method the ‘Strain Inference with Measures of Probable Local Elevation’ (SIMPLE) algorithm.
The DDE algorithm improves the accuracy of local strain estimates by three orders of magnitude compared with standard cross-correlation techniques and by up to an order of magnitude over prior techniques based upon the LK algorithm. This is achieved by directly incorporating the calculation of deformation into the warping function used in the algorithm, a powerful simplification that has not previously been implemented. By examining how the output of the DDE algorithm differs from the output of the LK algorithm, the SIMPLE algorithm provides a measure that is remarkably sensitive to strain localization. To illustrate the potential impact of the DDE and SIMPLE algorithms, we validate them using model problems. We then demonstrate them on four problems that pose a challenge to existing methods: (i) detection of spatially varying modulus in a polydimethylsiloxane (PDMS) scaffold with a spatial gradient in cross-linking density, (ii) detection of spatially varying modulus in a collagen scaffold with a spatial gradient in mineral content, (iii) prediction of crack formation prior to appearance of a visible crack in a vinylidene chloride sheet in tension, and (iv) confirmation of a long-standing hypothesis about the balance between active and passive contraction during the healing of embryonic wounds.
2. Results
2.1. Optical strain estimation is simpler, more precise and more accurate when numerical derivatives are avoided
Optical strain measurements use texture matching to estimate deformation. The basic texture-matching algorithm divides an initial reference image into several regions and finds the best-matching region in a deformed image. The most widely implemented class of algorithms, termed standard cross correlation (XCOR), search for matching regions without considering how the shape of the individual undeformed texture regions change (figure 1a,b) [21]. Strain fields can be estimated from the displacements of the midpoints of each region, often through calculation of a deformation gradient tensor that can be used to relate the spatial gradient of displacement fields to the strain fields (figure 1b).
Although not widely used in the biomedical and engineering communities, the LK method is broadly applied in computer vision to improve region-matching (figure 1a,c) [7,8,10,11]. Rather than matching regions of identical size and shape, the LK method optimizes a warping function for each region to improve the matching. Displacements of the midpoints of each region are then used to estimate the deformation gradient tensor and strain fields with a least-squares fit (LSF) [8]. This can reduce errors in strain estimation in cases of large deformations by two orders of magnitude (figure 2b,e,h). Alternate deformable image registration techniques have been developed and used in biomedical applications which improve upon LK displacement estimation, however all of these alternative techniques require a LSF of the displacement field [22,23].
We found that errors could be reduced another order of magnitude by incorporating continuum mechanics directly into the LK algorithm. During the Newtonian optimization performed to solve for the LK method, a warping function must be defined to describe the change from an undeformed to a deformed image and is usually chosen for efficiency and accuracy in estimation of displacement fields [8]. We defined a warping function that could be directly related to the deformation gradient tensor (see the electronic supplementary material for details). Using this approach, referred to as DDE, the deformation gradient tensor is intrinsically calculated as part of the region-matching algorithm, without the need to take numerical derivatives (figure 1a,d).
When tested against idealized images with deformation fields known a priori, the DDE approach out-performed LK and XCOR approaches substantially in pure incompressible deformation (figure 2a), pure rotation with no deformation (figure 2d) and incompressible deformation with rotation (figure 2g). Three advantages of the DDE approach are: (i) improved accuracy due to a unique deformation gradient tensor associated with each region (figures 1 and 2), (ii) increased precision due to circumvention of a least-squares estimation of the deformation gradient tensor (figures 1 and 2), and (iii) improved simplicity because least-squares estimation based on image motion is eliminated.
To demonstrate the utility of the increased accuracy and precision, we analysed deformation of PDMS samples fabricated with gradients in cross-linking and hence gradients of material stiffness, followed by coating with a speckle pattern to track deformations. Using videos taken as specimens were cyclically strained between 0 and 10% grip-to-grip strain, the DDE algorithm detected smooth spatial gradients of both axial strain and lateral contraction along the sample, corresponding to the expected stiffness gradient at a grip-to-grip strain of only 0.003 (figure 3a,c; electronic supplementary material, video 1). These patterns were evident long before detection using XCOR (figure 3b,d). Both methods detected strain gradients at a grip-to-grip strain of 0.03, but the strain fields predicted by XCOR were irregular, with regions of high strain seen next to regions of low strain (figure 3f). At higher strain levels, the XCOR methods failed to capture a meaningful strain field, whereas the DDE algorithm continued to identify the smooth gradient, even with peak strains over 0.2 (figure 3i–l). Similar results were seen using collagen scaffolds with gradients in mineral content (electronic supplementary material, figure S2 and video 2).
Many algorithms exist for improving the smoothing and improving the accuracy of displacement fields [24]. As these were not applied in this example, the example does not represent the limitations of XCOR. However, it does represent the strength and simplicity of DDE strain tracking which is inherently sensitive, does not require smoothing/averaging, has higher resolution and tracks to much higher strain levels.
2.2. The strain inference with measures of probable local elevation algorithm identifies strain localizations and predicts crack formation
The irregular strain pattern in figure 3f,h represents a well-known challenge with XCOR methods. Slight mistracking of a texture region leads to zones of over-estimated strain abutting zones of underestimated strain. If strain fields are known to be smooth, this can be fixed by simply averaging over several regions. However, in the absence of such information, a strain field such as that in figure 3f,h might lead to the erroneous conclusion that strain concentrations existed in these regions and that the material did not have a smooth stiffness gradient. Although the DDE method is able to reveal the smooth material gradient, detection of strain concentrations remains difficult because strain concentration detection methods must rely on post processing filtering techniques to detect local features.
The SIMPLE algorithm achieved robust prediction of strain localization and crack formation through a metric based upon differences between predictions of the DDE and LK methods (figure 4a,b; details in the electronic supplementary material, Methods). The output of this algorithm is a tensor Δ whose principal components reveal strain concentrations. As a demonstration, a vinylidene chloride sheet with a speckle pattern on its surface was pulled to failure. The peak principal value of Δ, termed the strain concentration detector, ΔI, identified strain localizations leading to cracks earlier and with more certainty than XCOR (figure 5a,b, white arrow; electronic supplementary material, video 3). As the primary region of strain localization inferred using ΔI cracked, ΔI continued to increase over the uncracked ligaments (figure 5c). Further, as the crack developed, neighbouring strain concentrations halted their development and unloaded, demonstrating transfer of stress to the propagating crack (figure 5, yellow arrows). By contrast, the strain concentration was difficult to identify above noise using XCOR methods (figure 5d, white arrow), XCOR returned unreasonable strains of 200% while cracks were propagating (figure 5f), and the XCOR method failed to track deformations after the crack had formed (figure 5f,h).
SIMPLE identifies when the strain field arising from the best estimates for displacements differ significantly from the piecewise constant DDE strain field that best represents how a defined portion of an image has deformed. Estimating displacements based upon the DDE strain fields, as is required for the former, has the advantage of providing a compatible strain field, meaning that it corresponds to a unique displacement field [25]. However, imposing compatibility is not in general appropriate for piecewise constant averaged strain fields (electronic supplementary material, §2).
2.3. Direct deformation estimation and strain inference with measures of probable local elevation algorithms reveal previously ambiguous mechanisms of embryonic wound healing
Embryonic wounds can heal without scarring and therefore serve as model systems for regenerative healing strategies and fetal surgery [26]. Central unresolved issues surround identification of the contractile field around a wound perimeter shortly after wounding and of how surgical technique affects this behaviour [2]. The dominant model suggests that a local ring contracts isotropically [2], but the strain fields needed to support this model have never before been imaged successfully. We therefore studied differences between three wound types in early stage chick embryos: (i) circular wounds created with a punch [2], (ii) elliptical wounds created by ablation (electronic supplementary material, Methods Section), and (iii) elliptical wounds created by incision with a micro-scalpel [2]. We sought to delineate three sources of tissue strain in vicinity of the wound: (i) isotropic contraction of the wound, (ii) passive elastic recovery of tissue distal to the wound, and (iii) stretching introduced during wound creation (electronic supplementary material, figure S3).
The DDE method succeeded in identifying the time course of straining, whereas XCOR revealed only noise (figure 6). For the circular punched wound, the first principal strain showed a contractile ring around the wound border, consistent with the isotropic contraction model [2] (figure 6a,d; electronic supplementary material, video 4). The SIMPLE algorithm detected a strain concentration around the wound consistent with localized isotropic contraction [2] (figure 6g and the electronic supplementary material, video 4).
For the elliptical ablated wound, a localized isotropic contractile ring again formed, and small amounts of tension distal to the wound were evident (figure 6b,e; electronic supplementary material, video 5). The SIMPLE algorithm again detected a strain concentration around the wound (figure 6h and the electronic supplementary material, video 5).
By contrast, the micro-scalpel incision showed elevated tensile strain at the leading edge of the incision, and very low strain in the wake of the incision (figure 6c,f; electronic supplementary material, video 6). Strain concentrations were detected along the flanks of the wound, and subsequent analysis revealed these to arise from shearing of the wound flanks (figure 6i and the electronic supplementary material, video 6).
Results suggest that the mode of incision, rather than the shape of the wound, dictated where strains were localized during closure/contracture. As discussed below, this supports predictions of the isotropic contraction model and sheds light on some basic mechanisms of fetal wound healing.
3. Discussion
The DDE and SIMPLE methods can identify strain concentrations that are very difficult to detect with any previously published method and are appealing due to the simplicity of their implementation. The SIMPLE method detected strain concentrations on the order of 0.005, long before they were evident using XCOR (figure 5a). Strain localizations were predictive of crack initiation and are therefore useful for applications ranging across biomaterial design and structural engineering. We are unaware of any other techniques to detect strain concentrations as robustly or predict the onset of fracture with this precision and accuracy.
DDE and SIMPLE quantified features of embryonic wound healing that were previously undetectable and in addition enabled a qualitative picture of the effect of wound type. The interplay of isotropic constriction, passive elastic recovery and stretching introduced during wound creation became apparent, providing insight into wound healing mechanisms and fetal surgery [2,27,28]. The strain fields associated with circular and elliptical ablated wounds exhibited a trade-off between localized isotropic contraction and distal tissue tension, with no additional effects of the wounding process (figure 6 and electronic supplementary material, figure S3). The scalpel incision, however, left tension in the wake of the wound, compression ahead of the wound and shear abutting the flanks. Cells surrounding the wound reacted to reach a homeostatic state, which combined with the effects of the localized isotropic contraction to induce wound closure (figure 6). Results suggest that ablating and punching are less disruptive to embryonic wounds than scalpel incisions and show that the method of wounding has a strong effect on the initial stages of the wound-healing response.
The DDE method showed improvement in accuracy, precision and resolution over previously employed techniques and maintained this through high strains. This renders the method particularly suitable for biologic systems, which often endure large and inhomogeneous strains [1–5]. DDE also demonstrated sensitivity sufficient to differences in strain as small as 0.001 (figure 3). The method is insensitive to movements and rotations of a specimen and is relatively robust against image noise. The method is therefore suitable for analysis of low-resolution/noisy images (e.g. from magnetic resonance imaging). Other methods for deformable image registration employ more flexibility than the simple affine transformation used here [10]; however, the DDE method is the first to take into account the formulations of mechanics directly into the image correlation algorithm, and thus delivers improved accuracy. Importantly, as with other texture-based methods including XCOR and LK, DDE is limited by image resolution and the size of the smallest image feature: the region size cannot be known a priori and must be adjusted for each sample based on the image resolution and the size of the smallest texture feature.
The techniques described are useful outside of biology as well. Glacial rifts and fronts of earthquakes begin as strain localizations before failure [29,30], and estimates of strain concentrations at these fronts might prove useful. Further, the method would be useful in monitoring of civil structures. We are hopeful that the simplicity of DDE and SIMPLE will enable easy strain estimation and strain concentration detection across many fields.
Supplementary Material
Acknowledgements
The authors would like to thank Dr Lester Smith for contributing to the fabrication of the collagen scaffolds.
Funding statement
This work was funded by the National Institutes of Health (NIH) (AR060820 and HL109505), the National Science Foundation (NSF) (CAREER 844607) and the NIH and NSF jointly (U01EB016422).
References
- 1.Shyer AE, Tallinen T, Nerurkar NL, Wei Z, Gil ES, Kaplan DL, Tabin CJ, Mahadevan L. 2013. Villification: how the gut gets its villi. Science 342, 212–218. ( 10.1126/science.1238842) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Wyczalkowski M, Varner V, Taber L. 2013. Computational and experimental study of the mechanics of embryonic wound healing. J. Mech. Behav. Biomed. Mater. 28, 125–146. ( 10.1016/j.jmbbm.2013.07.018) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Myers KM, Coudrillier B, Boyce BL, Nguyen TD. 2010. The inflation response of the posterior bovine sclera. Acta Biomater. 6, 4327–4335. ( 10.1016/j.actbio.2010.06.007) [DOI] [PubMed] [Google Scholar]
- 4.Phatak NS, Sun Q, Kim S-E, Parker DL, Sanders RK, Veress AI, Ellis BJ, Weiss JA. 2007. Noninvasive determination of ligament strain with deformable image registration. Ann. Biomed. Eng. 35, 1175–1187. ( 10.1007/s10439-007-9287-9) [DOI] [PubMed] [Google Scholar]
- 5.Billiar KL, Sacks MS. 2000. Biaxial mechanical properties of the natural and glutaraldehyde treated aortic valve cusp—part I: experimental results. J. Biomech. Eng. 122, 23–30. ( 10.1115/1.429624) [DOI] [PubMed] [Google Scholar]
- 6.Yoneyama S, Kitagawa A. 2007. Bridge deflection measurement using digital image correlation. Exp. Tech. 31, 34–40. ( 10.1111/j.1747-1567.2007.00132.x) [DOI] [Google Scholar]
- 7.Tong W. 2013. Formulation of Lucas–Kanade digital image correlation algorithms for non-contact deformation measurements: a review. Strain 49, 313–334. ( 10.1111/str.12039) [DOI] [Google Scholar]
- 8.Schreier HW, Sutton MA, Orteu J-J. 2009. Image correlation for shape, motion and deformation measurements. New York, NY: Springer. [Google Scholar]
- 9.Sutton MA. 2013. Computer vision-based, noncontacting deformation measurements in mechanics: a generational transformation. Appl. Mech. Rev. 65, 050802 ( 10.1115/1.4024984) [DOI] [Google Scholar]
- 10.Baker S, Matthews I. 2004. Lucas–Kanade 20 years on: a unifying framework. Int. J. Comput. Vis. 56, 221–255. ( 10.1023/B:VISI.0000011205.11775.fd) [DOI] [Google Scholar]
- 11.Lucas B, Kanade T. 1981. An iterative image registration technique with an application to stereo vision. In Proc. 7th Int. Joint Conf. on Artificial Intelligence (IJCAI), Vancouver, BC, pp. 674–679. [Google Scholar]
- 12.Bruck H, McNeill S, Sutton M, III WP. 1989. Digital image correlation using Newton–Raphson method of partial differential correction. Exp. Mech. 29, 261–267. ( 10.1007/BF02321405) [DOI] [Google Scholar]
- 13.Legant WR, Miller JS, Blakely BL, Cohen DM, Genin GM, Chen CS. 2010. Measurement of mechanical tractions exerted by cells in three-dimensional matrices. Nat. Methods 7, 969–971. ( 10.1038/nmeth.1531) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Dembo M, Wang YL. 1999. Stresses at the cell-to-substrate interface during locomotion of fibroblasts. Biophys. J. 76, 2307–2316. ( 10.1016/S0006-3495(99)77386-8) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Wang N, Naruse K, Stamenović D, Fredberg JJ, Mijailovich SM, Tolić-Nørrelykke IM, Polte T, Mannix R, Ingber DE. 2001. Mechanical behavior in living cells consistent with the tensegrity model. Proc. Natl Acad. Sci. USA 98, 7765–7770. ( 10.1073/pnas.141199598) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Franck C, Maskarinec SA, Tirrell DA, Ravichandran G. 2011. Three-dimensional traction force microscopy: a new tool for quantifying cell–matrix interactions. PLoS ONE 6, e17833 ( 10.1371/journal.pone.0017833) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Butler JP, Tolić-Nørrelykke IM, Fabry B, Fredberg JJ. 2002. Traction fields, moments, and strain energy that cells exert on their surroundings. Am. J. Physiol. Cell Physiol. 282, C595–C605. ( 10.1152/ajpcell.00270.2001) [DOI] [PubMed] [Google Scholar]
- 18.Trepat X, Wasserman MR, Angelini TE, Millet E, Weitz DA, Butler JP, Fredberg JJ. 2009. Physical forces during collective cell migration. Nat. Phys. 5, 426–430. ( 10.1038/nphys1269) [DOI] [Google Scholar]
- 19.Rabbitt RD, Weiss JA, Christensen GE, Miller MI. 1995. Mapping of hyperelastic deformable templates using the finite element method. In Proc. SPIE 2573, Vision Geometry IV (eds Melter RA, Wu AY, Bookstein FL, Green WDK.), pp. 252–265. Bellingham, WA: International Society for Optics and Photonics. [Google Scholar]
- 20.Veress AI, Phatak N, Weiss JA. 2005. Deformable image registration with hyperelastic warping. In Handbook of biomedical image analysis (eds Suri JS, Wilson DL, Laxminarayan S.), pp. 487–533. Boston, MA: Springer US. [Google Scholar]
- 21.Peters WH, Ranson WF, Sutton MA, Chu TC, Anderson J. 1983. Application of digital correlation methods to rigid body mechanics. Opt. Eng. 22, 226738 ( 10.1117/12.7973231) [DOI] [Google Scholar]
- 22.Zhao R, Simmons CA. 2012. An improved texture correlation algorithm to measure substrate-cytoskeletal network strain transfer under large compressive strain. J. Biomech. 45, 76–82. ( 10.1016/j.jbiomech.2011.10.003) [DOI] [PubMed] [Google Scholar]
- 23.Huyghe JM, Jongeneelen CJM. 2012. 3D non-affine finite strains measured in isolated bovine annulus fibrosus tissue samples. Biomech. Model. Mechanobiol. 11, 161–170. ( 10.1007/s10237-011-0300-8) [DOI] [PubMed] [Google Scholar]
- 24.Pan B, Qian K, Xie H, Asundi A. 2009. Two-dimensional digital image correlation for in-plane displacement and strain measurement: a review. Meas. Sci. Technol. 20, 062001 ( 10.1088/0957-0233/20/6/062001) [DOI] [Google Scholar]
- 25.Slaughter WS. 2002. The linearized theory of elasticity. New York, NY: Springer. [Google Scholar]
- 26.Sonnemann KJ, Bement WM. 2011. Wound repair: toward understanding and integration of single-cell and multicellular wound responses. Annu. Rev. Cell Dev. Biol. 27, 237–263. ( 10.1146/annurev-cellbio-092910-154251) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Krummel TM, Nelson JM, Diegelmann RF, Lindblad WJ, Salzberg AM, Greenfield LJ, Cohen IK. 1987. Fetal response to injury in the rabbit. J. Pediatr. Surg. 22, 640–644. ( 10.1016/S0022-3468(87)80117-3) [DOI] [PubMed] [Google Scholar]
- 28.Diegelmann R, Evans M. 2004. Wound healing: an overview of acute, fibrotic and delayed healing. Front Biosci, 9, 283–289. ( 10.2741/1184) [DOI] [PubMed] [Google Scholar]
- 29.van der Veen CJ. 2013. Fundamentals of glacier dynamics, 2nd edn Boca Raton, FL: CRC Press. [Google Scholar]
- 30.Caine JS, Evans JP, Forster CB. 1996. Fault zone architecture and permeability structure. Geology 24, 1025 () [DOI] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.