Abstract
In the boundary layers around the edges of images, basic nonlinear parabolic equations for image intensity used in image processing assume a special degenerate asymptotic form. An asymptotic self-similar solution to this degenerate equation is obtained in an explicit form. The solution reveals a substantially nonlinear effect—the formation of sharp steps at the edges of the images, leading to edge enhancement. Positions of the steps and the time shift parameter cannot be determined by direct construction of a self-similar solution; they depend on the initial condition of the pre-self-similar solution. The free-boundary problem is formulated describing the image intensity evolution in the boundary layer.
Keywords: nonlinear partial differential equations|self-similar solutions
Modern computer vision studies are based on a differential-geometric approach having roots in ideas presented in the inaugural lecture of B. Riemann at the Philosophical Faculty of Göttingen University in 1854. This lecture was earmarked in fact for a single listener, K. F. Gauss, who selected the topic from three that were proposed by Riemann and whose ideas concerning geometric theory of surfaces received in this lecture far-reaching development.
In an illuminating essay by B. Kagan (1), a review of the development of Riemann's geometric ideas in an active period up to the mid-thirties is presented most comprehensively together with a detailed bibliography. I want to mention here an instructive moment. Riemann's lecture was published by a German mathematician, R. Dedekind, long after Riemann's death. The title of the lecture was “Ueber die Hypothesen welche der Geometrie zu Grunde liegen” (on the hypotheses which lie at the foundation of the geometry). Soon after publication of Riemann's lecture, there appeared a paper by H. von Helmholtz having a title practically coinciding with the title of Riemann's lecture except for a single word: “Ueber die Tatsachen welche der Geometrie zu Grunde liegen” (on the facts which lie at the foundation of the geometry). Helmholtz claimed in this paper that he came to the ideas presented in Riemann's lecture independently, and what is most interesting now, by a completely different motivation, trying to construct a physiological model of vision (Helmholtz's basic profession was physiology and medicine). It is instructive to see how these ideas are resurrected in computer vision science!
Rather early it was recognized in computer vision studies [see especially the paper by Perona and Malik (2)] that the technique of image processing leads to solving nonlinear parabolic partial differential equations. What is important (it was emphasized in ref. 2), that a properly selected nonlinearity, i.e., the image intensity flux, can lead to an enhancement of image edges even if the flux is as usually directed opposite to the image intensity gradient. A different approach to the edge enhancement problem was proposed by Alvarez et al. (3). They selected the image flux direction orthogonal to the image intensity gradient. The basic partial differential equation for the image intensity obtained in ref. 3 is also a nonlinear parabolic one, but it does not belong to the class outlined in ref. 2.
In the present note the appearance of the edge enhancement in the technique proposed by Malladi and Sethian and their colleagues is investigated. In refs. 4 and 5, these authors arrived at the following equations for image intensity φ by using the differential-geometric approach and various assumptions concerning the image intensity flux:
1 |
[mean curvature flow (4)], and
2 |
[Beltrami flow (5)]. Here, x and y are the Cartesian coordinates in the image plane, t is time. Thus, according to refs. 4 and 5, image processing is reduced to the solution of the chosen equation under an initial condition φ(x, y, t0) = φ0(x, y) corresponding to a grey level of the image being processed. I note that later the equation (2) was also published by Yezzi (6), who used a different model for the image processing.
As a result of a certain degeneracy of the asymptotic forms of Eqs. 1 and 2, it is appropriate to consider a more general class of equations
3 |
where α ≥ 0 and β, γ are positive constants. Both Eqs. 1 and 2 belong to this class.
Boundary Layer Effect in Image Processing and the Asymptotic Form of the Basic Equation
An analysis of images presented in refs. 4 and 5 showed that near the edges of the images always exists a boundary layer (see Fig. 1), where the normal component of the image intensity gradient is large. We use the local Cartesian coordinates in the boundary layer: x, along the normal to its midline, and y, along the midline. It can be assumed that (∂xφ)2 ∼ 1/h2 in the boundary layer is, generally speaking, much larger than β2. It can be assumed also that in the boundary layer, (∂yφ)2 ≪ 1/H2 is much less than β2. Therefore, I can neglect (∂yφ)2 in comparison with β2. Eq. 3 in the boundary layer is reduced to the one-dimensional form
4 |
Here, κ = γβ2. Eq. 4 belongs to a general class of equations considered in the article by Bertsch and Dal Passo (7). If (∂xφ)2 is much larger than β2, I can neglect β2 in the denominator of Eq. 4, and an asymptotic form of Eq. 3 is obtained
5 |
governing the evolution of the image intensity in the boundary layer.
I note a certain connection between Eq. 5 and the Bertsch equation (see ref. 8)
(c is a constant). Indeed, assuming φ = ψ(1+2α)/2(1+α), I reduce Eq. 5 to a similar form
This form is also more convenient for numerical computations.
Intermediate-Asymptotic Solution
For a useful comparison, I present at first briefly a derivation based on the dimensional analysis of the classic intermediate-asymptotic solution to the linear equation ∂tφ = κ∂φ (formally corresponding to Eq. 5 for α = −1) for a “smoothed step” initial-boundary value problem
6 |
Here, φ1 > φ2 ≥ 0 and a, b > 0 are constant parameters of the problem, and the function φ0(x) is assumed to be smooth at −a ≤ x ≤ b, so that φ0(−a) = φ1, φ0(b) = φ2. Also, it is assumed that φ′0(−a), φ′0(b) are ≤ 0. Without loss of generality, φ2 can be assumed to be equal to zero.
A priori an intermediate-asymptotic solution to the problem Eq. 6 can depend only on the quantities κ, t + t0, φ1, and x − x0. The constant x0 which enters due to the invariance of the equation to shift x′ = x + const; it remains, however, undetermined in a direct construction of the self-similar intermediate asymptotics. The dimensions of the involved quantities are [φ] = [φ1] = Φ, [x − x0] = L, [t + t0] = T, and for the linear case under consideration, [κ] = L2T−1. (Maxwell's notation is used for the dimension of z.) Here, Φ is the independent dimension of φ, L and T are dimensions of length and time. Dimensional analysis shows that the intermediate-asymptotic solution can be represented in the form φ = φ1f(ξ), where, for the linear case under consideration, a dimensionless independent variable is inversely proportional to ∶ξ = (x − x0)/. Substituting φ = φ1f(ξ) to the linear equation (Eq. 5 for α = −1), I obtain a linear ordinary differential equation for the function f. Easy integration under boundary conditions f(−∞) = 1, f(∞) = 0 allows one to obtain the function f in an explicit form, and the intermediate-asymptotic solution appears in the classic form
7 |
Solution 7 demonstrates that for a linear case (α = −1), the smoothed stepwise initial distribution extends with time; its properly defined width increases with time proportionally to , and the maximum of the derivative modulus |∂xφ| decreases with time as 1/(t + t0)1/2.
I repeat now the above argument for the case of nonlinear asymptotic Eq. 5 corresponding to α = 1 [the Beltrami flow, Malladi and colleagues (5)]. The essential difference is that in this case, the dimension of coefficient κ is different:
8 |
This difference leads to a dramatic change in the solution. As before, the solution is represented in the form φ = φ1f(ξ); however in this case (α = 1),
9 |
so that the dimensionless argument of the function f is directly proportional, not inversely proportional, to √ Eq. 5 assumes for the case α = 1 the form
10 |
Substituting to Eq. 10 φ = φ1f(ξ), we obtain for f(ξ) the ordinary differential equation:
11 |
where ξ is determined by Eq. 9. Easy integration gives
12 |
Here, ξf is an integration constant. Further integration and the boundary conditions f(−ξf) = 1, f(ξf) = 0 give
13 |
The integration constant ξf is obtained from the condition f(ξf) = 0, so that
14 |
Thus, the intermediate-asymptotic solution assumes the form (see Fig. 2):
15 |
for x = x0 − ξf(φ)/() ≤ x ≤ x = x0 + ξf (φ/). It is seen that, contrary to the linear case presented above, this solution is a local solution. At free boundaries x = x and x = x, the image intensity is continuous but the derivative ∂xφ suffers an infinite jump. The condition ∂xφ = −∞ can be interpreted as the zero flux condition.
Relation 15 reveals important asymptotic properties of the image evolution in the boundary layer at the image edge. First of all, the width of the transition region x − x equal to 2ξf φ[κ(t + t0)]−1/2 decreases with time; the step forms from an initially noisy image (Relation 6) and the edge enhancement takes place. Furthermore, the value of φ(x0, t) remains constant and equal to φ1/2. (I emphasize that position x0 cannot be obtained in the presented construction and requires a matching with pre-self-similar solution, e.g., by a numerical computation.) Finally, the value of |∂xφ| at x = x0 equal to /φ1 ξ, which is the minimum of |∂xφ|, is growing with time, therefore the validity of the asymptotic Eq. 5 improves with time.
Solution 15 suggests the following free-boundary problem for determination of the image intensity evolution in the boundary layer. At the initial moment, the points x(t0) = −a and x(t0) = b—the boundaries of the uncertainty belt—are prescribed, so that φ ≡ φ1 for x ≤ x(t0) and φ ≡ 0 for x ≥ x(t0) (Relation 6). At t > t0, the image intensity φ(x, t) and the free boundaries x(t), x(t) should be determined so that Eq. 4, initial condition 6, and the conditions at free boundaries
16 |
should be satisfied. The condition ∂xφ = −∞ at x = x(t) and x = x(t) can be interpreted as zero flux condition. This one-dimensional free-boundary problem can be implemented to two-dimensional problems.
Intermediate-Asymptotic Solution for Arbitrary α > 0
I return to the general Eqs. 4 and 5. In this case, [κ] = Φ2(1+α) L−2αT−1, so that
17 |
and the equation for the function f(ξ) takes the form
18 |
Integrating and using the boundary condition f(−ξf) = 1, I obtain
19 |
for −ξf ≤ ξ ≤ ξf. By using the boundary condition f(ξf) = 0, the relation for ξf can be obtained:
20 |
The function ξf(α) is nonmonotonic (see Fig. 3); ξf(0) is equal to infinity. At first, ξf(α) decreases with growing α, reaches a minimum, and then starts to grow.
The intermediate-asymptotic solution takes for arbitrary positive α the form φ ≡ φ1, for
21 |
for x < x < x, x = x0 + ξfφ (κ(t + t0))−1/2α; and φ ≡ 0, for x > x. For the width of the transition region, the relation 21 suggests the expression
22 |
So, qualitatively the situation for any α > 0 is the same as in the case of the Beltrami flow α = 1: the edge enhancement will take place if any equation of this class will be used.
A. E. Chertock performed a series of numerical computations of the solutions to the suggested free-boundary problem for the Eq. 4. The function φ0(x) in some runs was nonmonotonic. Parameter α assumed the values α = 1 and other values including small positive ones. Computations demonstrated that the self-similar solution 21 was an intermediate asymptotics of the solutions computed numerically (A. Chertock, unpublished data). On Fig. 4, the evolution of the image intensity distribution in time is presented for a nonmonotonic initial condition in the case α = 1 (Beltrami flow).
The case of the mean curvature flow (Eq. 1) corresponding to α = 0 requires additional analysis.
Conclusion
A free-boundary problem is formulated for the image intensity evolution in the boundary layer around the edge of the image. Analysis of intermediate-asymptotic solutions for the image evolution in the boundary layer of an image demonstrated that the edge enhancement takes place for the class of flows under consideration. The rate of enhancement depends on the parameter, i.e., on the hypotheses concerning the image intensity flow.
Acknowledgments
I thank Prof. J. A. Sethian and Dr. R. Malladi for introducing me to their fascinating field as well as for valuable discussions and comments. I appreciate the illuminating comments of Professors L. C. Evans, M. Bertsch, and J. L. Vázquez and thank them. I thank Dr. A. E. Chertock for her stimulating questions and numerical calculations. I am grateful to Professor A. J. Chorin for his unfading stimulating interest in my work as well as for valuable discussions and comments. The work was supported by the Applied Mathematics subprogram of the U.S. Department of Energy under Contract DE-AC03-76-SF00098.
References
- 1.Kagan B. Geometric Ideas of Riemann and Their Modern Development. Moscow-Leningrad: GTTI; 1933. [Google Scholar]
- 2.Perona P, Malik J. IEEE Transactions of Pattern Analysis and Machine Intelligence. 1990;12:629–639. [Google Scholar]
- 3.Alvarez L, Lions P-L, Morel J-M. SIAM J Num Anal. 1992;29:845–866. [Google Scholar]
- 4.Malladi R, Sethian J A. Graph Models Image Process. 1996;58:127–141. [Google Scholar]
- 5.Sochen N, Kimmel R, Malladi R. From High Energy Physics to Low Level Vision. 1996. , preprint. [Google Scholar]
- 6.Yezzi A. IEEE Trans Image Process. 1998;7:345–352. doi: 10.1109/83.661184. [DOI] [PubMed] [Google Scholar]
- 7.Bertsch M, Dal Passo R. Arch Rat Mech Anal. 1992;117:349–387. [Google Scholar]
- 8.Bertsch M, Dal Passo R, Ughi M. Ann Mat Appl. 1992;(IV) CLXI:57–81. [Google Scholar]