Skip to main content
Springer logoLink to Springer
. 2018 Dec 9;64(3):363–389. doi: 10.1007/s10817-018-09504-w

A Verified Implementation of Algebraic Numbers in Isabelle/HOL

Sebastiaan J C Joosten 1, René Thiemann 1,, Akihisa Yamada 1
PMCID: PMC7089722  PMID: 32226180

Abstract

We formalize algebraic numbers in Isabelle/HOL. Our development serves as a verified implementation of algebraic operations on real and complex numbers. We moreover provide algorithms that can identify all the real or complex roots of rational polynomials, and two implementations to display algebraic numbers, an approximative version and an injective precise one. We obtain verified Haskell code for these operations via Isabelle’s code generator. The development combines various existing formalizations such as matrices, Sturm’s theorem, and polynomial factorization, and it includes new formalizations about bivariate polynomials, unique factorization domains, resultants and subresultants.

Keywords: Theorem proving, Algebraic numbers, Real algebraic geometry, Resultants

Introduction

Algebraic numbers, i.e., the numbers that are expressed as roots of non-zero integer (or equivalently rational) polynomials, are an attractive subset of the real or complex numbers. Every satisfiable polynomial constraint has solutions in the domain of algebraic numbers; in particular, algebraic numbers are closed under arithmetic operations (addition, multiplication, integer powers, and there inverses). Moreover these arithmetic operations are precisely computable, and comparisons of algebraic numbers are decidable. As a consequence, algebraic numbers are an important utility in computer algebra systems; e.g., Collin’s cylindrical algebraic decomposition algorithm for solving problems in real algebraic geometry heavily relies upon algebraic numbers [20, Sect. 8.6.5].

Our original interest in algebraic numbers stems from a certification problem about automatically generated complexity proofs, where for a given matrix AQn×n we have to compute the growth rate of An for increasing n [25]. To this end, all complex roots of the characteristic polynomial of A have to be identified.

Example 1

Consider a matrix A whose characteristic polynomial is f(x)=13·(1+2x+3x4) and let λ1,,λ4 be the complex roots of f. If the norm of some λi is larger than 1, then the growth rate of A is exponential; if all norms are below 1, then An tends to 0; and otherwise the growth rate is polynomial and its degree can be determined by further computations.

In order to apply this criterion, we need to compute each norm |λi|=Re(λi)2+Im(λi)2, and afterwards compare it with 1. All these computations can be performed with the help of algebraic numbers, as we will see throughout this paper. For instance, in this example we obtain the following results where roots are indexed from the smallest to the largest, and where the polynomials Inline graphic, Inline graphic, and Inline graphic are constructed during the computation. graphic file with name 10817_2018_9504_Figa_HTML.jpg As each norm |λi| is below 1, cf. Fig. 1, we can conclude that An tends to 0 for increasing n.

Fig. 1.

Fig. 1

The polynomial p with its four real roots

In this paper, we describe an implementation of algebraic numbers in Isabelle/HOL [21]. Up to our knowledge it is the first implementation that is both fully verified and executable on its own, i.e., without information from external tools. The implementation already became a crucial component of the automated reasoning tool CeTA for verifying complexity proofs [1, 25] that are generated during the annual termination competitions [12]. It is also used within a verified solver for linear recurrences [10].

The paper is structured as follows.

  • We first introduce some basic notions of algebraic numbers and then formalize the fact that every algebraic number has a unique canonical polynomial that represents it. We argue that these canonical polynomials make a good internal representation (Sect. 2).

  • For each algebraic operation, we formalize how to synthesize a polynomial that represents the output using polynomials that represent the inputs. We thus show that algebraic numbers are closed under the algebraic operations (Sect. 3).

  • For the multiplication and addition of algebraic numbers, we refer to resultants. We implement and formalize the subresultant remainder sequence algorithm, which can efficiently compute resultants (Sect. 4).

  • Using the above results, we implement the algebraic operations and comparisons of real and complex algebraic numbers, and a function to uniquely convert them into strings. We develop a hierarchy of four layers to represent real algebraic numbers, formalize several bisection algorithms, and integrate optimizations to obtain efficient code (Sect. 5).

  • We moreover provide algorithms that identify all real and complex roots of a rational polynomial. Together with the fact that complex roots of a real polynomial come in complex conjugate pairs, we derive algorithms that completely factor rational polynomials into real or complex polynomial factors (Sect. 6).

  • As we made an effort for efficiency, we experimentally compare the implementation against a version described in a preliminary version [24] of this paper, and the commercial computer algebra tool Wolfram Mathematica 11 (Sect. 7).

Most of the algorithms and proofs of our formalization are based on a textbook by Mishra [20, Chapters 7 and 8]; it contains a detailed implementation of real algebraic numbers, including proofs. When it comes to subresultants, we followed the original papers by Brown and Traub [2, 3]. However, our formalization also includes algorithms and optimizations, which we did not find in the literature, though they might be known.

For the Coq proof assistant, the Mathematical Components library1 contains various formalized results around algebraic numbers, e.g., quantifier elimination procedures for real closed fields [6]. In particular, the formalization of algebraic numbers for Coq is given by Cohen [4]. He employed Bézout’s theorem to derive desired properties of resultants, while we followed proofs by Mishra [20] and formalized various facts on resultants. Our work is orthogonal to the more recent work which avoids resultants [5]. A partial Coq formalization of subresultants also exists [19]. In contrast, our formalization is complete, and also integrates an optimization due to Ducos [8, Sect. 2].

For Isabelle, Li and Paulson [18] independently implemented algebraic numbers. They however did not formalize resultants; instead, they employed an external tool as an oracle to provide polynomials that represent desired algebraic numbers, and provided a method to validate that the polynomials from the oracle are suitable.2 Due to our optimization efforts, we can execute their examples [18, Fig. 3] in 0.016 seconds on our machine, where they reported 4.16 seconds.3

The whole formalization is available in the archive of formal proofs (AFP), mostly in entries Algebraic Numbers and Subresultants. Additionally, on

https://doi.org/10.5281/zenodo.1411394

we link statements in the paper with the Isabelle sources and provide details on our experiments.

Representation of Algebraic Numbers

Our formalization is based on Isabelle/HOL, and we state theorems and definitions following Isabelle’s syntax. For instance, Inline graphic indicates that Inline graphic is a function that takes integers and returns elements of type α, which is of class Inline graphic . The type of polynomials over coefficients of type α is denoted by Inline graphic . In Isabelle, a polynomial f(x)=i=0mfixi is written as Inline graphic (the leading coefficient comes last in the list), Inline graphic denotes the coefficient fi, Inline graphic the degree m, and Inline graphic the evaluation f(a) at Inline graphic.

A number a is algebraic if it is a root of a non-zero integer polynomial f. The notion is defined in Isabelle 2018 as follows.

Definition 1

graphic file with name 10817_2018_9504_Figi_HTML.jpg

Here the condition that f is an integer polynomial is expressed by enforcing the coefficients of f to be in the set Z, which is of type Inline graphic . In this definition, the polynomial Inline graphic and the algebraic number Inline graphic share the same domain type α, which will be instantiated by Inline graphic or Inline graphic . Since our motivation is to implement functions that actually operate on algebraic numbers of type Inline graphic and Inline graphic , manipulating polynomials in type Inline graphic leads to a circular dependency. Hence we introduce the predicate Inline graphic , meaning that a non-zero integer polynomial Inline graphic has Inline graphic as a root.

Definition 2

graphic file with name 10817_2018_9504_Figu_HTML.jpg

Here, Inline graphic is an abbreviation for Inline graphic , and Inline graphic converts the type of integer polynomials.

We obtain the following alternative characterization of algebraic numbers.

Lemma 1

graphic file with name 10817_2018_9504_Figy_HTML.jpg

Unique Representation

An algebraic number can be represented by arbitrarily many polynomials; for instance 2 is represented by f(x)=x2-2, g(x)=-x2+2, h(x)=x4+2x3-4x-4, k(x)=2x2-4, etc. However, every algebraic number can be uniquely represented by an integer polynomial which has no non-trivial divisors and a positive leading coefficient. The degree of this unique representative polynomial is called the degree of the algebraic number. For instance, f is this unique representative of 2, whereas g has a negative leading coefficient, and h is reducible as h(x)=f(x)·(x2+2x+2).

Irreducibility of a polynomial often means that it is non-constant and has no non-constant divisor of smaller degree, and in the preliminary version of this work [24] we used such a definition. Isabelle 2018, however, uses the following predicate Inline graphic for arbitrary commutative rings.

Definition 3

graphic file with name 10817_2018_9504_Figaa_HTML.jpg

Here Inline graphic is Isabelle’s notation for divisibility. This definition is stronger than the polynomial-specific version. In particular, Inline graphic for non-constant integer polynomial f demands that f is content-free, i.e., the GCD of the coefficients of f is 1; otherwise, f is “reducible” by the GCD. For instance, the integer polynomial k above is reducible since k(x)=(x2-2)·2. Note also that the definitions are equivalent on field polynomials.

We adopt this stronger definition in the current work, and formulate the uniqueness statement as follows.

Lemma 2

graphic file with name 10817_2018_9504_Figad_HTML.jpg

Typical uniqueness results found in the literature (e.g., [11, pp. 700] and [20, pp. 319]) state that there is a unique representative polynomial of the minimum degree. Our claim is more useful for computing the unique representative: if we find any irreducible polynomial representing a number, then we do not have to search for other polynomials of lower degree that represent the same number. The typical statement is easily obtained from Lemma 2; actually the irreducible representative polynomial is of the minimum degree.

Corollary 1

graphic file with name 10817_2018_9504_Figae_HTML.jpg

To prove Lemma 2 we first show that polynomials over a unique factorization domain (UFD) forms a UFD again. Whereas the class Inline graphic was (independently) introduced to Isabelle 2016-1 for UFDs, it demands several extra operations, i.e., Inline graphic , Inline graphic , Inline graphic , etc., to derive that polynomials over a UFD form a UFD. We instead define a more general class Inline graphic : graphic file with name 10817_2018_9504_Figak_HTML.jpg Here the first assumption claims that for every non-zero and non-unit element f in the domain, there exists a multiset Inline graphic of irreducible factors of f, denoted by the predicate Inline graphic . The second assumption claims that for any element f, any two irreducible factorizations F and G of f are “associated”, i.e., F and G contain the same number of factors, f1,,fn and g1,,gn, such that Inline graphic . Here Inline graphic is defined as Inline graphic .

In this general setting we show that polynomials over a UFD form a UFD. graphic file with name 10817_2018_9504_Figaq_HTML.jpg This result is instantly lifted to any multivariate polynomials; if α is of sort Inline graphic , then so is Inline graphic , and thus so is Inline graphic , and so on. This is crucial for formalizing addition and multiplication of algebraic numbers, where we extensively use bivariate polynomials.

We also establish a connection between Inline graphic and the already existing locale Inline graphic . Thus we can derive results from Inline graphic , e.g., that irreducibility and primality are equivalent in UFDs. This yields that for an irreducible integer polynomial f with positive leading coefficient, the GCD of f and any polynomial g is either 1 or f itself:

Lemma 3

graphic file with name 10817_2018_9504_Figax_HTML.jpg

To prove Lemma 2 we further show that the GCD of two integer polynomials stays the same up to a constant factor if we embed Z into R or C.

Lemma 4

graphic file with name 10817_2018_9504_Figay_HTML.jpg

Our proof of Lemma 2 then works as follows: Assume that f and g are two different, positive and irreducible integer polynomials with a common real or complex root a. That is, f and g as real or complex polynomials have a common factor x-a and hence, their GCD is a non-constant polynomial. On the other hand, the GCD of f and g as integer polynomials must be 1: it cannot be f or g itself, since fg.

Unique Representation or Not?

Despite the existence of a unique (and minimal) representative polynomial of an algebraic number, it is a priori questionable whether it is a good choice in an implementation to stick to the unique representative polynomials. There is a trade-off between the cost of computing unique representatives from arbitrary representations via polynomial factorization, and the penalty of not using minimal representations in a sequence of operations.

We answer this question experimentally by computing representations of the algebraic numbers i=1ni for various n. In one configuration we stick to the unique representatives and perform complete polynomial factorization after each addition. In another configuration we only perform the efficient square-free factorization that eliminates duplicate factors.

The result is reported in Table 1, where the computation time t and the degree d of the representing polynomial is reported as t / d. Here the benefit of complete factorization is clear; the growth of the degrees is so rapid that manipulating the high-degree polynomials is more costly than applying complete factorization each time.

Table 1.

Computation time/degree of representing polynomials for i=1ni

Factorization n=6 n=7 n=8 n=9 n=10
Square-free 0.054s/64 0.807s/128 19.725s/256 3m19s/384 1h48m/768
Complete 0.019s/8 0.044s/16 0.080s/16 0.080s/16 0.117s/16

Hence we choose irreducible polynomials for representing algebraic numbers; however for those of degree 1, i.e., the rational numbers, there is already an efficient implementation. When implementing a binary arithmetic operation on algebraic numbers, we actually implement two variants: one on a rational and an algebraic number, and another one on two algebraic numbers. The former variant is faster to execute than the more generic latter one. This special treatment for rational numbers explains why there is no measurable difference in Table 1 in the computation time of i=18i and i=19i: the last addition when computing

i=18i+9=i=18i+3=

will be the efficient “rational + algebraic”-addition.

Synthesizing Representative Polynomials

In order to define arithmetic operations over algebraic numbers, the first task is the following: Given polynomials that represent the input numbers, compute a polynomial that represents the output number. In the sequel, we will illustrate the constructions for the various arithmetic operations in ascending difficulty.

Constants

Obviously, a rational number a=nd can be represented by dx-n.

Definition 4

graphic file with name 10817_2018_9504_Figaz_HTML.gif

Lemma 5

graphic file with name 10817_2018_9504_Figba_HTML.gif

Isabelle’s implementation of the rational numbers ensures that n and d are coprime and d1. Therefore the polynomial is already positive and irreducible.

Lemma 6

graphic file with name 10817_2018_9504_Figbb_HTML.gif

Negation and Inverse

Consider an algebraic number a represented as a root of f(x)=i=0mfixi. To represent the unary minus -a, the polynomial Inline graphic , defined as f(-x), i.e., i=0m(-1)ifixi, does the job.

Lemma 7

graphic file with name 10817_2018_9504_Figbd_HTML.jpg

For the inverse 1a, it is also not difficult to show that the reciprocal polynomiali=0mfixm-i, which is defined in Isabelle 2018 as Inline graphic , has 1a as a root.

Lemma 8

graphic file with name 10817_2018_9504_Figbf_HTML.jpg

It is beneficial to also show that Inline graphic and Inline graphic preserve irreducibility, since otherwise we would have to perform polynomial factorization to maintain the invariant of always working on irreducible polynomials. We argue as follows: Suppose that f is irreducible and represents a. Clearly Inline graphic preserves the degree and content; thus if Inline graphic is reducible, then there is a polynomial h of smaller degree that represents -a. Since Inline graphic represents -(-a)=a, we obtain a polynomial representing a whose degree is smaller than f. This contradicts the uniqueness of f.

The same argument works also for Inline graphic , and we formalize the following lemma that generalizes the two.

Lemma 9

graphic file with name 10817_2018_9504_Figbm_HTML.jpg

By instantiating b in the lemma by -a, g by Inline graphic , and I by Inline graphic , we obtain the desired result for Inline graphic . Similarly we easily obtain the result for Inline graphic .

Lemma 10

graphic file with name 10817_2018_9504_Figbr_HTML.jpg

Lemma 11

graphic file with name 10817_2018_9504_Figbs_HTML.jpg

Multiplication and Addition with Rational Numbers

If we had chosen rational polynomials to represent algebraic numbers, it would be easy to add or multiply a rational number to an algebraic number: when f represents a, the rational polynomials f(x-nd) and f(dn·x) represent a+nd and a·nd, respectively. In our current formalization, however, we work with integer polynomials for efficiency reasons. As neither f(x-nd) nor f(dn·x) is in general an integer polynomial, we define the polynomials slightly differently.

To represent a·nd, we use the following constant multiple of f(dn·x):

nm·fdn·x=i=0mfi·di·nm-i·xi

where f(x)=i=0mfi·xi. Similarly, for a+nd we first compute dm·f(1d·x), and compose this polynomial and dx-n to obtain dm·f(x-dn). In the following definition, fpg denotes the polynomial composition f(g(x)), and the monomial cxn is denoted by Inline graphic .

Definition 5

graphic file with name 10817_2018_9504_Figbu_HTML.jpg

We prove the desired correctness results in a straightforward way.

Lemma 12

graphic file with name 10817_2018_9504_Figbv_HTML.jpg

Lemma 13

graphic file with name 10817_2018_9504_Figbw_HTML.jpg

The condition b0 in Lemma 13 stems from the fact that we are essentially performing division. In practice this just demands a special case for b=0, which trivially results in the rational number 0.

Unfortunately both Inline graphic and Inline graphic do not preserve irreducibility in terms of Definition 3 in general, since they do not preserve content; e.g., for f(x)=2x-3, the unique representation of 32, Inline graphic results in the polynomial 2x-6, which represents 3 but is not content-free. Nevertheless, we only need to eliminate content to obtain irreducibility. We define a function Inline graphic which divides all coefficients by the content, and additionally ensures a positive leading coefficient. Note that f represents a if and only if Inline graphic represents a. Since each of the above functions preserves degree, and an inverse operation can be found, we apply Lemma 9 and derive the desired irreducibility results.

Lemma 14

graphic file with name 10817_2018_9504_Figcc_HTML.jpg

Lemma 15

graphic file with name 10817_2018_9504_Figcd_HTML.jpg

n-th Root

For n-th root of a represented by f(x)=i=0mfixi, it is easy to see that f(xn), i.e., i=0mfixni, represents an.

Definition 6

graphic file with name 10817_2018_9504_Figce_HTML.jpg

Lemma 16

graphic file with name 10817_2018_9504_Figcf_HTML.jpg

We stated the result for n-th roots without using Isabelle’s operations Inline graphic and Inline graphic , because they are defined only on types Inline graphic and Inline graphic , respectively, but not on a generic field. We easily derive the results for the specific types.

Lemma 17

graphic file with name 10817_2018_9504_Figck_HTML.jpg

Lemma 18

graphic file with name 10817_2018_9504_Figcl_HTML.jpg

In contrast to previous sections, Inline graphic does not preserve irreducibility, even though it preserves contents. Consider, e.g., Inline graphic applied to x-64, the unique representative of 64. The resulting polynomial is x4-64, which can be factored into (x2-8)·(x2+8). Also for the polynomials obtained from addition and multiplication of two algebraic numbers, we cannot ensure irreducibility in general. We address this issue in Sect. 5.3.

Addition and Multiplication of Algebraic Numbers

To add or multiply two irrational algebraic numbers a and b, respectively represented as roots of polynomials f and g, we must compose non-zero polynomials Inline graphic and Inline graphic that have a+b and a·b as a root.

For this purpose the resultant is a well-known solution. The resultant of the polynomials f(x)=i=0mfixi and g(x)=i=0ngixi is defined as Res(f,g)=det(Sf,g), where Sf,g is the Sylvester matrix:

graphic file with name 10817_2018_9504_Equ12_HTML.gif

Note that if f and g are univariate, then Res(f,g) is a constant. We write Resx(f(x),g(x)) for Res(f,g) when the resolved variable x should be clarified. If f and g are bivariate then Resy(f(x,y),g(x,y)) is a univariate polynomial over x.

We first state the desired result for addition. Here, Inline graphic is defined as the univariate polynomial Resy(f(x-y),g(y)).

Lemma 19

graphic file with name 10817_2018_9504_Figcr_HTML.jpg

We perform multiplication through division by the inverse, and division as follows: Inline graphic is defined as Resy(f(x·y),g(y)) and Inline graphic ensures that g does not represent 0, so that in particular b0.

Lemma 20

graphic file with name 10817_2018_9504_Figcu_HTML.jpg

To prove each lemma, we need to prove two claims: the resultant has a desired root, and is a non-zero polynomial. In the next sections we prove each of the claims.

Resultant has Desired Roots

For non-constant polynomials f and g over a commutative ring, we can compute polynomials p and q such that for arbitrary x,

Res(f,g)=p(x)·f(x)+q(x)·g(x). 1

To formally prove the result, we first define a function Inline graphic that operates on the Sylvester matrix. For each j-th column except for the last one, Inline graphic adds the j-th column multiplied by xm+n-j to the last column. Each addition preserves determinants, and we obtain the following equation:

graphic file with name 10817_2018_9504_Equ2_HTML.gif 2

Note here that only the last column depends on x. We can extract this column using the Laplace expansion, which we formalize as follows.

Lemma 21

graphic file with name 10817_2018_9504_Figcx_HTML.jpg

Here Inline graphic just means that A is an n×n matrix over the considered ring, and Inline graphicAij is defined as Inline graphic, where B is the minor matrix of A obtained by removing the i-th row and j-th column. Thus we can remove the last column of the matrix A in (2), by choosing j=m+n-1. Note that then every Inline graphic is independent from x. We obtain p and q in (1), as Res(f,g) is represented as follows:

graphic file with name 10817_2018_9504_Equ13_HTML.gif
Lemma 22

graphic file with name 10817_2018_9504_Figda_HTML.jpg

The lemma implies that, if f and g are polynomials of positive degree with a common root, say f(a)=g(a)=0, then

Res(f,g)=p(a)·f(a)+q(a)·g(a)=0

The result is lifted to the bivariate case: f(a,b)=g(a,b)=0 implies that Resy(f(a,y),g(a,y))=0 for all a and b.

Lemma 23

graphic file with name 10817_2018_9504_Figdb_HTML.jpg

Here, Inline graphic is our notation for bivariate polynomial evaluation.

Now for univariate non-zero polynomials f and g with respective roots a and b, the bivariate polynomials f(x-y) and g(y) have a common root at x=a+b and y=b. Hence, Lemma 23 indicates that the univariate polynomial Resy(f(x-y),g(y)) has x=a+b as a root.

Lemma 24

graphic file with name 10817_2018_9504_Figdd_HTML.jpg

We need a variation of Lemma 24 in which Inline graphic and Inline graphic are of type Inline graphic while Inline graphic and Inline graphic are still of type α. We prove some homomorphism lemmas to obtain the following:

Lemma 25

graphic file with name 10817_2018_9504_Figdj_HTML.jpg

Analogously, if b0, then f(x·y) and g(y) have a common root at x=a/b and y=b.

Lemma 26

graphic file with name 10817_2018_9504_Figdk_HTML.jpg

Resultant is Non-Zero

Now consider the second claim: Inline graphic and Inline graphic are non-zero polynomials. Note that they would otherwise have any number as a root. Somewhat surprisingly, formalizing this claim is more involved than the first one.

We first strengthen Lemma 22, so that p and q are non-zero polynomials. Here, we require an integral domain Inline graphic , i.e., there exist no zero divisors.

Lemma 27

graphic file with name 10817_2018_9504_Figdo_HTML.jpg

The proof is easy for the case where Res(f,g) is non-zero: we obtain p and q using Lemma 22, and it is easy to see that p·f+q·g cannot be a constant if p=0 or q=0, using the constraints on degrees. For the case Res(f,g)=0, we formalize the classical result that linear equation Av=0 on an integral domain has a non-zero solution if and only if det(A)=0. Since resultants are the determinants of Sylvester matrices, from a non-zero solution to Sf,gv=0 one can extract non-zero polynomials p and q as a solution to p·f+q·g=0.

If Res(f,g)=0, then from Lemma 27 we have p·f=-q·g. In UFDs, this implies that f and g cannot be coprime, i.e., that f and g have a common factor, since otherwise f must divide -q, contradicting degree(f)>degree(q).

The definition of the predicate Inline graphic in Isabelle 2018 relies on the definition of Inline graphic . We generalize Inline graphic as follows in order to state the above for arbitrary UFDs:

Definition 7

graphic file with name 10817_2018_9504_Figds_HTML.jpg

Lemma 28

graphic file with name 10817_2018_9504_Figdt_HTML.jpg

Finally, we reason that Resy(f(x-y),g(y)) and Resy(f(x·y),g(y)) are non-zero polynomials by contradiction. As f and g are integer polynomials—a UFD— there exist irreducible factorizations: f=f1fm and g=g1gn. The operation of transforming a univariate polynomial f(x) to the bivariate f(x-y) is a ring homomorphism, and moreover preserves irreducibility. Thus,

f(x-y)=f1(x-y)fm(x-y)

is an irreducible factorization. The same property clearly holds for the transformation from g(x) to g(y), and we get an irreducible factorization of g(y):

g(y)=g1(y)gn(y) 3

Now suppose that Resy(f(x-y),g(y))=0. Then Lemma 28 implies that f(x-y) and g(y) have a common proper factor. Without loss of generality consider an irreducible one h(xy). In UFDs, this implies that graphic file with name 10817_2018_9504_Figdu_HTML.jpg for some im and jn. By fixing y, e.g., to 0, we conclude fi(x) divides a constant gj(0), and hence fi is a constant. This contradicts the assumption that fi is a proper factor of f.

The reasoning is similar for division, but note that the transformation from f(x) to f(x·y) does not preserve irreducibility: monomial x is irreducible but x·y is not. Nevertheless it is a ring homomorphism and we have a (possibly reducible) factorization:

f(x·y)=f1(x·y)fm(x·y)

Now if Resy(f(x·y),g(y))=0, then we obtain an irreducible factor h(xy) by the same reasoning as above. We still have the irreducible factorization (3) for g(y), and thus Inline graphic for some j.

As h(xy) is irreducible and divides f(x·y), it divides some fi(x·y). Here we need the fact that irreducibility and primality coincide in UFDs. Hence, graphic file with name 10817_2018_9504_Figdw_HTML.jpg Now we fix x to 0. Then we conclude that gj(y) divides a constant fi(0), and hence gj is a constant, leading to a contradiction (the case fi(0)=0 will ultimately be handled by the assumption that g does not represent 0). This proves that Inline graphic and Inline graphic are non-zero polynomials, completing our proof of Lemma 19 and Lemma 20.

Computing the Resultant

Resultants can be computed by first building the Sylvester matrix and then computing its determinant by transformation into row echelon form. A more efficient way to compute resultants has been developed by Brown and Traub: the subresultant polynomial remainder sequence (PRS) algorithm [2, 3].

The algorithm computes Res(f,g) in the manner of Euclid’s algorithm. It repeatedly performs the polynomial division on the two input polynomials and replaces one input of larger degree by the remainder of the division.

We first consider all computations over the fraction field Inline graphic , where all division operations are inherently exact. We then prove that intermediate values stay of form a1; that is, we can use a partial division operator Inline graphic on the integral domain α, that satisfies Inline graphic for b0, but not necessarily Inline graphic . Therefore, our final implementation works solely on the integral domain, without requiring fraction field operations.

The j-th subresultant of the polynomials f and g with f(x)=i=0mfixi and g(x)=i=0ngixi is defined as follows:

graphic file with name 10817_2018_9504_Equ4_HTML.gif 4

Note that, in contrast to resultants, the subresultant of polynomials is a polynomial of the same type. However, due to equation (2), Sub0(f(x),g(x)) is actually the constant Res(f,g).

Lemma 29

graphic file with name 10817_2018_9504_Figed_HTML.gif

Using the following lemma, we can always assume degree(f)degree(g). In the remainder of this section, we write m for degree(f) and n for degree(g).

Lemma 30

Inline graphic

Following Brown and Traub [3], we then formalize the following lemma, showing that a Euclidean algorithm can be used to compute subresultants. As in the Euclidean algorithm, we require a polynomial h such that h=f+b·g for some b, where l=degree(h)<n.

Lemma 31

(Subresultants via Euclidean algorithm)

  1. j<lInline graphic

  2. Inline graphic

  3. Inline graphic

  4. Inline graphic

For non-field polynomials, and in particular bivariate polynomials, polynomial division is not always possible, but pseudo-division is: we can find h such that h=d·f+b·g for some constant d. The following lemma allows us to use pseudo-division instead of division in subresultant computation.

Lemma 32

graphic file with name 10817_2018_9504_Figee_HTML.gif

Iterated application of pseudo-division results in repeated multiplication with constants dn-j, and hence the coefficients of the processed polynomials increase exponentially. One approach to keep the coefficients small is to divide the polynomials by their content in every iteration, as in Collin’s primitive PRS algorithm [3, Sect. 4]. We have implemented this approach for the preliminary version [24] of this paper.

This work additionally formalizes the more sophisticated subresultant PRS algorithm of Brown and Traub [2, 3]. Here, a constant Inline graphic —the leading coefficient of a subresultant of the input polynomials—is carried around as an extra argument. It is used to perform exact divisions on the pseudo-remainder polynomials without the necessity to calculate the content in every iteration.

The core of this algorithm is formalized as follows, where Inline graphic is an Isabelle function that divides a polynomial by a constant.

Definition 8

graphic file with name 10817_2018_9504_Figeh_HTML.jpg

The above function works under the invariant that n<m (so that δ-10 in Definition 8) and in particular the invariant that all divisions are exact. Thus as the initial step we establish these invariants, and obtain a suitable initial value for Inline graphic .

Definition 9

graphic file with name 10817_2018_9504_Figej_HTML.jpg

The invocation of Inline graphic returns a pair (hd), where h is a scalar multiple of the GCD of Inline graphic and Inline graphic , and Res(f,g)=d if degree(h)=0, and Res(f,g)=0 otherwise.

In addition to the definitions of Inline graphic and Inline graphic we develop an optimized implementation in the form of code equations. These optimizations include treating common cases separately, avoiding calculating the same value twice, and replacing expressions like (-1)δ+1·h by a single negation. We also integrate the efficient calculation of Inline graphic described by Ducos as dichotomous Lazard [8, Sect. 2], but we did not integrate Ducos’ second optimization about the calculation of Inline graphic in Definition 8.

We define the final function as Inline graphic , and prove the following correctness result as a code equation:

Lemma 33

graphic file with name 10817_2018_9504_Figes_HTML.jpg

We also define a function Inline graphic that returns the GCD of two polynomials based on Inline graphic , and get a correctness result:

Lemma 34

graphic file with name 10817_2018_9504_Figev_HTML.jpg

We do not state Lemma 34 as a code equation, since on simple polynomials, e.g., of type Inline graphic , we experimentally see that the algorithm performs worse than the standard GCD implementation. The algorithm becomes beneficial for multivariate polynomials, e.g., Inline graphic .

Real Algebraic Numbers

In the previous two sections, we have seen how to synthesize a polynomial f representing an algebraic number a as one of its root. To unambiguously represent a, we need to specify which root of f is actually a. Moreover, we need a concrete representation of real algebraic numbers. Both of these problems are addressed in this section, resulting in a verified implementation of real algebraic numbers.

Datatypes for Real Algebraic Numbers

For representing real algebraic numbers, we develop a hierarchy of four layers.

On the lowest, Layer  1 (cf. Fig. 2), we define the type Inline graphic that represents a real algebraic number a as a triple (flr), where [lr] is a rational interval in which only a is a root of f. The function Inline graphic takes such a triple and gives back aInline graphic . This function is defined only on triples that represents exactly one algebraic number, which is ensured as a part of the invariant Inline graphic . The invariant additionally demands that the representative polynomials are irreducible and have positive leading coefficients, and that the lower- and upper-bounds of the interval have the same sign. For instance, in Fig. 3 the three roots a1, a2, and a3 of f are represented by the triples (f,l1,r1), (f,l2,r2), and (f,l3,r3), respectively, as each interval [li,ri] contains exactly one root ai. Note also that the intervals may be overlapping.

Fig. 2.

Fig. 2

Internal type hierarchy for representing real algebraic numbers, including invariants and conversions to real numbers

Fig. 3.

Fig. 3

Representing all roots a1, a2, and a3 of some polynomial f

Layer 2 introduces the datatype Inline graphic , which takes a special treatment for rational numbers, so that computations involving only rational numbers will not experience overheads that would arise by manipulating roots of polynomials as in Layer  1. Hence, Inline graphic demands that the (flr)-form is used only for algebraic numbers of degree at least 2. In Inline graphic , we additionally store the index of the root, counted from the smallest to the largest.

Layer 3 introduces the type Inline graphic , which is identical to Inline graphic but now Inline graphic is enforced by the type system.

Layer 4 introduces the quotient type Inline graphic , that identifies different representations of the same number. Hence, the built-in equality of Isabelle/HOL on Inline graphic corresponds to equality on the represented real numbers. We do not have this property in other layers, since they still permit a number to be represented differently; e.g., 2 is encoded by (x2-2,1,2), (x2-2,1.4,1.5), etc.

In each layer we define algebraic operations that are formalized in Sect. 3. Here we take the computation of -a as a first simple example, cf. Fig. 4. Other arithmetic operations like addition require factorization and root separation which will be discussed in Sect. 5.3.

Fig. 4.

Fig. 4

Definitions and properties for negation illustrated for all layers

In Layer  1, Inline graphic computes the new representative polynomial Inline graphic , and takes [-r,-l] as the new interval. To satisfy the invariant that the leading coefficient is positive, Inline graphic , which just negates the polynomial if the leading coefficient is negative, is applied. The correctness lemma states that the invariants are preserved and the desired -a is represented.

In Layer  2, we perform a simple case-analysis on whether the represented number a is rational or not. If it is, then we use the rational number -a, and otherwise invoke Inline graphic from Layer  1. Afterwards, Inline graphic is applied. This function converts the triple representation into Inline graphic by either extracting the rational root if f is linear, or by computing the index of the root by invoking Sturm’s method.

Lifting the algorithms and the correctness lemma from Layer  2 to Layer s  3 and 4 is then immediate using Isabelle’s lifting and transfer package [14].

Comparison and Tightening Intervals

As we work on unique representative polynomials, we can immediately determine the equality of two algebraic numbers in Layer  2: they are equal if the representative polynomials and the root indices match. This test is implemented as follows, and satisfies the corresponding correctness statement. graphic file with name 10817_2018_9504_Figfq_HTML.jpg

Lemma 35

graphic file with name 10817_2018_9504_Figfr_HTML.jpg

We can efficiently compare an algebraic number a and a rational number q. Suppose that a is irrational and represented by (flr). Then a=q is impossible as q is rational, so we want to know whether a<q or q<a. It is trivial if q[l,r], and otherwise we compare the signs of f(q) and f(r): we know a<q if the signs coincide, and q<a otherwise (see Fig. 5).

Fig. 5.

Fig. 5

Comparing an algebraic number a and a rational number q. In this case, we know q<a since f(q) and f(r) have different signs

Definition 10

graphic file with name 10817_2018_9504_Figfs_HTML.jpg

Using this comparison with rational numbers, we can tighten the intervals to arbitrary precision: by taking, e.g., q=l+r2 one can halve the interval to [lq] or [qr], depending on whether a<q or q<a.

Being able to tighten intervals, we can implement the Inline graphica and Inline graphica operations: tighten the interval of a until it contains at most one integer point, and then use the sign-based comparison to determine whether a is less or greater than the integer.

We can also compare two irrational algebraic numbers a and b by tightening intervals. The implementation of the comparison functions4 for the first two layers is shown in Fig. 6.

Fig. 6.

Fig. 6

Comparison for the first two layers

In Layer  1, if a and b have disjoint intervals, then comparison is trivial. Otherwise Inline graphic tightens the intervals of a and b until they become disjoint. The procedure is terminating only if ab, since intervals will never become disjoint if a=b. Hence Isabelle’s partial-function command [16], that allows defining potentially nonterminating procedures, becomes essential. In order to conveniently prove correctness, we define some well-founded relations for inductive proofs, which are reused for various bisection algorithms. For instance, we define a relation based on a decrease in the size of the intervals by at least δ, where δ is the separation distance, i.e., the minimal distance of two distinct roots of some polynomial.

In Layer  2, Inline graphic invokes a suitable comparison function depending on rationality: Isabelle’s standard Inline graphic for two rational numbers, Inline graphic if exactly one of the inputs is rational, and Inline graphic for two irrational numbers. Before invoking Inline graphic , Inline graphic first tests equality in order to ensure termination.

Polynomial Factorization and Root Separation

Recall the invariant of Layer  1: the representing polynomial must be irreducible and have exactly one root in the provided interval. Hence, after synthesizing a polynomial f to represent an algebraic number a, we must further ensure irreducibility of f and provide an interval in which a is the only root of f.

For unary minus and multiplicative inverse, Lemmas 10 and 11 ensure irreducibility, and moreover the obvious intervals [-r,-l] and [r-1,l-1] work, where [lr] is the interval for the input. For other arithmetic operations from Sect. 3, the synthesized polynomial is not generally irreducible, and obviously derived intervals may contain multiple roots.

We first establish irreducibility by a formalized polynomial factorization algorithm [7], and obtain irreducible polynomials f1,,fn, such that exactly one of them represents the desired a. So the remaining task is to determine which fi has a as a root, and to provide an interval in which a is the only root of fi.

We achieve the two goals in one go. Our algorithm maintains: the current interval [lr], which contains the desired a; a list F of candidate polynomials which have at least one root in the interval; and the total number n of roots the candidates have in the interval.

The procedure returns if n=1; in this case, F contains exactly one polynomial, and this polynomial represents a. Otherwise, it tightens [lr], and then updates n and simultaneously excludes those factors from F that have no root in [lr]. We will explain later in this section how to count the number of real roots a polynomial f has in a given interval.

Note that this procedure terminates only if exactly one candidate polynomial has a as a root. Consequently, we again use partial-function to define the procedure in Isabelle.

How [lr] is tightened depends on the actual operation we are computing. Hence we model the algorithm abstractly using the two functional parameters: graphic file with name 10817_2018_9504_Figgd_HTML.jpg The type variable β represents states, which contain sufficient information to maintain intervals. The interval is retrieved by the function Inline graphic , and Inline graphic updates one state to another in which a tighter interval is obtained.

For instance, if a is the addition of b and c, represented by (g,lb,rb) and (h,lc,rc), then the state is a quadruple (lb,rb,lc,rc), Inline graphic returns [lb+lc,rb+rc], and Inline graphic tightens intervals of b and c using the bisection algorithm Inline graphic of Sect. 5.2. Multiplication a=b·c is treated in the same way, except that Inline graphic returns the interval [lb·lc,rb·rc]; here, the main bisection algorithm for multiplication is only invoked on positive numbers, and a separate algorithm takes care of the signs.

Finally, for computing the n-th root a=bn of a positive number b, the state is an interval [la,ra] containing a, where initially la=lbn and ra=rbn. In every iteration of Inline graphic , we first compute the rational number m=la+ra2. We then compare m with a by comparing mn with b. This detour is necessary, since the latter comparison can be computed using Inline graphic from Sect. 5.2, whereas the former comparison is problematic since a is not available. Finally, we update the interval [la,ra] to one of the tighter intervals [la,m], [mm], or [m,ra], depending on whether a<m, a=m, or m<a.

We present the correctness statement of the generic factor selection procedure only on Layer  2 where the functions Inline graphic and Inline graphic are implicit arguments to Inline graphic , and where Inline graphic is iterated function application of Inline graphic on input Inline graphic .

Lemma 36

graphic file with name 10817_2018_9504_Figgs_HTML.jpg

The actual correctness proof in Layer  1 is a rather involved inductive proof; the well-foundedness of the induction relation depends on the convergence of the bounds towards Inline graphic , and the statement uses 12 invariants that are maintained throughout the proof.

It remains to count how many roots a polynomial f has in a given interval. We implement such a root-counting function Inline graphic using Sturm’s method, with a special treatment for linear polynomials. We extend the existing formalization by Eberl [9], which takes a real polynomial and real bounds, so that it can be applied on rational polynomials with rational bounds; nevertheless, the number of real roots must be determined. This extension is crucial as we later implement the real numbers by the real algebraic numbers via data refinement [13]; at this point we must not yet use real number arithmetic. The correctness of this extension is shown mainly by proving that all algorithms utilized in Sturm’s method can be homomorphically extended. For instance, for Sturm sequences we formalize the following result:

Lemma 37

graphic file with name 10817_2018_9504_Figgv_HTML.jpg

For efficiency, we adapt the algorithm for our specific purpose. Sturm’s method works in two phases: the first phase computes a Sturm sequence, and the second one computes the number of roots by counting the number of sign changes on this sequence for both the upper and the lower bounds of the interval. The first phase depends only on the input polynomial, but not on the interval bounds. Therefore, for each polynomial f in the candidate list F we precompute the Sturm sequence once, so that when a new interval is queried, only the second phase of Sturm’s method has to be evaluated. This can be seen in the following code equation:

Lemma 38

graphic file with name 10817_2018_9504_Figgw_HTML.jpg

Implementing Real and Complex Numbers via Real Algebraic Numbers

Having the arithmetic operations on real algebraic numbers, we now provide code equations to implement the real numbers via real algebraic numbers by data refinement, where Inline graphic is converted into a constructor in the generated code.

Lemma 39

(Code lemmas) graphic file with name 10817_2018_9504_Figgy_HTML.jpg

Note that in Lemma 39, the left-hand side of the equality is addition for type Inline graphic , whereas the right is addition for type Inline graphic .

As a consequence, Isabelle users now can specify algorithms using algebraic operations on type Inline graphic and will obtain executable code which uses our verified real algebraic number implementation. Similarly, one can prove a lemma over real numbers like Inline graphic by evaluation.

To implement complex algebraic numbers, we require nearly nothing: Isabelle implements complex numbers as pairs of real numbers representing the real and imaginary part, and this is possible also in the algebraic setting. Note that a complex number is algebraic if and only if both the real part and the imaginary part are algebraic. Thus, all of the following operations become executable on the complex numbers for free: +, −, ·,  / , ·, =, and complex conjugate. These operations are already implemented via operations on the real numbers, and computed by real algebraic numbers via data refinement. For instance, complex square roots are computed as

graphic file with name 10817_2018_9504_Equ14_HTML.gif

Another approach to implement complex algebraic numbers would be to use one representing polynomial in combination with a rectangle in the complex plane to uniquely identify roots, instead of using two real algebraic numbers, each requiring its own representing polynomial and interval. As most of our results have been formalized in a generic way, this would become possible if one had replaced the bisection algorithms by similar methods to separate complex roots, e.g., by formalizing results by Kronecker [23, Sect. 1.4.4]. Li provides such a complex root counting algorithm in the AFP [17]. However, his verified implementation currently has some limitations resulting in runtime errors, which makes it at least hard, to use it as a bisection algorithm which must always succeed.

Displaying Algebraic Numbers

We provide two approaches to display real algebraic numbers, i.e., two functions Inline graphic of type Inline graphic . The first one displays an approximative value of an algebraic number a. Essentially, the rational number 1000a1000 is computed and displayed as a string. For instance, 2 is displayed as “ 1.414”.

The second approach displays an algebraic number without approximation, canonically in form “root #n of f”. For Layer  4 we have to prove that this approach actually defines a function, i.e., f and n are uniquely defined by the represented algebraic number. This result easily follows from the invariant that we use irreducible polynomials in combination with their uniqueness, Lemma 2.

Besides this well-definedness result, we also prove soundness in the following sense. The function Inline graphic first invokes a function Inline graphic where graphic file with name 10817_2018_9504_Fighg_HTML.jpg It then converts these intermediate values into strings.

Whereas there is no soundness statement for the final Inline graphic , we prove the following result for Inline graphic .

Lemma 40

graphic file with name 10817_2018_9504_Fighj_HTML.jpg

Using Inline graphic , we define a function for displaying values of type Inline graphic and then provide its executable implementation via a code equation.

Definition 11

graphic file with name 10817_2018_9504_Fighm_HTML.jpg

Lemma 41

graphic file with name 10817_2018_9504_Fighn_HTML.jpg

Using Inline graphic , it is trivial to display complex numbers. Here we only present a simplified definition. The actual definition produces nicer strings if the imaginary part or real part are zero. In the definition, Isabelle’s list-append operator Inline graphic is used for string concatenation.

Definition 12

graphic file with name 10817_2018_9504_Fighq_HTML.jpg

Real and Complex Roots of Rational Polynomials

In this section, we provide executable functions which identify all real or complex roots of an integer or rational polynomial, as illustrated in Example 1. Without loss of generality we only consider integer polynomials, since every rational polynomial can be converted into an integer polynomial with the same roots, namely by multiplying with the common denominator of the coefficients.

Based on the root finding algorithms, we also provide complete real and complex polynomial factorization algorithms, that work for polynomials with rational coefficients.

Real Roots of Integer Polynomials

We cannot yet represent the roots of an arbitrary polynomial f as Inline graphic , ..., Inline graphic as in Example 1, since we have to establish the invariant that f is irreducible, and provide an interval for each root.

Example 2

The polynomial f=-14+63x+49x2+-490x3+469x4+21x5+-126x6 has three real roots. The algorithm for computing all roots of f will result in the rational number 13 and the first two roots of g=2+3x+-7x2+x3+2x4, which are irrational and are the unique roots of g in the intervals [-4,-2] and [-2,0].

So, essentially the construction works in three steps:

  1. integer polynomial factorization: f=-7·(-1+3x)2·g in Example 2

  2. construction of initial bounds for roots: all roots of g are within [-8,8]

  3. bisection until one finds intervals for all roots: the roots of g are the unique roots of g in the intervals [-4,-2] and [-2,0]

For the first step we use again the formalized polynomial factorization algorithm. Then we develop an algorithm that, given an irreducible polynomial f, produces a list of intervals such that each interval contains exactly one root of f, and every root of f is contained in one of them. Below we provide more details on the second and third step.

Root Bounds

Instead of searching the infinite real space for roots of a polynomial, we start with a closed interval. There are some known bounds on the maximal absolute value of roots of a polynomial. Among them we choose Cauchy’s bound, as it is efficient and easy to formalize, and gives sufficient precision for our purpose.

The Cauchy boundC(f) of a non-zero polynomial f(x)=i=0mfixi is defined as follows:

C(f)=1+max{|f0|,,|fm-1|}|fm|

Then for any root a of f, we have |a|C(f). In the implementation, we do not start with the exact computed bound, which most often is a fraction. Instead, we start with the smallest power of 2 such that 2nC(f). The advantage is that then the bisection algorithm avoids fractions as long as possible. In Example 2, C(g)=92 and hence, we choose 8 as the initial bound.

Definition 13

graphic file with name 10817_2018_9504_Fight_HTML.jpg

Lemma 42

graphic file with name 10817_2018_9504_Fighu_HTML.jpg

Root Separation

Now we separate the roots using a bisection algorithm. The main idea is similar to the interval tightening algorithm in Sect. 5.3. The difference is that here we keep track of all the roots. Hence the algorithm stores two lists: a work list of intervals from which roots of input f have to be found, and a result list which stores the already found intervals each containing exactly one root of f. Initially the work list is a singleton containing the interval [-B,B] where B is the initial bound explained above, and the result list is empty.

In every iteration the algorithm picks up an interval [lr] from the work list, and calls the root-counting function Inline graphic to determine the number n of real roots of f within this interval. If n=0 then the algorithm throws away this interval and carries on to the next of the work list. If n=1 then a root is identified; the representation (flr) is added to the result list. Finally, if n>1 then the algorithm splits the interval into [l,l+r2] and [l+r2,r] and pushes them back to the work list. The overlap of the intervals is not problematic, since the bisection algorithm is only invoked on irreducible polynomials of degree at least 2, which cannot have a rational root like l+r2. In particular, the algorithm will return a distinct list of roots.

The bisection algorithm is defined via Inline graphic for efficiency reasons. The root counting function Inline graphic , that is obtained after the first phase of Sturm’s method, is passed as a parameter to the main procedure, in order to avoid recomputation. If the algorithm is invoked with an unexpected function, e.g., one that always yields n=2, then it is nonterminating.

We prove that, if correct arguments are passed, then the result of the bisection algorithm is as intended. To this end, we perform well-founded induction on the work list. Here we define δ as in the bisection algorithm of Sect. 5.2, but now combine the size-measure of intervals with the multiset-extension of a well-founded order [15]. This is required, since if n>1 we replace one interval by two smaller ones.

The final correctness is stated as follows.

Lemma 43

graphic file with name 10817_2018_9504_Fighy_HTML.jpg

Complex Roots of Integer Polynomial

In contrast to Sect. 5.4, where complex algebraic numbers are easily implemented via real algebraic numbers, it is not so trivial to develop a complex-number counterpart of Inline graphic , i.e., a method to identify all complex roots of an integer polynomial f.

To identify complex roots, we formalize the following algorithm. It is based on a constructive proof of the fact that a complex number is algebraic if and only if its real and imaginary part are algebraic [22, Corollary 7.3].

  • Consider a complex root a+bi of f for a,bR. We have
    2a=(a+bi)+(a-bi)
    and since both a+bi and a-bi are roots of f, 2a is a root of Inline graphic . Hence the following polynomial g has a as a root: graphic file with name 10817_2018_9504_Figib_HTML.jpg Similarly, 2i·b=(a+bi)-(a-bi) is a root of Inline graphic , and as 2i is represented by polynomial 4+x2, the following polynomial h has b as a root: graphic file with name 10817_2018_9504_Figid_HTML.jpg
  • Let C be the set of complex numbers a+bi with Inline graphic and Inline graphic . Then C contains at least all roots of f. Return {cC.f(c)=0} as the final result.

The actual formalization of Inline graphic contains several special measures to improve efficiency, e.g., factorizations are performed in between, explicit formulas are used, symmetries are exploited, etc. In particular, we explain how we efficiently compute {cC.f(c)=0} from C.

Since we have now executable complex algebraic operations, one can in principle evaluate f(c) and test whether it is 0 or not. A drawback of this approach is the demand for manipulating polynomials of high degree. For instance, when testing Inline graphic in Example 1, complex algebraic numbers like c4 occur. These result in factorization problems for integer polynomials of degree 144.

Instead, we formalize the following algorithm based on interval arithmetic.

  • For each cC, extract the real intervals Ir and Ii from the internal representation of the real and imaginary part, respectively. Use interval arithmetic to test whether 0f(Ir+Iii). If 0 is not contained in the interval, remove c from C.

  • If |C|=degree(f), return C.

  • Tighten all bounds of C so that the extracted intervals will be half of the previous size and start again.

The filter algorithm is formalized on Layer 3, since it is the highest layer which still permits to access the internal interval bounds. Its termination is proven by showing some convergence properties, so that in particular all non-roots are eventually detected and removed. The correctness result of the Inline graphic looks as in the real case.

Lemma 44

graphic file with name 10817_2018_9504_Figii_HTML.jpg

Factorization of Polynomials over C and R

With the help of the complex roots algorithm Inline graphic and the fundamental theorem of algebra, we further develop two algorithms that factor polynomials with rational coefficients over C and R, respectively. Factorization over C is easy: every factor corresponds to a root. Hence, the algorithm and the proof mainly take care of the multiplicities of the roots and factors. Also for factorization over R, we first determine the complex roots. Afterwards, we extract all real roots and group each pair of complex conjugate roots. Here, the main work is to prove that for each complex root c, its multiplicity is the same as the multiplicity of the complex conjugate of c.

Experiments

Now we experimentally evaluate our implementation. We compare the following three implementations of algebraic numbers:

  • Old version refers to our verified implementation as described in the preliminary version of this paper [24].

  • New version refers to our current implementation of algebraic numbers as described in this paper.

  • Mathematica refers to Wolfram Mathematica 11. Here, we invoke the methods RootReduce and IsolatingInterval in order to obtain the representing polynomial and an interval which uniquely identifies the root, respectively.

Differences with the old version include:

  • The type of representing polynomials are now Inline graphic rather than Inline graphic .

  • We incorporated the verified factorization algorithm [7] while the old version uses an unverified one that does not ensure irreducibility.

  • We introduced the sign-based comparison technique (Sect. 5.2) while the old version uses Sturm’s method. Due to this, the old version has to keep Sturm sequences in internal representations while the new version does not.

  • We introduced an algorithm that finds the correct factor and a valid interval in one go (Sect 5.3), while the old version performs these tasks sequentially: it first tightens intervals until undesired roots are excluded, and then applies factorization and selects the correct factor.

  • We formalized Brown and Traub’s subresultant PRS algorithm (Sect. 4), while the old version uses a variant of Collin’s primitive PRS algorithm.

  • We apply interval arithmetic for filtering the complex roots of a polynomial from a list of candidates. In contrast, the old version utilizes algebraic number arithmetic.

All of our implementations have been tested using extracted Haskell code which has been compiled by GHC version 8.2.1 using ghc -O2. The experiments with Mathematica have been conducted within the graphical user interface using Mathematica’s Timing routine. All experiments in this paper have been executed on a 3.2 GHz 8-Core Intel Xeon W with 64 GB of RAM running macOS High Sierra.

The results of our experiments in Table 2 illustrate that our new implementation is significantly faster than the old implementation.

Table 2.

Total time for example computations with algebraic numbers

Experiment Old version New version Mathematica
(1) Examples in [18, Fig. 3] 0.032s 0.016s 0.061s
(2) Inline graphic 21.941s 0.207s 0.654s
(3) i=110i 0.422s 0.117s 0.070s
(4) i=16i3 41.779s 19.902s 0.081s
(5) (i=19i)-(i=18i) 26.459s 2.261s 0.000s

The big difference in experiment (2) is due to the use of interval arithmetic instead of expensive complex algebraic number computations (Sect. 6.2). For the other experiments, the improvements are mainly due to optimizations of the bisection algorithms and the resultant computation.

In Table 3 we report on detailed profiling information on experiments (4) and (5). The improvements in tightening intervals is due to the sign-based method (Sect. 5.2) and the combined algorithm which tightens intervals and selects correct factors at the same time (Sect. 5.3). In experiment (5) we also see that the subresultant PRS algorithm of Sect. 4 significantly improves the computation time of resultants. As a consequence of our optimizations, polynomial factorization is the main bottleneck of the new implementation.

Table 3.

Timing of individual sub-algorithms in percentage of total runtime

Experiment Algorithm Old version (%) New version (%)
(4) Tightening intervals 59.3 11.5
(4) Resultant 0.1 0.0
(4) Factorization 40.1 88.4
(5) Tightening intervals 13.3 1.5
(5) Resultant 76.1 35.9
(5) Factorization 10.7 62.6

Table 2 also reveals that there is further room for efficiency improvements in order to compete with the commercial product Mathematica. In particular in Experiment (5), Mathematica can first symbolically simplify the expression to 9 which is then easily computed. In contrast, our implementation computes the difference of two real algebraic numbers, each having minimal representatives of degree 16. Still, also our implementation has its benefit: it is formally verified.

Conclusion

We developed verified algorithms for real and complex algebraic numbers in Isabelle/HOL. These include all the algebraic operations, algorithms to identify complex roots of rational polynomials, and to uniquely present algebraic numbers as strings. The formalization is available to every Isabelle user, and the implementation is available to every programmer as verified Haskell code.

As for future work, a formalization of an equivalent to Sturm’s method for the complex numbers would admit to represent the roots in Example 1 just as root #(1,2,3,4) of Inline graphic , without the need for high-degree polynomials for the real and imaginary part. Moreover, a more efficient verified polynomial factorization algorithm would be welcome, since this algorithm is currently the most time-consuming part when computing algebraic numbers.

Finally, it would be useful to algorithmically prove that the complex algebraic numbers are algebraically closed, so that one is not restricted to rational coefficients in the factorization algorithms over R and C.

Acknowledgements

Open access funding provided by Austrian Science Fund (FWF).

Footnotes

2

The suitability test cannot simply evaluate the polynomial on the algebraic point and test whether the result is 0; evaluating at an algebraic point requires the basic arithmetic operations on algebraic numbers, which are the operations we are defining in this work.

3

However, we use a faster computer with 3.2 GHz instead of 2.66 GHz.

4

The formalization differs slightly, since the value of Inline graphic is carried around for efficiency.

This research was supported by the Austrian Science Fund (FWF) project Y757. The authors are listed in alphabetical order regardless of individual contributions or seniority. Sebastiaan is now working at University of Twente, the Netherlands, and Akihisa at National Institute of Informatics, Japan. We thank the reviewers of this paper for their helpful comments.

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

References

  • 1.Avanzini, M., Sternagel, C., Thiemann, R.: Certification of complexity proofs using CeTA. In: RTA 2015. pp. 23–39. LIPIcs 36 (2015)
  • 2.Brown WS. The subresultant PRS algorithm. ACM Trans. Math. Softw. 1978;4(3):237–249. doi: 10.1145/355791.355795. [DOI] [Google Scholar]
  • 3.Brown WS, Traub JF. On Euclid’s algorithm and the theory of subresultants. J. ACM. 1971;18(4):505–514. doi: 10.1145/321662.321665. [DOI] [Google Scholar]
  • 4.Cohen Cyril. Interactive Theorem Proving. Berlin, Heidelberg: Springer Berlin Heidelberg; 2012. Construction of Real Algebraic Numbers in Coq; pp. 67–82. [Google Scholar]
  • 5.Cohen, C., Djalal, B.: Formalization of a Newton series representation of polynomials. In: CPP 2016. pp. 100–109. ACM (2016)
  • 6.Cohen C, Mahboubi A. Formal proofs in real algebraic geometry: from ordered fields to quantifier elimination. Log. Methods Comput. Sci. 2012;8(1:02):1–40. [Google Scholar]
  • 7.Divasón, J., Joosten, S., Thiemann, R., Yamada, A.: A formalization of the Berlekamp-Zassenhaus factorization algorithm. In: CPP 2017, pp. 17–29 (2017) [DOI] [PMC free article] [PubMed]
  • 8.Ducos L. Optimizations of the subresultant algorithm. J. Pure Appl. Algebra. 2000;145:149–163. doi: 10.1016/S0022-4049(98)00081-4. [DOI] [Google Scholar]
  • 9.Eberl, M.: A decision procedure for univariate real polynomials in Isabelle/HOL. In: CPP 2015. pp. 75–83. ACM (2015)
  • 10.Eberl, M.: Linear recurrences. Archive of Formal Proofs (Oct 2017), http://isa-afp.org/entries/Linear_Recurrences.html, Formal proof development
  • 11.von zur Gathen, J., Gerhard, J.: Modern computer algebra, 2nd edn. Cambridge University Press, Cambridge (2003)
  • 12.Giesl Jürgen, Mesnard Frédéric, Rubio Albert, Thiemann René, Waldmann Johannes. Automated Deduction - CADE-25. Cham: Springer International Publishing; 2015. Termination Competition (termCOMP 2015) pp. 105–108. [Google Scholar]
  • 13.Haftmann Florian, Krauss Alexander, Kunčar Ondřej, Nipkow Tobias. Interactive Theorem Proving. Berlin, Heidelberg: Springer Berlin Heidelberg; 2013. Data Refinement in Isabelle/HOL; pp. 100–115. [Google Scholar]
  • 14.Huffman Brian, Kunčar Ondřej. Certified Programs and Proofs. Cham: Springer International Publishing; 2013. Lifting and Transfer: A Modular Design for Quotients in Isabelle/HOL; pp. 131–146. [Google Scholar]
  • 15.Jouannaud JP, Lescanne P. On multiset orderings. Inf. Process. Lett. 1982;15(2):57–63. doi: 10.1016/0020-0190(82)90107-7. [DOI] [Google Scholar]
  • 16.Krauss Alexander. Recursive Definitions of Monadic Functions. Electronic Proceedings in Theoretical Computer Science. 2010;43:1–13. doi: 10.4204/EPTCS.43.1. [DOI] [Google Scholar]
  • 17.Li, W.: Count the number of complex roots. Archive of Formal Proofs (Oct 2017), http://isa-afp.org/entries/Count_Complex_Roots.html, Formal proof development
  • 18.Li, W., Paulson, L.C.: A modular, efficient formalisation of real algebraic numbers. In: CPP 2016. pp. 66–75. ACM (2016)
  • 19.Mahboubi Assia. Automated Reasoning. Berlin, Heidelberg: Springer Berlin Heidelberg; 2006. Proving Formally the Implementation of an Efficient gcd Algorithm for Polynomials; pp. 438–452. [Google Scholar]
  • 20.Mishra B. Algorithmic Algebra. Texts and Monographs in Computer Science. New York: Springer; 1993. [Google Scholar]
  • 21.Nipkow, T., Paulson, L., Wenzel, M.: Isabelle/HOL—A Proof Assistant for Higher-Order Logic, LNCS, vol. 2283. Springer (2002)
  • 22.Niven, I.: Irrational Numbers. No. 11 in Carus Mathematical Monographs, Mathematical Association of America (1956)
  • 23.Prasolov, V.V.: Polynomials. Springer (2004)
  • 24.Thiemann René, Yamada Akihisa. Interactive Theorem Proving. Cham: Springer International Publishing; 2016. Algebraic Numbers in Isabelle/HOL; pp. 391–408. [Google Scholar]
  • 25.Thiemann, R., Yamada, A.: Formalizing Jordan normal forms in Isabelle/HOL. In: CPP 2016. pp. 88–99. ACM (2016)

Articles from Journal of Automated Reasoning are provided here courtesy of Springer

RESOURCES