Automatic Calibration of a Two-Axis Rotary Table for 3D Scanning Purposes

Abstract

Rotary tables are often used to speed up the acquisition time during the 3D scanning of complex geometries. In order to avoid manual registration of the point clouds acquired with different orientations, automatic algorithms to compensate the rotation were developed. Alternatively, a proper calibration of the rotary axis with respect to the camera system is needed. Several methods are available in the literature, but they only consider a single-axis calibration. In this paper, a method for the simultaneous calibration of both axes of the table is proposed. A checkerboard is attached to the table, and several images with different poses are acquired. An optimization algorithm is then setup to determine the orientation and the locations of the two axes. A metric to assess the calibration quality was also defined by computing the average mean reprojection error. This metric is used to investigate the optimal number and distribution of the calibration poses, demonstrating that the optimum calibration results are achieved when a wider dispersion of the calibration poses is adopted.

1. Introduction

Image-based modeling is the process of reconstructing the three-dimensional geometry and the surface appearance of a real object from its two-dimensional images. In typical applications [1] images are acquired in a controlled environment. In order to achieve a $360{}^{°}$ view of a complex object, the scanning must be repeated from different perspectives. Then, acquisition performed from different viewpoints needs to be registered, to reconstruct the full object geometry. The easiest solution to this issue is the manual point cloud registration, which is generally based on the 3-2-1 procedure: the first rough registration is manually provided by selecting three or more corresponding points on the clouds. Then, an iterative closest-point algorithm is run to refine the manual registration [2]. This procedure is robust and versatile, and it does not impose any constraints in terms of scanning perspective, but it requires long processing times. The procedure can be accelerated by gluing markers on the target surface, which can help the user to manually select the corresponding points, or can even allow for automatic algorithms [3]. Nevertheless, the marker placement may be cumbersome and also impossible to use where the surface cannot be altered. An alternative solution to this problem is represented by the use of turntables, which have proven to be effective in the reconstruction of complex shapes [4,5]. The object to be scanned can be placed on a turntable, and a stereo-camera system acquires images, while both orientation and placement of the item are changed within the work space by rotating the table by known angles. The use of a rotary table imposes a constraint to the possible scanning orientations, which can help the development of automatic algorithms to register the point clouds [6,7]. In addition, knowing the precise position and orientation of the turntable axis can further improve the registration step [8,9,10]. To this extent, a proper calibration of the acquisition system is necessary to obtain satisfying results.

The camera calibration problem has been extensively studied by researchers, and several approaches have been proposed. Linear methods [11,12] adopt a simple pinhole camera model and incorporate no distortion effects. Despite the algorithm being fast and non-interactive, neglecting camera distortion implies that lens distortion effects cannot be compensated for. Conversely, non-linear techniques [13,14,15] use general camera models, which also incorporate distortion parameters. At first, a relation between parameters is established, and then an iterative solution is found by minimizing properly defined error terms. Typically, the iterative procedure requires an initial guess, which often dictates the quality of the convergence. However, the most common approach is represented by two-step techniques [16,17,18], where in the first step, a direct solution of some parameters is given, and then an iterative procedure is followed in order to compute the other parameters as well as to reduce the error of the direct solution. The research on stereo camera systems calibration pushed forward the calibration of non-conventional optical setups based on mirrors (catadioptric systems), such as [19,20,21,22] which solve the problem of spherical mirror calibration to achieve an omnidirectional scanning.

Although technical literature well addresses the camera calibration problem, the extraction of the rotation axis of the turntable with reference to the fixed camera coordinate frame still deserves attention. Many different approaches have been found dealing with single-axis calibration: Mülayim et al. [23] proposed a multi-image approach capable of extracting the rotation axis of a single-axis turntable with respect to the camera coordinate frame. Li et al. [24] calibrated the rotation axis by means of a test sphere with a known diameter mounted on the turntable, similarly to [25]. Bi et al. [26] used a cuboid block and edge detection to assess the rotation axis. Langming et al. [27] developed a procedure based on the scanning of a cylindrical specimen. Ye et al. [28] used a planar specimen acquired in different orientations, basing the calibration on the intersection lines between subsequent planar surfaces. Chen et al. [29] formalized the problem as a constrained global optimization problem. However, these techniques do not generalize when a multi-axis turntable is considered, since each axis has to be calibrated separately, one after the other. Furthermore, no strict information about the placement of the calibration target as well as the number of images to be acquired is given in order to obtain acceptable results.

In this study, a novel approach for the calibration of a two-axis turntable is proposed. At first, a mathematical model for the rotation of a point attached to the turntable has been formalized and exploited in order to provide a minimum least-squares estimation of the two rotation axes as well as their distance with respect to the reference camera. Afterwards, a further analysis, based on optimal conditions to calibrate the rotary table, was conducted in order to optimize the estimates of the calibration process. Optimal conditions are considered to be the number and the orientation of placements of the calibration board with respect to the stereo-camera system. Qualitative criteria are finally provided based on experimental results.

2. Materials

With reference to Figure 1 the image acquisition system consisted of a fixed stereo-camera system, a rotary table, and a computer. The stereo-camera system, shown in Figure 1a, is characterized by two digital cameras with a resolution of 1600 pixel × 1200 pixel (The ImagingSource® DMK 51BU02), equipped with lenses having a 16 mm focal length, and a 1024 pixel × 768 pixel multimedia DLP projector (OPTOMA EX330e, resolution XGA 1024 pixel × 768 pixel). Figure 1b shows the two-axis rotary table developed in this work. The overall system schematic, reporting the main reference frames, is represented in Figure 2. The first axis is parallel to the camera image plane while, by construction, the second is perpendicular to the first; the two axes are also assumed to intersect each other. It is reasonable to make such an assumption, since the rotary table was designed as a CNC (Computer Numerical Control) machine with high dimensional accuracy. An asymmetrical checkerboard of 7 × 10 squares (each square having size of 12 mm × 12 mm), resulting in $M=54$ inner corners, was attached to the turntable during the image acquisition process. This pattern allows for extraction of the point sets as they are placed in corners on the squares (excluding those on the external side of the checkerboard). Therefore, information on the table configuration, through the arrangement of the points in space, can then be deduced.

Figure 1.

Main instruments used for experimentation: (a) stereo-camera system; (b) two-axis turntable with checkerboard attached.

Figure 2.

Axes and system representations: (a) 3D axonometric view; (b) 2D top view.

Each axis of the turntable was moved by means of a stepper motor, respectively a NEMA 23 for the vertical axis and a NEMA 17 for the horizontal axis. Both steppers were controlled via Arduino Uno with the addition of the Adafruit Motor Shield V2. The overall system was controlled via Matlab^® on a PC platform where a Graphic User Interface (GUI) has been developed in order to simplify the entire workflow, providing an interface that allows to control the settings of cameras, image acquisition, table calibration, and analysis results. The software is available as a free package at [30], and a brief description of the GUI is given in Appendix A.

3. Calibration Approach

The geometrical construction of the system was exploited for the implementation of a suitable calibration procedure of the two-axis turntable. We assume that the centers of the tables are disposed such that their axes intersect perpendicularly at point q. That bears the advantage to consider a single point of application of rotation for both axes. Hence, just a single position vector from the cameras is enough. Since the orientation of the camera system, chosen as a global reference, was different from those of the tables, axis-angle notation was used to describe the rotation of each table.

The general rotation of a point around an axis outside of the origin, as shown in Figure 3, is represented as follows:

$$p^{\prime }=R_{\omega }\left(\theta \right)(p-q)+q,$$ (1)

where p is a generic point positioned on a system rotating around an axis with unit vector $\omega$ going through point q, $p^{\prime }$ is the rotated point, and $R_{\omega }\left(\theta \right)$ is the axis-angle parametrization of the rotation matrix in which $\theta$ is the angle of rotation. Equation (1) can be expressed as a rigid-body transformation in homogeneous coordinates as follows:

$$\left[\begin{array}{c}{p}^{\prime }\\ 1\end{array}\right]=\left[\begin{array}{cc}{R}_{\omega }\left(\theta \right)& (I-R_{\omega }\left(\theta \right))q\\ 0& 1\end{array}\right]\left[\begin{array}{c}p\\ 1\end{array}\right]$$ (2)

Figure 3.

Rotation of a point p by an angle $\theta$ around a single axis $\omega$.

Equation (2) can be applied to the studied system. As shown in Figure 2, the axis of the horizontal table is defined as ${\omega }_1$, the axis of the vertical as ${\omega }_2$, ${\theta }_1$ is the angle of rotation around ${\omega }_1$, and ${\theta }_2$ the angle around ${\omega }_2$. Since ${\omega }_2$ lies in the reference system of the horizontal table, the global transformation must be defined in the following order:

$$\begin{array}{cc}\hfill \left[\begin{array}{c}{p}^{\prime }\\ 1\end{array}\right]& =T({\omega }_1,{\omega }_2,q;({\theta }_1,{\theta }_2))\left[\begin{array}{c}p\\ 1\end{array}\right]\hfill \\ \hfill & =\left[\begin{array}{cc}{R}_{{\omega }_1}\left({\theta }_1\right)& (I-R_{{\omega }_1}\left({\theta }_1\right))q\\ 0& 1\end{array}\right]\left[\begin{array}{cc}{R}_{{\omega }_2}\left({\theta }_2\right)& (I-R_{{\omega }_2}\left({\theta }_2\right))q\\ 0& 1\end{array}\right]\left[\begin{array}{c}p\\ 1\end{array}\right]\hfill \\ \hfill & =\left[\begin{array}{cc}{R}_{{\omega }_1}\left({\theta }_1\right)R_{{\omega }_2}\left({\theta }_2\right)& (I-R_{{\omega }_1}\left({\theta }_1\right)R_{{\omega }_2}\left({\theta }_2\right))q\\ 0& 1\end{array}\right]\left[\begin{array}{c}p\\ 1\end{array}\right]\hfill \end{array}$$ (3)

The axis-angle representation provides the advantage of being a direct function of the components of the axis unit vector for both tables. The two axis unit vectors ${\omega }_1$ and ${\omega }_2$, together with the global coordinates of their intersection point q from the camera frame, denoted in Figure 2 as $\left\{S_c\right\}$, are used as input parameters for an optimization procedure that finds the solutions through a nonlinear least-squares approach.

First, an initial reference pose $X^R$ is acquired, which is associated to angle configuration $({\theta }_1={\theta }_2)=(0{}^{°},0{}^{°})$. Then, N poses ${\overline{X}}^i$ ($i=1,\dots ,N$) are acquired by rotating around both axes ${\omega }_1$ and ${\omega }_2$ in their working range of interest. From each of the N poses, a point cloud in the 3D space is extracted, corresponding to the checkerboard corners, thus obtaining the measured pose ${\overline{X}}^i$. The theoretical relation between a generic (ideal) pose $X^i$ and the reference pose $X^R$ would be

$$X^i=T({\omega }_1,{\omega }_2,q;{({\theta }_1,{\theta }_2)}_i)X^R,i=1,\dots ,N$$ (4)

where both $X^i$ and $X^R$ are expressed in homogeneous coordinates. However, since measured point clouds ${\overline{X}}^i$ are considered, which are affected by various error sources, the following equations can be written:

$$\left\{\begin{array}{c}\begin{array}{cc}\hfill {\overline{X}}^1-T({\omega }_1,{\omega }_2,q;{({\theta }_1,{\theta }_2)}_1)X^R& =\delta X^1\hfill \\ \hfill {\overline{X}}^2-T({\omega }_1,{\omega }_2,q;{({\theta }_1,{\theta }_2)}_2)X^R& =\delta X^2\hfill \\ \hfill & =\hfill \\ \hfill {\overline{X}}^N-T({\omega }_1,{\omega }_2,q;{({\theta }_1,{\theta }_2)}_N)X^R& =\delta X^N\hfill \end{array}\hfill \end{array}\right.$$ (5)

where $\delta X^i\in {\mathbb{R}}^{4\times M}$ ($i=1,\dots ,N$) are the residual errors between measured and ideal coordinates of corresponding point clouds originated by $X^R$, and where M are the points (extracted via software) on the checkerboard.

Finally, a nonlinear least-squares estimation of the parameters is established to minimize the mismatch between measured and ideal point cloud coordinates. The optimization function is therefore based on Equation (5), where the table rotation angles are known by counting the steps provided to the stepper motors (since the rotational speed is low, it is reasonable to neglect step losses). On the other hand, $q,{\omega }_1, \mathrm{and} {\omega }_2$ are unknown and should be estimated. A formalization of the nonlinear least-squares estimation, minimizing the sum of squared Euclidean error norms, is provided as follows:

$$\underset{{\omega }_1,{\omega }_2,q}{min}\frac{1}{2}\sum _{i=1}^N\sum _{j=1}^M{\parallel {\overline{p}}_j^i-p_j^i({\omega }_1,{\omega }_2,q;{({\theta }_1,{\theta }_2)}_i)\parallel }_2^2,$$ (6)

where i is the pose index examined ($i=1,\dots ,N$), j is the point index in the checkerboard ($j=1,\dots ,M$), and ${\overline{p}}_j^i$ is the corresponding rotated point (Cartesian coordinates) measured on the checkerboard. Point $p_j^i({\omega }_1,{\omega }_2,q;{({\theta }_1,{\theta }_2)}_i)$ is obtained from the rotation of the reference pose by ${\theta }_{1,i}$ around axis ${\omega }_1$ and ${\theta }_{2,i}$ around axis ${\omega }_2$, both intersecting at the point q. The optimization must also satisfy the following constraints:

$$\{\begin{array}{}\mathrm{(7a)}& {\omega }_1^T{\omega }_2=0\mathrm{(7b)}& {\omega }_1^T{\omega }_1=1\mathrm{(7c)}& {\omega }_2^T{\omega }_2=1\end{array}$$

where (7a) indicates the perpendicularity between the axes, whereas (7b) and (7c) impose the condition for ${\omega }_1,{\omega }_2$ of having unit length.

For instance, the proposed method was employed for the calibration of a two-axis rotary table, using the hardware previously described in Section 2; hence, $M=54$ points per grid were considered. At first, 100 stereo-pair images were acquired in different poses ${({\theta }_1,{\theta }_2)}_i,i=1,\dots ,N$ of the rotary table. Then, using an estimation of $({\omega }_1,{\omega }_2,q)$ yielded by (6) applied to all the $N=100$ stereo-pair images, and by taking the inverse of (4), the measured grids ${\overline{X}}^i,i=1,\dots ,N$ were reprojected onto the reference grid ${\overline{X}}^R$. Finally, the $N·M$ point-to-point errors committed were computed. Figure 4 shows the error cloud in the 3D space, expressed in the camera frame $\left\{S_c\right\}$, whereas Figure 5 shows these errors in the three Cartesian planes. The absolute error was lower than 1 mm in every direction.

Figure 4.

Dispersion of the $M=54$ point-to-point errors in the 3D space—for a given set of $N=100$ images—committed using an estimation of $({\omega }_1,{\omega }_2,q)$ yielded by (6) and expressed in the camera frame $\left\{S_c\right\}$.

Figure 5.

Same error cloud of Figure 4, plotted in the three Cartesian planes: (a) $XY$-plane; (b) $YZ$-plane; (c) $ZX$-plane.

4. Influence of the Number of Calibration Images

Calibration quality depends both on the number K of poses used and on their spatial location, i.e., ${({\theta }_1,{\theta }_2)}_i$, $i=1,\dots ,K$. Hence, it is useful to investigate the influence of the number K of images to be captured towards a quality and fast calibration. To this extent, a proper metric was introduced, as discussed further in this section.

4.1. Data Set Definition

Any i-th image, $i=1,\dots ,K$, can be captured in the rotary table joint configuration Space S, $S\subseteq [-{180}^{°},{180}^{°}]\times [-{180}^{°},{180}^{°}]$. This is the space any pair of angular positions ${({\theta }_1,{\theta }_2)}_i$, $i=1,\dots ,\left|S\right|$, belongs to, i.e., $S=[{\theta }_{1,min},{\theta }_{1,max}]\times [{\theta }_{2,min},{\theta }_{2,max}]$. In order to assess the influence of the number of images K, a test run was conducted. First of all, a set of images was captured in S (Acquisition set A, $A\subset S$). Then—excluding an image $S_R$ which is taken as Reference—it was partitioned into two subsets: the Calibration set C, $C\subset A$, and the Test set T, $T\subset A$, so that $C\cup T=A\setminus S_R\wedge C\cap T=\varnothing$. C is the set from which to select the desired subset $C_H$ of K images to calibrate the turntable with, whereas T is the set subsequently used for quantifying the calibration error achieved with $C_H$. With respect to C, for each K, $K=1,\dots ,\left|C\right|$, a series of $b_K$ subsets $C_H$, $C_H\subseteq C$ could be extracted, where H is a set of indices i, K is the size of H, and $b_K$ is the following binomial coefficient:

$$b_K=\left(\genfrac{}{}{0pt}{}{\left|C\right|}{K}\right)=\frac{\left|C\right|!}{K!\left(\right|C|-K)!},K=1,\dots ,\left|C\right|$$ (8)

In the present study, a $S=[-36{}^{°},+36{}^{°}]\times [-90{}^{°},+90{}^{°}]$ was considered. Such S ensures that the checkerboard remains visible from the stereo-camera system during the entire acquisition process. To discretize S, a uniform sampling was performed, obtaining 101 images: the first one was associated to $(0{}^{°},0{}^{°})$ and was taken as reference, whereas the remaining 100 were equally spaced in steps of size $(\delta {\theta }_1,\delta {\theta }_2)=(8^{°},{20}^{°})$ within S, as in Figure 6. Lastly, the obtained A was partitioned into two equally sized and spaced sets C and T. In more detail:

• $S=[{\theta }_{1,min},{\theta }_{1,max}]\times [{\theta }_{2,min},{\theta }_{2,max}]=[-{36}^{°},+{36}^{°}]\times [-{90}^{°},-{90}^{°}]$;

• $A=\{{({\theta }_1,{\theta }_2)}_i\mid i=1,\dots ,N_A\}$, where $N_A=\left|A\right|=101$;

• $C=\{{({\theta }_1,{\theta }_2)}_{2r+1}\mid r=1,\dots ,N_C\}$, where $N_C=\left|C\right|={\displaystyle \frac{N_A-1}{2}}=50$;

• $T=\{{({\theta }_1,{\theta }_2)}_{2s}\mid s=1,\dots ,N_T\}$, where $N_T=\left|T\right|={\displaystyle \frac{N_A-1}{2}}=50$;

• $H\subseteq \{3,\dots ,2r+1,\dots ,N_A\}$ is a set of indices i, where $r=1,\dots ,N_C$, that denotes the pairs of angular positions ${({\theta }_1,{\theta }_2)}_i$, $i=2r+1$, of the subset of images to calibrate with;

• $K=\left|H\right|$, $K\in \{1,\dots ,N_C\}$, is the size of H, i.e., the number of images considered;

• $C_H=\{{({\theta }_1,{\theta }_2)}_h\mid h\in H\}$.

Figure 6.

Acquisition setA within the joint configuration Space S; the red points constitute the Calibration set C, whereas the blue are the Test set T and black is the reference. The number next to a point of coordinates ${({\theta }_1,{\theta }_2)}_i$ denotes the index i of the corresponding image; any combination of the indices highlighted in red constitutes a possible subset H of size K.

The i-th pair of angular positions is given by

$$\begin{array}{c}\hfill {({\theta }_1,{\theta }_2)}_i=\left\{\begin{array}{cc}(0{}^{°},0{}^{°})\hfill & i=1\hfill \\ ({\theta }_{1,min}+(m-1)·8{}^{°},{\theta }_{2,min}+(n-1)·20{}^{°})\hfill & i=2,\dots ,N_A\hfill \end{array}\right.\end{array}$$ (9)

where

$$\left\{\begin{array}{c}{\displaystyle m=⌊{\displaystyle \frac{i+8}{10}}⌋}\hfill \\ n=mmod2·\left(i+9-10m\right)+\left(m+1\right)mod2·\left(10m+2-i\right)\hfill \end{array}\right.i=2,\dots ,N_A$$ (10)

4.2. Error Metric Definition

The checkerboard, shown in Figure 7, consists of 7 × 10 squares, so the number of inner-corners M is $(7-1)\times (10-1)=54$. Figure 7 shows the turntable with the attached checkerboard in two different poses: Figure 7a is the reference pose at ${({\theta }_1,{\theta }_2)}_1=(0{}^{°},0{}^{°})$, whereas Figure 7b represents a generic i-th configuration, which is taken as target at ${({\theta }_1,{\theta }_2)}_i$. Given the i-th pose expressed in the coordinate frame $\left\{S_c\right\}$, $i=1,\dots ,N_A$, and recognizing the i-th Equation in (5), it is possible to rotate by ${({\theta }_1,{\theta }_2)}_i$ its measured target grid ${\overline{X}}^i$ (blue dots in Figure 7b and Figure 8a) onto the reference grid ${\overline{X}}^R={\overline{X}}^1$ (red dots in Figure 7a and Figure 8), thus obtaining the reprojected grid $X^R=X^1$, as shown in Figure 8b.

Figure 7.

Checkerboard in two different poses and their M highlighted inner corners: (a) reference grid (${\overline{X}}^R$, in red); (b) target grid (${\overline{X}}^i$, in blue).

Figure 8.

The two measured grids of Figure 7 in the operative space: (a) reference grid (${\overline{X}}^R$, in red; as in Figure 7a) and target grid (${\overline{X}}^i$, in blue; as in Figure 7b); (b) reference grid (in red), and target grid rotated by ${({\theta }_1,{\theta }_2)}_i$ onto the reference grid ($X^R$, in blue); virtually identical because of the low reprojection error.

Hence, given a subset $C_H$ within the Calibration set C of K images, and based on the results described in the previous section, it is possible to calibrate the rotary table, obtaining an estimate ${({\tilde{\omega }}_1,{\tilde{\omega }}_2,\tilde{q})}_H$ of $({\omega }_1,{\omega }_2,q)$. A series of metrics was arranged to quantify the reprojection accuracy obtained to reproject all $N_T$ grids of the Test set T onto the reference grid ${\overline{X}}^1$ using the calibration results acquired with the subset $C_H$ of K images. The subscript H highlights the dependency of the two axes, ${\omega }_1$ and ${\omega }_2$, and of their intersection point, q, on the particular subset of images used, thus ${({\tilde{\omega }}_1,{\tilde{\omega }}_2,\tilde{q})}_H$.

Considering only the grids belonging to T, for a given H, the point-to-point error between a j-th measured point ${\overline{p}}_j^1$ on the reference grid ${\overline{X}}^1$ and the reprojection of the j-th point $p_j^1({({\tilde{\omega }}_1,{\tilde{\omega }}_2,\tilde{q})}_H;{({\theta }_1,{\theta }_2)}_{2s})$ of the $2s$-th target grid ${\overline{X}}^{2s}$ onto ${\overline{X}}^1$, i.e., $X^1=T^{-1}({({\tilde{\omega }}_1,{\tilde{\omega }}_2,\tilde{q})}_H;$${({\theta }_1,{\theta }_2)}_{2s}){\overline{X}}^{2s}$, where $j=1,\dots ,M$ and $s=1,\dots ,N_T$, is

$$\begin{array}{cc}\hfill {ϵ}_{j,2s,H}={∥{\overline{p}}_j^1-p_j^1({({\tilde{\omega }}_1,{\tilde{\omega }}_2,\tilde{q})}_H;{({\theta }_1,{\theta }_2)}_{2s})∥}_{2{}_{,}}& j=1,\dots ,M,s=1,\dots ,N_T,\hfill \\ \hfill & H\subseteq \{3,\dots ,2r+1,\dots ,N_A\},r=1,\dots ,N_C\hfill \end{array}$$ (11)

The arithmetic mean of ${ϵ}_{j,2s,H}$ over M points yields the $2s$-th averaged point-to-point error committed using the ${({\tilde{\omega }}_1,{\tilde{\omega }}_2,\tilde{q})}_H$ that was estimated through the calibration previously made with the grids ${\overline{X}}^h$, $h\in H\mid {({\theta }_1,{\theta }_2)}_h\in C_H$, and for the target grid ${\overline{X}}^{2s}$, $s=1,\dots ,N_T$:

$${ϵ}_{2s,H}={\displaystyle \frac{{\displaystyle \sum _{j=1}^M{ϵ}_{j,2s,H}}}{M}},s=1,\dots ,N_T,H\subseteq \{3,\dots ,2r+1,\dots ,N_A\},r=1,\dots ,N_C$$ (12)

Finally, averaging all of the $N_T$ averaged point-to-point errors over the entire Test set T gives the T-averaged point-to-point error, yielding the reprojection accuracy:

$${\overline{ϵ}}_H=\frac{{\displaystyle \sum _{s=1}^{N_T}{ϵ}_{2s,H}}}{N_T},H\subseteq \{3,\dots ,2r+1,\dots ,N_A\},r=1,\dots ,N_C$$ (13)

Additionally, the root mean square (RMS) of these errors was defined as

$${\overline{\sigma }}_H=\sqrt{\frac{{\displaystyle \sum _{s=1}^{N_T}{({ϵ}_{2s,H}-{\overline{ϵ}}_H)}^2}}{N_T-1}},H\subseteq \{3,\dots ,2r+1,\dots ,N_A\},r=1,\dots ,N_C$$ (14)

The number of possible subsets $C_H$ of size K that can be employed for calibration is given by the binomial coefficient $b_K$ in (8). First of all, in order to have a rough estimation of the effect of K on the calibration accuracy, and to reduce the computational time, for each K, $K=2,\dots ,N_C$ only $N_{R_K}=1000$ combinations of $C_H$ are randomly extracted, obtaining $N_C-1$ sets $R_K$, and $N_{R_K}$ is the size of $R_K$, i.e., $N_{R_K}=\left|R_K\right|$. The case $K=1$ is not considered from now on since it is not sufficient to calibrate a two-axis rotary table. Then, all the $R_K$ sets, $K=2,\dots ,N_C$, were used to execute $(N_C-1)·N_{R_K}=\mathrm{49,000}$ independent table calibrations. Subsequently, their respective T-averaged point-to-point errors ${\overline{ϵ}}_H$ given by Equation (13), $H\mid C_H\in R_K$, were computed. Finally, averaging them over $R_K$, where $K=2,\dots ,N_C$, returns $N_C-1$$R_K$-averaged point-to-point errors:

$${\overline{\mathcal{E}}}_K=\frac{{\displaystyle \sum _{H\mid C_H\in R_K}{\overline{ϵ}}_H}}{N_{R_K}},K=2,\dots ,N_C$$ (15)

Additionally, the root mean square (RMS) of these errors was defined as

$${\overline{\sigma }}_K=\sqrt{\frac{{\displaystyle \sum _{H\mid C_H\in R_K}{({\overline{ϵ}}_H-{\overline{\mathcal{E}}}_K)}^2}}{N_{R_K}-1}},K=2,\dots ,N_C$$ (16)

An overview of the errors, and their RMS, is presented in Figure 9 for $K=2,\dots ,N_c$. As can be seen, both ${\overline{\mathcal{E}}}_K$ and ${\overline{\sigma }}_K$ decrease when K increases. While the effect of K on ${\overline{\mathcal{E}}}_K$ seems to saturate for K greater than 10, it can be noted that ${\overline{\mathcal{E}}}_K$ still decreases with K. Thus, if the poses are randomly chosen, greater values of K are more likely to produce high-quality calibrations. Nevertheless, even a small K can provide high-quality calibration results, if the poses are properly chosen as demonstrated in the following.

Figure 9.

The $R_K$-averaged point-to-point errors ${\overline{\mathcal{E}}}_K$ (blue dots) and their RMS ${\overline{\sigma }}_K$ (red circles) for $K=2,\dots ,N_C$.

4.3. Methods Comparison

In order to verify its effectiveness, the developed algorithm was compared with the circles method proposed by Chen et al. [29]. Hence, several combinations of images were extracted from the Calibration Set, and the calibration of the two-axis rotary table was carried out using both methods. It is worth mentioning, being that the circles method is a single-axis procedure, the vertical axis ${\omega }_1$ was firstly calibrated, and subsequently the horizontal axis ${\omega }_2$ was considered. For each combination H of images, the T-averaged point-to-point error ${\overline{ϵ}}_H$ and its standard deviation ${\overline{\sigma }}_H$ were computed by considering all the images of the Test Set. The results are reported in Table 1, comparing the two methods for the tested calibration sets.

Table 1.

Comparison between the proposed method and the circles algorithm.

Combination	Circles method		Proposed method
H	${\overline{\mathit{ϵ}}}_{\mathit{H}}$ [mm]	${\overline{\mathit{\sigma }}}_{\mathit{H}}$ [mm]	${\overline{\mathit{ϵ}}}_{\mathit{H}}$ [mm]	${\overline{\mathit{\sigma }}}_{\mathit{H}}$ [mm]
$\{59,79,99,93,95,97\}$	1.6956	0.1488	0.3579	0.1758
$\{35,55,75,95,93,97,99\}$	0.8038	0.2310	0.3414	0.1711
$\{13,33,53,73,93,95,97,99\}$	0.5283	0.1833	0.3352	0.1678

It is possible to observe that the proposed method returned almost constant values of ${\overline{ϵ}}_H$ and ${\overline{\sigma }}_H$ (i.e., $0.33$–$0.36$ mm and $0.16$–$0.18$ mm, respectively), which slightly decreases with the increasing of K. On the contrary, a different behavior was noticed in the circles procedure case, where ${\overline{ϵ}}_H$ decreased but not ${\overline{\sigma }}_H$, since this method is influenced appreciably by the specific calibration poses. In addition, the range of values of both ${\overline{ϵ}}_H$ was considerably wider (i.e., $0.52$–$1.70$ mm) than the results of the proposed method. Hence, the proposed method seems to be more robust and reliable with respect to the circles algorithm.

5. Optimal Calibration Set

On the basis of the data obtained in the previous section, a visual inspection was conducted to find out whether a certain pattern in the joint configuration Space S yielded preferred calibration results. No recurrent pattern (e.g., “X”-like, cross-like, circle-like, square-like, etc.) was evident among either of the studied subsets, which had led to quality calibrations of the tables or among the ones with poorer calibrations. Nevertheless, a direct correlation between dispersion of subsets and calibration quality has been found: for any given H, the more uniformly distributed the cloud of K points $({\theta }_1$, ${\theta }_2{)}_h\in C_H\subset S$, $h\in H$, the lower its calibration error ${\overline{ϵ}}_H$. For instance, in Figure 10, two opposite situations are reported. A wide dispersion can be noted in (a), corresponding to ${\overline{ϵ}}_H=0.3445$ mm, while a lower dispersion can be noted in (b), which corresponds to ${\overline{ϵ}}_H=0.4239$ mm.

Figure 10.

Two investigated subsets with the same number K of points ${({\theta }_1,{\theta }_2)}_h$ within the joint configuration Space S: (a) H = {5, 13, 25, 33, 43, 47, 69, 77, 81, 87}, K = 10, C_H = {(−36°,−30°), (−28°, 70°), (−20°,−30°), (−12°, 70°), (−4°,−70°), (−180°, 10°), (12°, 50°), (20°,−10°), (20°,−70°), (28°, 10°)}, which has a higher dispersion; (b) H = {17, 19, 25, 37, 39, 41, 43, 65, 67, 79}, K = 10, C_H = {(−28°,−10°), (−28°,−50°), (−20°,−30°), (−12°,−10°), (−12°,−50°), (−12°,−90°), (−4°,−70°), (12°,−30°), (20°,−10°), (20°,−50°)}, which has a lower dispersion.

5.1. Complete Graph Index

To quantify the scattering of any desired set of arbitrary dimension K, an index ($I_{CG}$) was devised based on the calculations of the arithmetic mean of all the weights of a weighted complete graph (CG). The subset of Figure 10a can be considered as an example. If its points were regarded as the vertices of a graph, it would be possible to think of their edges as being weighted by their Euclidean distances; hence, they can be summed and finally averaged by the number of links. Among all the weighted undirected graphs, the weighted complete graph (CG) was chosen, since it has the property to take into account all the pairs of points. In Figure 11 the CG constructed from the subset of Figure 10a is shown; it is possible to see its K points (nodes of CG, in red) and their $\left(\begin{array}{c}K\\ 2\end{array}\right)$ links (edges of CG, in blue).

Figure 11.

Complete graphs on the nodes in C_H of Figure 10: the K red points are the vertices, whereas the $\left(\begin{array}{c}K\\ 2\end{array}\right)$ blue dotted lines constitute the edges: (a) C_H is the same as Figure 10a; (b) C_H is the same as Figure 10b.

Given K points $v_t={({\theta }_1,{\theta }_2)}_t,t=1,\dots ,K$, it is advantageous to normalize them so that the index does not depend on the length of S ($[{\theta }_{1,min},{\theta }_{1,max}]\times [{\theta }_{2,min},{\theta }_{2,max}]$). The normalized angular positions ${\widehat{v}}_t=({\widehat{\theta }}_1$, ${\widehat{\theta }}_2{)}_t,t=1,\dots ,K$, are obtained by applying the following normalizations:

$${({\widehat{\theta }}_1,{\widehat{\theta }}_2)}_t={\displaystyle \frac{{\displaystyle {({\theta }_1,{\theta }_2)}_t-({\theta }_{1,min},{\theta }_{2,min})}}{({\theta }_{1,max},{\theta }_{2,max})-({\theta }_{1,min},{\theta }_{2,min})}},t=1,\dots ,K$$ (17)

where ${({\widehat{\theta }}_1,{\widehat{\theta }}_2)}_t$ are the normalized coordinates of ${\widehat{v}}_t$ along the ${\omega }_1$-axis and the ${\omega }_2$-axis, respectively. The weighted complete graph of order K considered is the pair $(G,w)$, where

• $V=\{{\widehat{v}}_t\mid t=1,\dots ,K\}$ is the set of vertices (normalized angular positions);

• $E=\{({\widehat{v}}_t,{\widehat{v}}_u)\mid t,u=1,\dots ,K,u>t\}$ is the set of edges;

• $G=(V,E)$ is a graph;

• $\left|E\right|=K2=\frac{K(K-1)}{2}$;

• $w:E\to {\mathbb{R}}_{\ge 0}$ is the weight function;

and the weight function is the Euclidean distance between any pair of vertices:

$$w={∥{\widehat{v}}_t-{\widehat{v}}_u∥}_2={\sqrt{{({\widehat{\theta }}_{1,t}-{\widehat{\theta }}_{1,u})}^2+{({\widehat{\theta }}_{2,t}-{\widehat{\theta }}_{2,u})}^2}}_{,}t,u=1,\dots ,K$$ (18)

The $I_{CG}$ index reported in (19) sums the weight function w evaluated in every pair of normalized points $({\widehat{v}}_t,{\widehat{v}}_u),t,u=1,\dots ,K,u>t$ and $K>1$ (the case $K=1$ must be avoided since at least two images are required to calibrate a two-axis rotary table), then divided by $\sqrt{2}$ times the number of pairs ($\left|E\right|$):

$$I_{CG}=\frac{{\displaystyle \sum _{t=1}^K\sum _{\begin{array}{c}u=1\\ u>t\end{array}}^K{∥{\widehat{v}}_t-{\widehat{v}}_u∥}_2}}{\sqrt{2}\left|E\right|}$$ (19)

The dividing factor $\sqrt{2}\left|E\right|$ is useful for normalizing the index value with respect to the number of chosen images K, so that $I_{CG}\in [0,1]\forall K\in \mathbb{N},K>1$. For instance, the subset in Figure 10a has a $I_{CG}=0.4036$, while the less scattered subset in Figure 10b gives a $I_{CG}$ of $0.2684$.

5.2. Index-Based Analysis and Experimental Results

Let us now consider the joint configuration Space S, the Acquisition set A, the Calibration set C, the Test set T, and all the $b_K$ subsets $C_H\subseteq C$ presented in Section 4, as in Figure 6. Given a $C_H$ set of K images, the index is

$$I_{CG,H}=\frac{{\displaystyle \sum _{t\in H}\sum _{\begin{array}{c}u\in H\\ u>t\end{array}}{∥{\widehat{v}}_t-{\widehat{v}}_u∥}_2}}{\sqrt{2}\left|E\right|},H\subseteq \{3,\dots ,2r+1,\dots ,N_A\},r=1,\dots ,N_C$$ (20)

In order to examine the relationship between ${\overline{ϵ}}_H$ and $I_{CG,H}$, $K=7$ has been selected, since it guarantees a relatively low binomial coefficient (Equation (8)), being $b_7=\left(\begin{array}{c}50\\ 7\end{array}\right)=99884400$. Firstly, $I_{CG,H}$ is calculated for all the $b_7$ possible combinations of $C_H$, obtaining the array $I_{b_7}$. Then, this is sorted in ascending order of $I_{CG,H}$, obtaining the ordered array $\overline{I_{b_7}}$. In order to reduce the computing time, $\overline{I_{b_7}}$ was downsampled by a factor of $\Delta =1000$, obtaining $N=⌈{\displaystyle \frac{b_7}{\Delta }}⌉=99885$ calibrations ${({\tilde{\omega }}_1,{\tilde{\omega }}_2,\tilde{q})}_H$, equally spaced between $min\overline{I_{b_7}}$ and $max\overline{I_{b_7}}$. The corresponding T-averaged point-to-point errors ${\overline{ϵ}}_H$ were computed, as expressed in Equation (13), and shown in Figure 12a for all the N unsorted calibrations. Finally, these errors are graphed in function of $I_{CG,H}$. Such plot is shown in Figure 12b: increasing the index, the errors tend to decrease. Moreover, it is clear that the greater the value of $I_{CG,H}$, the lower the expected value of ${\overline{ϵ}}_H$ and its variance.-

Figure 12.

Relationship between ${\overline{ϵ}}_H$ and $I_{CG,H}$ for N = 99,885 calibrations made using N C_H subsets of K = 7 images. These subsets were uniformly downsampled by a factor of Δ = 1000 among all the b₇ combinations of C_H, then finally used for estimating $({\omega }_1,{\omega }_2,q)$, thus obtaining N ${({\tilde{\omega }}_1,{\tilde{\omega }}_2,\tilde{q})}_H$: (a) the order is the same as in $I_{b_7}$; (b) the order is the same as in $\overline{I_{b_7}}$.

The same analysis was conducted for $K=2$, $K=4$, and $K=46$ to assess whether the parameter $I_{CG,H}$ was reliable regardless the value of K. At first, $I_{CG,H}$ was computed and used for ordering all the $b_4$, $b_{46}$, and $b_2$ combinations, respectively. Then, at every K, the N $C_H$ subsets were selected by uniformly downsampling by a factor—summed and rounded to the nearest integer index—of $\Delta =\frac{b_4}{N}$, $\frac{b_{46}}{N}$, and 1 among all the $b_4$, $b_{46}$, and $b_2$ combinations of $C_H$, respectively. Finally, each combination of images was used for estimating $({\omega }_1,{\omega }_2,q)$, thus obtaining N ${({\tilde{\omega }}_1,{\tilde{\omega }}_2,\tilde{q})}_H$.

With reference to Figure 13, it is possible to observe that the trend of ${\overline{ϵ}}_H$, for $K=2,4,46$, was the same as for $K=7$ (Figure 12b), provided that the results were sorted in ascending order of $I_{CG,H}$. It is worth noting that the higher the value of K, the more flattened the error range. In fact, while for $K=2$ the errors ranged from around $0.3$ mm to $3.7$ mm, for $K=46$ they were between $0.344$ mm and $0.346$ mm (as could be predicted considering that ${\overline{\sigma }}_2\gg {\overline{\sigma }}_{46}$). Additionally, Figure 13 confirms the effectiveness of $I_{CG,H}$ as a method to find the sets which yielded better calibration results, i.e., lower calibration errors. Moreover, considering as a reference the ${\overline{\mathcal{E}}}_K$ obtained by using all the $N_C$ images, i.e., ${\overline{\mathcal{E}}}_{50}=0.3446$ mm (Figure 9), and given a subset H, it is possible to define the percent relative error as

$${\eta }_H=\left|\frac{{\overline{\mathcal{E}}}_{50}-{\overline{ϵ}}_H}{{\overline{\mathcal{E}}}_{50}}\right|·100\%$$ (21)

Figure 13.

Relationship between ${\overline{ϵ}}_H$ and $I_{CG,H}$ for N calibrations and for various K: (a) K = 4 and N = 99,885; (b) K = 46 and N = 99,885; (c) K = 2 and N = b₂ = 1225; (d) same results as in (c), but zoomed-in at the error range [0.3, 0.6] mm.

It is worth noting that, if the H corresponding to the highest $I_{CG,H}$ was considered, ${\eta }_H$ was noticeably low for all the tested K, as shown in Table 2. As expected, the higher K, the lower ${\eta }_H$. However, ${\eta }_H$ was lower than 10% also for $K=2$. In particular, for $K=2$, there were four subsets corresponding to the highest $I_{CG,H}$: for the worst ${\eta }_H=$ 8.72%, whereas for the best ${\eta }_H=$ 1.28%. Hence, high-quality calibration results can be achieved even with $K=2$, provided that the proposed index $I_{CG,H}$ is used to choose the calibration set.

Table 2.

${\eta }_H$ at different H and at various K.

K	${\mathit{I}}_{\mathit{CG},\mathit{H}}$	${\overline{\mathit{ϵ}}}_{\mathit{H}}\left[\mathbf{mm}\right]$	${\mathit{\eta }}_{\mathit{H}}$[%]
2	0.8958	0.3747	8.72
		0.3643	5.73
		0.3533	2.52
		0.3490	1.28
4	0.7225	0.3469	0.67
7	0.6313	0.3466	0.58
46	0.4226	0.3445	0.02

It is reasonable to use the index as a criterion for selecting the angular positions $({\theta }_1$, ${\theta }_2{)}_h$ within the joint configuration Space S, that is the K placements of the checkerboard. The main advantage is that it is able to predict whether a set is going to achieve an effective calibration before acquiring the images. An additional benefit is that it is less time-consuming for a computer, compared to an entire calibration. For instance, the code was tested using a computer equipped with Intel^® i7-6700HQ CPU (Dell Inc., Round Rock, TX, USA, 4 physical cores at $2.60$ GHz and 8 logical cores), and 32 GB of RAM, then running Matlab^® R2020a (The MathWorks Inc., Natick, MA, USA) with parallel pool active on Microsoft Windows^® 10. It was observed that the time required to calculate $b_7$ times the index $I_{CG,H}$ was about 10 times shorter than the time needed for N calibrations. Thus, it is possible to assume that computing the index is $10·\Delta =10000$ times faster than repeating the calibration for all the $b_7$ possible configurations.

6. Conclusions

This paper presents a novel approach for the automatic calibration of two-axis rotary tables through optical stereo systems. The proposed optimization algorithm allows for simultaneously calibrating both axes by imaging and processing a checkerboard attached to the rotary table in different poses. A test set of images was defined, which were not exploited during calibration, to assess the quality of the achieved calibration parameters by computing an average reprojection error and its RMS. Moreover, this paper investigated the effect of the number of calibration images on the results. It was shown that the higher the number of images, the lower the achieved mean error and RMS, if the calibration poses are randomly selected. Nevertheless, it was demonstrated that a proper choice of calibration poses can provide high-quality calibration results even with a limited number of images (thus, a shorter calibration time). An index based on the weighted complete graph, $I_{CG}$, was defined, demonstrating that higher values of $I_{CG}$ (i.e., wider dispersion of the calibration poses) correspond to better calibration results. Thus, once the joint configuration Space S is defined, and given the number of calibration images to be used, it is possible to determine the ideal combination of poses by looking for the highest value of $I_{CG}$. The experimental measurements demonstrated that, using this strategy, the worst calibration error achievable with only two calibration images is marginally higher, about 8%, than the best calibration error achievable with 50 images, thus confirming the advantages of the proposed approach.

Appendix A

In this appendix, a brief description of the Graphical User Interface—MATTA: autoMatic Acquisition Tool for Turntable cAlibration—downloadable at [30], is given. The main purpose of the software is to provide a tool that guides the user through the entire calibration process. The software has been developed in the Matlab^® R2020a environment [31] and is meant to work on computers equipped with Microsoft Windows^® 10, macOS^®, or Linux^®. The Computer Vision Toolbox, The Image Processing Toolbox, the Optimization Toolbox, and the Matlab^® Support Package for Arduino Hardware are required. The GUI also makes use of the open source Camera Calibration Toolbox for Matlab^® provided by the California Institute of Technology [32]. The additional hardware required is described in Section 2. The GUI consists of six tabs:

1. Settings;

2. Turntable Control;

3. Image Acquisition;

4. Stereo-Camera Calibration;

5. Turntable Calibration;

6. Error Analysis.

The Settings tab, shown in Figure A1a, allows the user to manage several hardware settings. In more detail, it is possible to

• activate/deactivate the motors connected to the shield via Arduino and to specify its serial port;

• activate/deactivate the camera(s) connected to the computer, adjusting several parameters such as exposure, image format, image resolution, and frame rate.

Figure A1.

(a) Settings tab; (b) Turntable Control tab.

Moreover, it is possible to test the stereo-camera system configuration performing an image preview or taking a one-shot acquisition.

The second tab, Turntable Control, is reported in Figure A1b. It allows the user to rotate the table within the working space in a target configuration determined by the pair of angular positions $({\theta }_1,{\theta }_2)$. The directions of rotation are according to the rotary table model presented in Section 3, Figure 2. After reaching the desired target configuration, it is possible to set the current table pose as the reference pose ${\overline{X}}^r$ for the image acquisition task by means of the Initialize button.

The Image Acquisition tab, shown in Figure A2a, allows the user to automatically capture the stereo-pair images within the joint configuration Space S needed for the calibration of the stereo-camera system or of the rotary table. As inputs, the user has to provide the following:

1. the square dimensions of the checkerboard;

2. the desired image format;

3. the target poses of the turntable, in the form of pairs of angular positions ${({\theta }_1,{\theta }_2)}_i$, $i=1,\dots ,N_A$, where $N_A$ is the number of acquisitions, with respect to the reference pose ${({\theta }_1,{\theta }_2)}_1=(0{}^{°},0{}^{°})$.

Figure A2.

(a) Image Acquisition tab; (b) Stereo-Camera Calibration tab.

When the process is completed, the tab automatically creates a folder containing both the stereo-pair images and the associated input variables. It is worth mentioning that the first configuration to be acquired has to be the reference pose.

Subsequently, the Stereo-Camera Calibration tab enables the user to properly calibrate the stereo-camera system. With reference to Figure A2b, the user has to specify, as input, the path of a folder of images previously generated with the Image Acquisition tab. The software automatically recognizes the key variables and calibrates the stereo-camera system according to the Camera Calibration Toolbox for Matlab^®. Thus, a stereo-camera calibration file is generated in the Camera Calibration folder (inside the Workspace folder) labeled with reference to the folder of images deployed in the task. Eventually, it is possible to obtain insights of a stereo-camera calibration file such as intrinsic and extrinsic parameters and geometrical displacement of both the $N_A$ grids and cameras in the 3D space by means of the Show Results button.

Furthermore, the user is able to calibrate the two-axis rotary table by means of the Turntable Calibration tab, shown in Figure A3a. As inputs the user has to provide the following:

1. a stereo-camera calibration file previously generated in the Stereo-Camera Calibration tab;

2. a folder of images previously acquired with the aid of the Image Acquisition tab. The GUI fills the Calibration set panel with a number of checkboxes equal to the number of stereo-pair images contained in the specified folder, i.e., $N_A$. By means of the checkboxes, the user is able to select the K stereo-pair images to be used in the calibration procedure, thus constituting the desired subset H; alternatively, the entire set of $N_A$ images is used by default.

Figure A3.

(a) Turntable Calibration tab; (b) Error Analysis tab.

The rotary table calibration method is according to the one presented in Section 3. At the end of the process, a table calibration file is generated, and the estimated values of the unit vectors ${\omega }_1$ and ${\omega }_2$, as well as the intersection point q, i.e., ${({\tilde{\omega }}_1,{\tilde{\omega }}_2,\tilde{q})}_H$, are displayed in the tab.

The last tab offers an in-depth analysis of the errors committed during a turntable calibration. As input, only a folder of $N_A$ images—of which K are previously used for calibrating the rotary table—must be provided. At first, the computed T-averaged point-to-point error ${\overline{ϵ}}_H$, as well as its standard deviation ${\overline{\sigma }}_H$, are displayed. Then, as Figure A3b shows, the Error Analysis tab fills the Target grid panel with ${\overline{X}}^i$, $i=1,\dots ,N_A$, Target grids. Finally, once a desired target grid has been selected by the user, a summarizing figure is displayed, as shown in Figure A4.

Figure A4.

A typical analysis figure displayed once a target grid (in this example, $i=2$) is selected in the Error analysis tab of Figure A3b, showing the following: at the top, the reference grid (${\overline{X}}^1$, in red) and the target grid (in blue) before (${\overline{X}}^2$) and after (the reprojected grid $X^1$) the overlapping, respectively; at the center, their point-to-point errors (${ϵ}_{j,i,H},j=1,\dots ,54,i=2$, and for a certain H); at the bottom, the norm of these errors ($|{ϵ}_{j,i,H}|$, blue asterisks), the T-averaged point-to-point error (${\overline{ϵ}}_H$, red line) and its standard deviation ($\pm {\overline{\sigma }}_H$, green lines). A ${({\tilde{\omega }}_1,{\tilde{\omega }}_2,\tilde{q})}_H$ previously obtained from the Turntable Calibration tab was used.

It is worthwhile to mention that, for each tab, various errors are properly treated by MATTA, as well as warnings, and that numerous informative messages stating the current status of the running process are displayed.

Author Contributions

Software, L.B., R.M. and M.P.; validation, L.B., R.M. and M.P.; writing–original draft preparation, L.B., R.M. and M.P.; writing–review and editing, P.N. and M.G.; supervision, P.N. and M.G. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Conflicts of Interest

The authors declare no conflict of interest.