Abstract
Understanding elastic instability has been a recent focus of concentric tube robot research. Modeling advances have enabled prediction of when instabilities will occur and produced metrics for the stability of the robot during use. In this paper, we show how these metrics can be used to resolve redundancy to avoid elastic instability, opening the door for the practical use of higher curvature designs than have previously been possible. We demonstrate the effectiveness of the approach using a three-tube robot that is stabilized by redundancy resolution when following trajectories that would otherwise result in elastic instabilities. We also show that it is stabilized when teleoperated in ways that otherwise produce elastic instabilities. Lastly, we show that the redundancy resolution framework presented here can be applied to other control objectives useful for surgical robots, such as maximizing or minimizing compliance in desired directions.
1. Introduction
Concentric tube robots have garnered considerable interest in the continuum and surgical robotics communities in recent years. They can achieve bending and elongation via the elastic interactions of their nested, precurved tubes (see Fig. 1), effects which are desribed by mechanics-based models (Rucker et al. 2010; Dupont et al. 2010). These devices have been applied to a number of minimally invasive surgical applications because of their small diameter and dexterity. For a review of concentric tube robotics research and applications, see (Gilbert et al. 2016).
Despite many recent advancements in design, modeling, control, and practical applications, concentric tube robots have thus far been limited to maximum curvatures far below the theoretical upper limit provided by Nitinol’s maximum recoverable strain. Yet higher curvatures are often desirable, because they enable the robot to work in smaller, more constrained spaces. The reason concentric tube robots have been limited to curvatures far below the maximum recoverable strain limit of the material is that highly curved tubes, when nested within one another and axially rotated, store torsional elastic energy. If the tubes rotate too far, they will exhibit an elastic instability, rapidly releasing this energy and “snapping” from one configuration to another. This snapping effect has recently been studied from design (Hendrick et al. 2015; Bergeles et al. 2015; Luo et al. 2018; Ha et al. 2014) and modeling (Gilbert et al. 2016; Ha et al. 2016) perspectives. Actuator motions likely to create snapping can now be predicted, and metrics for stability have been derived.
To date, elastic stability-aware control has primarily been achieved in an a priori, motion planning sense. An early metric for stability was torsional windup (Bergeles and Dupont 2013), which has been used in planning stable paths (Bergeles et al. 2015). Gilbert et al. devised a relative elastic stability metric and used it to produce stability maps for planning purposes (Gilbert et al. 2016). These examples of stability-aware planners do not run rapidly enough to avoid snapping during real-time teleoperation. The goal of this work is to integrate instability avoidance into a real-time controller so that a user can control the robot safely.
Real-time control of concentric tube robots has been an important research topic in recent years. Several methods involve precomputation of the robot’s forward kinematics or path plans; the inverse kinematics can then be solved online at each time step using root-finding methods (Dupont et al. 2010) or a local inverse kinematics solver such as damped least squares (Torres et al. 2015). Local Jacobian-based methods seek to solve the inverse kinematics online with no need for precomputation. For example, Burgner et al. proposed a weighted damped least squares (WDLS) approach that incorporates tracking, damping, and joint limit goals (Burgner et al. 2014). This is an efficient Jacobian-based approach that can be solved at each time step with low computational burden. Other examples of Jacobian-based damped least squares control of concentric tube robots include (Fagogenis et al. 2016; Xu et al. 2013). Our proposed approach in this work uses a similar WDLS approach to (Burgner et al. 2014) that also incorporates instability avoidance and stiffness goals.
These online inverse kinematics methods have also been used for instability avoidance. Leibrandt et al. have explored rapid, online motion planning for concentric tube robots while integrating elastic stability into the framework (Leibrandt et al. 2015, 2017a). While it has been shown that it is possible to compute these replanning approaches rapidly enough for use in real time control via parallelized computing, they are computationally intensive and often require some a priori knowledge of the environment and/or the desired path. Implementation of these approaches typically requires multi-core parallel computing or graphical processing unit (GPU) computing methods. In contrast, the redundancy resolution approach we present in this paper is computationally inexpensive and requires no a priori information. Of course, the tradeoff for these advantages is that a redundancy resolution approach like ours makes no claims of global optimization to a desired final path—it will only locally optimize among competing objectives at each time step—but it is useful for teleoperation when anatomical constraints are not accurately known and/or the user’s intended path is not known a priori. The ability of our method to move the robot away from unstable configurations is also an advantage over the rapid planning method in (Leibrandt et al. 2017a); if the user enforces a particular trajectory, it is possible that the online inverse kinematics solver cannot escape local minimum due to the formulation of the stability constraint. Leibrandt et al. also used the online inverse kinematics solver to integrate dexterity goals; the dexterity measure penalizes columns of the Jacobian based on joint limits, anatomical collisions, and configuration stability (Leibrandt et al. 2017b). Since we employ a computationally efficient Jacobian-based approach, the controller moves the robot away from instability using knowledge of each joint’s effect on the robot’s stability. This is a noted limitation of (Leibrandt et al. 2017b) that arises from the high computational cost of the rapid planning GPU approach. Additional extensions in this paper beyond the work of (Leibrandt et al. 2017b,a) include the integration of stiffness objectives, and experimental evaluation on a physical robot prototype. A final distinction is our use of a stability metric derived from first principles (Gilbert et al. 2016), whereas Leibrandt et al. used a torsional windup stability metric (Bergeles and Dupont 2013).
Khadem et al. employ a redundancy resolution approach to integrating instability avoidance into an online concentric tube robot controller (Khadem et al. 2019). They use a gradient projection method in which the secondary control goal is to reshape a force-velocity manipulability ellipsoid toward a sphere to ensure that the Jacobian is full rank. Our method uses a stability metric that is derived from first principles which enables the controller to enforce an exact stability threshold. In addition, our use of a WDLS redundancy resolution formulation enables the controller to override user trajectories that will make the robot unstable, whereas null-space methods must always satisfy the primary tracking task even when that task could cause instability. An additional advantage of our approach is that it pushes the system away from instability, whereas approaches that seek to iteratively maximize manipulability, like that of Khadem et al., can sometimes push the system toward instability.
It is also desirable to control the stiffness of a concentric tube robot in real time, based on application requirements. Recognizing this, Mahvash and Dupont proposed the first stiffness controller for concentric tube robots (Mahvash and Dupont 2011). They use a deflection model to control the robot tip stiffness, based on real-time measurements of tip location made with a magnetic tracking coil. In some applications, it may be advantageous to keep an open lumen in the concentric tube robot for surgical instruments or suction/injection, rather than consuming it with such a tracking coil and image-based tip position sensing may be unavailable or insufficiently accurate. Yet control of tip mechanical impedance may still be useful, such as to enable the robot to gently interact with delicate tissues or forcefully interact with tissue (as must occur when a needle is being driven through tissue), as has been shown in the past with tendon-operated and multi-backbone continuum robots (e.g., see Kim et al. (2014); Bajo and Simaan (2016)). One method for controlling tip stiffness is to examine its unified force-velocity manipulability ellipsoid (Khadem et al. 2018, 2019). In these works, the controller seeks to reshape the force-velocity manipulability ellipsoid in order to increase its force application capabilities. Our approach seeks to optimize stiffness using the compliance matrix at the tip of the robot (although different metrics could easily be incorporated into the framework).
The redundancy resolution framework we present in this paper enables both stiffness tuning and instability avoidance. Redundancy resolution has previously been applied to other kinds of continuum robots to accomplish a variety of objectives. For example, controllers for hyper-redundant robots have been developed that simultaneously command both end effector pose and backbone shape (Chirikjian and Burdick 1994, 1995). Redundancy resolution has also been used to reduce actuation forces of tendon-actuated (Camarillo et al. 2008; Yip and Camarillo 2014) and variable diameter continuum robots (Abah et al. 2018), avoid buckling in multi-backbone continuum robots (Simaan 2005), improve stability in magnetically controlled continuum catheters (Edelmann et al. 2017), avoid joint limits in multi-backbone robots (Bajo et al. 2012) and robots with multiple rolling joints (Berthet-Rayne et al. 2018), and reduce visual occlusion of the endoscope field of view during surgery (Sarli and Simaan 2017).
Toward the goal of enabling higher curvatures than have traditionally been used in continuum robot prototypes (i.e., to facilitate the stable use of robots with elastic instabilities in their workspaces) while also achieving stiffness objectives, we present a new redundancy resolution technique in this paper. Our approach makes several contributions with respect to existing literature. Compared to rapid planning and parallelized kinematics approaches, our approach has low computational burden by locally optimizing stability (and/or stiffness) at each servo cycle with an efficient Jacobian-based WDLS method. Our method also requires no a priori knowledge of the planned path. We use a stability metric derived from first principles which exactly defines when a robot is stable or unstable, as well as how far a given configuration is from instability. Our redundancy resolution approach is formulated with the joint-specific relationship of configuration to stability and uses this knowledge to actively move the robot away from instability only when necessary. A preliminary version of some results in this paper was presented in conference workshop form in (Anderson et al. 2017). Extensions in the current paper beyond the results in (Anderson et al. 2017) include more extensive simulation results, the integration of stiffness objectives into the framework, and experimental results on a physical robot prototype.
2. Redundancy Resolution Algorithm
To achieve redundancy resolution with multiple control objectives for concentric tube robots, we use a weighted damped least squares control strategy. This section describes the objective function and resulting update law that incorporate instability avoidance and stiffness tuning objectives into resolved rates control.
2.1. Choice of Joint Space
In this work, we use the mechanics-based model of concentric tube robots described in (Rucker et al. 2010; Dupont et al. 2010). For a concise form of the equations see (Gilbert et al. 2016). The simulations and experiments in this paper use a three-tube, six-degree-of-freedom concentric tube robot (see Fig. 2). Such a robot has a joint space q given by,
(1) |
where ψiL is the angle between the material frame of the ith tube and a Bishop frame RB at the tip of the robot, and ri is the exposed length of each tube, or
(2) |
The inner, middle, and outer tubes correspond to subscripts 1, 2, and 3, respectively.
We use tip angles ψL as joint variables here because they correspond to a unique configuration of the robot, which enables us to solve a single differential equation to determine the shape of the robot, rather than performing a shooting method on the differential equation, as would be needed if base angles were used. Note that after solving the initial value problem differential equation, the base angles ψβ are known and can be commanded to the actuators. Furthermore, if base angles are used, the robot’s configuration is not guaranteed to be uniquely specified, and can depend on actuation history (Hendrick et al. 2015; Gilbert et al. 2016).
Throughout this paper, we use the elastic stability measure proposed in (Gilbert et al. 2016). We give this stability measure the symbol , a scalar that is positive when the robot configuration is stable and negative when the robot configuration is unstable. Physically, the robot goes unstable when there is a direction in the solution space in which the robot can move to a lower energy state. This is identified mathematically by a negative eigenvalue of the second variation operation of the energy functional of the robot’s twist angles. See (Gilbert et al. 2016) for a complete derivation and evaluation of the metric.
2.2. Redundancy Resolution Framework
During resolved rates teleoperation, the surgeon commands a desired trajectory, which is converted to a desired task space velocity . The robot’s Jacobian maps instantaneous joint velocities to instantaneous task space velocities: . Note that we use the hybrid Jacobian (Murray et al. 1994) throughout this paper, with the desired task space velocity specified in the robot’s base frame coordinates.
To control a concentric tube robot to track a sequence of desired tip coordinates, we use the weighted damped least squares framework (Wampler II 1986), into which we previously incorporated tracking, damping, and joint limits (Burgner et al. 2014). In this work, we use the same tracking, damping, and joint limit goals as Burgner et al.; our contribution to this framework is the addition of instability avoidance and desired stiffness as additional objectives within this algorithm.
The damped least squares framework defines a cost function and applies weights to these potentially competing objectives. The cost function H, using the notation from (Burgner et al. 2014), is given as,
(3) |
where Wi are non-negative symmetric weighting matrices. The first term penalizes any which does not follow the surgeon’s command, while subsequent terms can be used to damp high velocities (if vi is set to zero), to penalize joint configurations that are near joint limits, or to encourage joint velocities in the direction of the gradient, vi, of some objective function. The necessary condition for to minimize H is found by setting , and can be shown to be
(4) |
In this paper, we will use a cost function and update law with standard tracking, damping, and joint limit avoidance terms that will be augmented with novel instability avoidance and stiffness tuning terms. The cost function is given by
(5) |
which can again by minimized by setting . The resulting instantaneous joint velocity vector that minimizes H is
(6) |
We will examine each term in this cost function and resulting update law in subsequent subsections. In particular, the instability avoidance and stiffness tuning terms are an important contribution of this work. The gains used in the algorithm are summarized in Table 1.
Table 1.
Parameter | Symbol | Value |
---|---|---|
Tracking Proportional Gain | α 0 | 1.0 × 108 |
General Damping Proportional Gain | α D | 0.1 |
Nominal Translation Damping | b T | 5.0 × 108 |
Nominal Rotation Damping | b R | (180/2π)2 |
Joint Limit Damping Proportional Gain | α J | 20.0 |
Stability Proportional Gain | 10.0 | |
Compliance Proportional Gain | α C | 300 |
Compliance Weight | k C | 1000 |
2.2.1. Tracking
The first term in the cost function (5) penalizes joint velocities that differ from those specified by the surgeon. The desired task space velocity is calculated using the current tip position ptip given by the kinematic model and the desired tip position pdes from the surgeon interface:
(7) |
where vmag is a piecewise continuous function of the magnitude of e given by
(8) |
where
(9) |
We also set a converged radius ρ, so that if ∥e∥ < ρ, . The control gains for selecting the task space velocity are found in Table 2. The tracking weighting matrix is defined as
(10) |
where α0 is a proportional tracking gain. Note that if tracking in a certain direction is more important than others, the elements of this weighting matrix could be adjusted accordingly by using a higher gain for these directions.
Table 2.
Parameter | Symbol | Value | Units |
---|---|---|---|
Maximum Task Space Velocity | v max | 100.0 | mm/s |
Minimum Task Space Velocity | v min | 13.0 | mm/s |
Maximum Velocity Error | e max | 5.0 | mm |
Minimum Velocity Error | e min | 1 .0 | mm |
Converged Radius | ρ | 1.0 × 10−5 | mm |
2.2.2. Damping
The second term in the cost function (5) penalizes high joint velocities , adding numerical damping. The damping term has a weighting matrix defined by
(11) |
where αD is an overall proportional damping gain, bR is a rotational damping gain, and bT is a translational damping gain. We distinguish bR and bT due to the different rotation and translation units.
2.2.3. Joint Limit Avoidance
The third term in the cost function (5) penalizes joint velocities that violate joint limits. Here, we define joint limits based on the exposed length of each tube. For each tube, we define a minimum and maximum exposed length, ri,min and ri,max. In the simulations that follow, we make the choice to prevent a given tube from being retracted beyond the tip of the tube surrounding it, meaning that all ri,min must be greater than zero. Note that this joint limit definition could be relaxed if desired; it is not an intrinsic part of the algorithm. Specifically, we set all ri,min to 1 mm and all ri,max to 40 mm for the simulation studies. For the robotic experiments, we define the maximum limits based on the robot actuation unit travel limits. To avoid these joint limits, we define a joint limit penalty function as
(12) |
which was inspired by results in (Chan and Dubey 1995). We then define a weighting matrix as,
(13) |
where
(14) |
, and αJ is a proportional joint limit avoidance gain. We do not enforce rotational joint limits, so the first three elements of ∇Jq are zero. With this strategy, the joint limit avoidance term dominates the cost function when a joint value ri approaches its limits.
2.2.4. Instability Avoidance
When resolving redundancy to avoid elastic instability, the final term in the cost function (5) (i.e., the secondary goal) is designed to dominate the cost function when the robot configuration approaches instability as given by the metric , derived in (Gilbert et al. 2016). We define an instability avoidance weighting matrix as
(15) |
in which each diagonal element approaches infinity as approaches the stability threshold . In such cases, we want the update law to command joint velocities that move the robot away from unstable configurations. To do so, we define
(16) |
By choosing the proportional gain , the system will ascend the stability gradient when the instability avoidance term dominates the cost function, moving the robot to a more stable configuration. We numerically compute the stability gradient using centered finite difference (translational step = 0.01 mm, rotational step = 0.05°). When computing this gradient, we take advantage of our choice of joint variables (see section 2.1). Controlling tip angles and solving the kinematic model as an initial value problem with a single differential equation improves computational speed.
The instability avoidance weighting matrix (15) is designed such it does not impact the control law (6) when the robot’s stability is far from the stability threshold . In these cases, the diagonal elements of are nearly zero. The closer the stability metric is to the threshold, the more the instability avoidance term dominates the control law, causing the controller to steer the robot toward more stable configurations. This approach does not seek to continually maximize stability; rather, instability avoidance is only employed when necessary, allowing the controller to use as much of the stable configuration space as possible. Note that when this term is used in the remainder of the paper, we will refer to (6) as the “instability avoidance control law.”
2.2.5. Stiffness Tuning
When resolving redundancy to tune stiffness, we set a stiffness-based secondary goal in the cost function (5). To accomplish this, we make use of the concentric tube robot’s compliance matrix , which maps a tip wrench to a tip deflection as Cω = δ (see (Rucker and Webster III 2011)). In surgical scenarios, it is common for the robot to experience tip loads; therefore, we will utilize Cf, which is the top left 3 × 3 submatrix of C that maps a force f to a position deflection δx.
While a variety of stiffness objectives can be defined based on this tip stiffness matrix, in the simulations that follow we simply use the maximum singular value of Cf, for which we use the symbol σC. More precisely, we have that
(17) |
and define σC as
(18) |
This means that when σC is maximized, the system will attempt to achieve configurations with maximal compliance in its most compliant direction. On the other hand, when σC is minimized, the system will attempt to achieve configurations with minimal compliance in its most compliant direction. Alternative metrics for stiffness tuning include minimizing tip deflection (if the applied load vector is known) or optimizing stiffness in a particular direction (e.g., axial or lateral stiffness, which could be beneficial for different applications).
We define a compliance weighting matrix as
(19) |
In order to maximize or minimize σC, we define a joint space velocity vector vC as
(20) |
which points along the positive gradient of σC if the user defines αC > 0 and along the negative gradient of σC if the user defines αC < 0. This will command joint velocities that make the robot more (or less) compliant in its most compliant direction. We compute ∂σC/∂q numerically using the same centered finite difference parameters as Sec. 2.2.4. Unlike the instability avoidance term in the control law, which changes in magnitude based on proximity to the stability threshold, the compliance optimization term seeks to always move the robot into more (or less) compliant configurations due to the constant gain kC used to compute the weighting matrix WC. Note that when this term is used in the paper, we will refer (6) as the “stiffness tuning control law.”
3. Simulations
We first tested our redundancy resolution algorithm for both instability avoidance and stiffness tuning in simulation to verify its effectiveness, analyze its impact on the robot’s behavior, and tune the control gains. This section describes first the instability avoidance simulations, followed by the stiffness tuning simulations.
3.1. Instability Avoidance Simulations
To test our elastic stability-aware redundancy resolution algorithm, we simulated the real-time control of a three-tube concentric tube robot made of superelastic nitinol tubes (E = 50 GPa, ν = 0.33, see Table 3 for tube dimensions) along a desired trajectory. In this simulation, we used the gain parameters given in Tables 1 and 2, as well as a minimum stability threshold of .
Table 3.
Tube 1 | Tube 2 | Tube 3 | Units | |
---|---|---|---|---|
Outer Diameter | 1.1 | 1.4 | 1.7 | mm |
Inner Diameter | 1.0 | 1.3 | 1.6 | mm |
Total Tube Length | 150.0 | 100.0 | 50.0 | mm |
Straight Tube Length | 100.0 | 60.0 | 25.0 | mm |
Precurvature | 30.0 | 30.0 | 30.0 | m−1 |
3.1.1. Desired Trajectory
During teleoperation, the desired input velocities are those commanded by the surgeon. Here, to create an example trajectory to use in simulation, we chose a helix wrapping around a torus, as shown in Fig. 3. The equations defining the desired tip position were
(21) |
where the torus’ major radius (R) was 15.0 mm, its minor radius (r) was 3.0 mm, the number of helix turns (NT) was 5, the offset from the x-y plane (zoff) was 55.0 mm, and θ ∈ [0, 2π). The robot’s home position was given by ψL = 0 and r1 = r2 = r3 = 20 mm. We used a total simulation time of 10 s with a step time of 5 ms and implemented a standard resolved rates scheme in which the desired tip velocities were calculated using the error vector between the current position and desired position at each time step.
3.1.2. Simulation Results
We performed the simulation both with (the “stability-aware” case) and without (the “stability-unaware” case) the instability avoidance term included in the cost function and control law. In Fig. 4(a), we show the stability metric and tracking error throughout the entire trajectory for the stability-unaware case. Due to the high curvature of the tubes and the commanded trajectory, the robot snaps twice. However, the controller has no knowledge of this instability nor does it have a way to avoid it. Based purely on the kinematic model, the robot appears to be tracking well from the controller’s perspective. However, the physical robot is in a different local minimum energy solution than the local minimum energy solution assumed by the controller, due to the uncontrolled snapping. As soon as the stability metric first crosses to , the robot snaps to a configuration far away and tracking is lost.
Fig. 4(b) shows that using the instability avoidance control law enables the robot to avoid instabilities while maintaining good tracking (~1 mm) in task space. Note that the error along the chosen trajectory is due to the dynamic trajectory and high damping; the error quickly reduces to < 0.01 mm when regulating a constant desired tip position. At the beginning of the trajectory, stability moves toward zero, but unlike Fig. 4(a), the instability avoidance term causes the robot to move to a more stable configuration while continuing to track the desired trajectory.
3.1.3. Computing the Robot’s Post-Snap Configuration
In order to generate the simulated unstable robot trajectory, we calculated the new physical configuration of the robot in cases where the robot snaps. This was necessary for finding the results of Fig. 4(a). The key idea behind this problem is that, when the robot is in an unstable configuration, there are multiple configurations in model space (and therefore multiple sets of tip angles ψL) corresponding to the same base rotational angles ψβ. When the robot snaps, the current tip angles are unstable, and the physical solution must be found. To find the new, post-snap configuration, one must search the tip angle space for a configuration corresponding to the same base angles ψβ. Note that the relative tube angles affect stability, not the absolute angles, so the search for the new configuration is done in the relative angle space and then converted back to absolute angles. We define the relative joint angles as θi = ψi(s) − ψ1(s).
When the stability of the robot in the simulation goes to 0, we use MATLAB’s fzero function to find the exact relative tube angles θL,unstable at the edge of the unstable configuration space. This point is shown by the “before snap” points in Fig. 5. Once this unstable configuration is found, we calculate the unique relative base angles θβ using the kinematic model. Then, we use MATLAB’s fsolve function to find another set of relative tip angles θL,stable that produce the same relative base angles as the unstable solution.
Because the relative joint space is wrapped from 0 to 2π radians we must convert the new relative tip angles to absolute angles. To do so, we first assume a configuration of ψL,guess = [0, θ2L,stable, θ3L,stable]⊤. Solving the kinematic model returns absolute base angles that have the same relative angles but are offset from the original absolute base angles by Δψ. We then add this offset to the tip angle guess to get the new, stable configuration:
(22) |
The new robot configuration is shown by the “after snap” points in Fig. 5. This approach could potentially be used in a physical system to “recover” tracking should a snap occur.
3.1.4. Effect of Instability Avoidance
When using the weighted damped least squares approach for redundancy resolution, there are several interacting variables (damping, joint limit avoidance, tracking, and instability avoidance) which interact in a nonlinear manner. Selecting gains can be challenging and the performance of the algorithm can be sensitive to these gain selections. There was one analysis tool that proved particularly useful towards selecting these gains. If we define the 6 × 6 inverted matrix from (6) as A, then we can re-express this update law as
(23) |
and it becomes clear that the joint velocity is related to tracking, and the joint velocity is related to instability avoidance. We can compare the norm of these two competing joint velocities to better understand which term is dominating the simulation. Fig. 6 shows the relative norm of these joint velocities, or
(24) |
for both rotational () and translational () joint velocities for the simulation. As is clear from the figure, when is low, the effect of becomes more prominent. In addition, there appears to be an oscillating exchange of control priority from tracking to instability avoidance.
3.1.5. Effect of Stability Threshold
We explored the effect of the stability threshold on the robot’s behavior. We performed the trajectory-following simulation with chosen as 0.0, 0.1, 0.2, and 0.3. The results of these simulations are shown in Fig. 7. In each case, the controller tracks well and does not violate the stability threshold. As can be seen in Fig.7(Top), the stability trajectories are nearly identical and only differ by an offset in . The initial tracking response time is slower for higher values of , as shown in Fig. 7(Bottom).
3.2. Stiffness Tuning Simulations
To test our stiffness-tuning redundancy resolution algorithm, we simulated the real-time control of a three-tube concentric tube robot. For this simulation, we used tubes of the same dimensions as Table 3 with curvatures of 10, 12, and 22 m−1 for tubes 1, 2, and 3, respectively.
3.2.1. Stiffness Tuning with Trajectory Following
First, we optimized σC while the robot follows the torus trajectory given by (21). The results for this redundancy resolution controller are shown in Fig. 8. The first panel depicts σC throughout the trajectory with αC set to 300 (maximize σC), −300 (minimize σC), and 0 (nominal performance). The second panel shows the difference in performance when maximizing or minimizing σC. This shows that the redundancy resolution algorithm is capable of commanding a robot configuration that is nearly four times more compliant (in its most compliant direction) than the least compliant case. The third panel shows the tracking error in task space is similar and small for each case (~1 mm).
It is likely this difference in compliance would be apparent to a surgeon. It has been shown that the peak forces during minimally invasive surgery are around 2 N for suturing skin, around 1 N for suturing muscle, and typically less than 0.5 N for suturing liver tissue (Peirs et al. 2004). The forces during other tissue interactions (i.e. not driving needles) are typically much less than these. As a specific example of the potential utility of this control law, consider a 0.5 N force on the tip of the concentric tube manipulator investigated here. In maximum compliance mode, this could generate a deflection of up to 20 mm, and in minimum compliance mode, this would generate a deflection as small as 5 mm. This could very well be the difference between being able to drive the needle and not drive the needle.
3.2.2. Stiffness Tuning with Position Regulation
Next, we sought to maximize or minimize σC while keeping the tip position of the robot at a fixed position in space, which illustrates the degree of stiffness tuning self-motion. We commanded a static tip position at p = [1, 1, 55]⊤ mm, which is near the center of the robot’s workspace. The simulation lasted for 40 seconds, where every 10 seconds we changed the goal from maximizing (αC > 0) to minimizing (αC < 0) σC, or vice versa. This is shown in the first panel of Fig. 9.
The second and third panels of Fig. 9 show the configuration variable paths that move the robot from compliant configurations to stiff configurations, and vice versa. The translational joint values shown in the third panel make intuitive sense: when maximizing σC, the outer tube nearly fully retracts (r3 approaches 0 mm), meaning that the exposed length of the robot is almost entirely made up of the middle and inner tubes, which are more flexible. The fourth panel of Fig. 9 shows σC throughout the simulation as it is clearly maximized and minimized according to αC. Also, note that the error is not plotted here, but quickly approaches ~0.1 mm and remains there throughout the trajectory.
4. Experiments
After exploring the ability of the controller to avoid instabilities and tune stiffness in simulation, we conducted experiments to verify performance on physical hardware. This is an important contribution of this paper, since previous investigations of controllers including stability metrics have been primarily in simulation.
4.1. Instability Avoidance Experiments
To evaluate the elastic stability-aware redundancy resolution algorithm on robotic hardware, we performed a series of experiments using a three-tube concentric tube robot. The tube dimensions are listed in Table 4. First, we conducted a trajectory following experiment to compare the simulation results to a physical robotic system. Next, we used a teleoperation experiment to demonstrate the use of the redundancy resolution algorithm.
Table 4.
Tube 1 | Tube 2 | Tube 3 | Units | |
---|---|---|---|---|
Outer Diameter | 1.2446 | 2.0547 | 2.540 | mm |
Inner Diameter | 1.0287 | 1.6002 | 2.2479 | mm |
Total Tube Length | 398.1 | 284.7 | 162.3 | mm |
Straight Tube Length | 301.0 | 200.2 | 89.96 | mm |
Precurvature | 9.174 | 10.075 | 4.794 | m−1 |
For both experiments, we used the robotic setup shown in Fig. 10. The desired joint velocities are calculated in (6) at each time step of the trajectory following or teleoperation process. The joint values are converted to motor position commands and sent to the six motors that rotate the tubes and translate the tubes along linear slides. Further information on the design and use of this robot can be found in (Burgner et al. 2014; Swaney et al. 2015; Wirz et al. 2015).
Throughout the experiments, the tip position of the robot was tracked using an electromagnetic tracking coil (Aurora, Northern Digital, Inc.) inserted into the inner tube. The tracker data is used for recording purposes only and is not fed back into the controller (i.e., the controller is open loop with respect to the tip position). We set the joint limit r1,min = 10 mm to ensure that the tracking coil is not accidentally dislodged from the inner tube during operation.
After shape-setting the tube curvatures using the procedure described in (Gilbert and Webster III 2016), we measured the resulting curvatures and tube lengths (see Table 4). We then performed an calibration process to register the base pose of the robot (i.e., the exit point s = 0 from the base plate shown in Fig. 2) to the tracker frame. We moved the robot joints to 82 configurations and recorded the actuator vectors q and corresponding tip positions in the tracker frame. We used MATLAB’s fmincon function to find the transformation between the tracker frame and the robot base frame by minimizing the total euclidean error between the tip position transformed into the base frame and the tip position found with the forward kinematics model. The parameters for the optimization routine were the position vector of the transformation, the ZYX Euler rotation angles, and the torsional and bending stiffness of each tube.
4.1.1. Trajectory Following Experiment
We had the robot follow a helix trajectory similar to the simulations described in Sec.3.1.1, with the parameters R = 28 mm, r = 12 mm, NT = 2, and zoff = 110 mm, and a total time of 50 sec. We completed the trajectory 3 times with and without the instability avoidance control law. For each trial, the robot began at the home configuration ψL = 0 and r1 = r2 = r3 = 20 mm. From the home configuration, the robot was commanded to the first point of the trajectory (x = 40 mm, y = 0 mm, z = 110 mm) using the instability avoidance control law; this was done so that the robot began at the trajectory in the same configuration whether or not the instability avoidance term would be used for that particular trial. Once the robot tip reached the first point in the trajectory, it stopped for 10 seconds before following the trajectory; here, we jostled the tubes to remove small static frictional effects that may have built up during the transition between the home configuration and the initial trajectory configuration. This again was to ensure uniformity between trials.
During the experiments, the magnetic tracker recorded data at a rate of 40 Hz, and the robot positions were set to update at a loop rate of 125 Hz. The tracking output produced approximately 2000 data points. The tracking output was then transformed from the tracker frame to the robot’s base frame using the calibrated transformation between the two frames. Taking the euclidean norm between the desired trajectory and sensor data provides the trajectory following error at each time step.
As seen in Fig. 11(b), the robot does not snap when using the instability avoidance control law. However, without the control law (Fig. 11(a)), the robot exhibits poor tracking and snaps. Snap points are marked with yellow diamonds and the post-snap position is at the tips of the black arrows. Results of this experiment can also be seen in Extension 1.
The tracking errors are shown in time in Fig. 12. We performed these experiments with a stability threshold of 0.5. The mean error and mean normalized error are shown for the stable and unstable cases as horizontal dashed lines. The mean error for all data across 3 trials with the elastic stability-aware redundancy resolution was 4.18±1.98 mm. When normalized by the extended arclength of the robot at each time step, the mean error is 3.56±1.58 %. The mean error with elastic stability-unaware redundancy resolution was 13.84±10.95 mm (11.95±9.58 % when normalized by arclength). More importantly, the robot undergoes an uncontrolled snap when the controller does not include the instability avoidance term.
Note that these levels of error are excellent considering the intrinsic error in concentric tube robot models. The standard kinematic model for concentric tube robots does not include effects such as friction, tube clearances, and nonlinear material properties. Experimental evaluations of the model report errors of 1.5–3.0% (Rucker et al. 2010) and 2.1% (Dupont et al. 2010) of robot arclength. Thus, our results of 3.56±1.58 % of arclength represent very good tracking.
It is interesting to note that a simulation of this experiment reveals that the stability measure goes below zero twice when not using instability avoidance, but only one snap occurred during the experimental trials. This is to be expected based on the experiments in (Gilbert et al. 2016), which show the stability measure to be generally conservative; i.e., the physical robot generally snaps at a relative angle greater than that predicted by the model due to unmodeled frictional effects.
4.1.2. Teleoperation Experiment
Applying redundancy resolution methods to concentric tube robots to avoid elastic instabilities is motivated by the need for stable control without the significant computational overhead or a priori knowledge necessary for path planning. While the trajectory following experiment described above is not “pre-planned” (in the sense that the controller gets a new desired task space velocity at each time step and calculates a joint space velocity based only on that time step, without knowledge of the entire trajectory), it is still worthwhile to validate the algorithm’s performance in a teleoperated scenario with a user in the loop and no prescribed trajectory.
The user was instructed to control the tip position of the robot to explore the robot’s workspace. This was conducted with and without the instability avoidance control law. The user controlled the robot using a 3D Systems Touch haptic device. The user’s commanded tip position was compared to the previous position to compute the desired task space velocity using (7).
Fig. 13 shows all points that the robot can reach in stable configurations (blue) overlaid with all points that if reached would be unstable (red). Note that there is overlap between the two areas due to the robot’s redundancy—many points can be reached in both stable and unstable configurations. The user’s teleoperated position time history is overlaid using a black line. With instability avoidance turned off, the user experienced several uncontrolled snaps while moving the manipulator. These snapping points are marked with yellow diamonds in Fig. 13. Results of this experiment can also be seen in Extension 2.
This experiment demonstrates the importance of using the stability metric for redundancy resolution in a real-time control scenario on a prototype with highly curved tubes. Without the elastic stability-aware algorithm, the robot cannot be reliably teleoperated throughout much of its workspace.
4.2. Stiffness Tuning Experimental Validation
To validate the stiffness tuning approach, we measured the tip deflection of a three-tube concentric tube robot. We used the stiffness tuning control law to first minimize and then maximize the maximum singular value of the compliance matrix σC while regulating the robot’s tip position, as described in the simulations of Sec. 3.2.
The same tube set was used for these experiments as were used in the instability avoidance experiments of Sec. 4.1. The commanded tip position was p = [50, 0, 100]⊤ mm. This is a suitable point for testing compliance, as the direction of σC in this configuration is approximately aligned with the y-axis of the robot base frame (i.e., vertically in the world frame).
To evaluate the tip stiffness of the robot, we hung a 50 g mass approximately 4 mm from the tip of the inner tube (shown in Fig. 14). We measured the tip position with and without the applied load using the same electromagnetic tracking system as Sec. 4.1 in order to assess the position regulation error and the deflection. These measurements were taken at the nominal configuration (αC = 0), the compliance minimization configuration (αC = −300), and the compliance maximization configuration (αC = 300). The robot was driven to these positions by commanding a constant tip position, changing the value of αC, and waiting for the motors to stop moving (the ability of the robot to change compliance and maintain tip regulation is dictated by joint limits and the location of the desired position in the workspace). When no further changes in motor positions or σC were observed, tip position measurements were taken with and without the applied load. This procedure was repeated 5 times and the resulting mean and standard deviation for each configuration were computed.
We compared our experimental results to a simulated robot, using the tip regulation simulation described in Sec. 3.2. The simulated robot achieved a nominal σC of 32.4 mm/N, minimized σC of 24.7 mm/N, and maximized σC of 67.8 mm/N. Using the nominal, minimized, and maximized σC and an applied load of 50 g, produced predicted tip deflections of 15.9 mm, 12.1 mm, and 33.3 mm, respectively, in the robot’s most compliant direction. As shown in Fig. 15, the corresponding measured deflections were 13.5±1.2 mm, 11.8±0.4 mm, and 27.8±2.0 mm. Fig. 15 also shows the tip regulation error in all three cases, computed as the euclidean norm between the commanded tip position p and the measured tip position with no load applied. The tip error was 3.23±0.84 mm in the nominal configuration, 1.27±0.32 mm in the minimized σC configuration, and 9.33±3.81 mm in the maximized σC configuration.
5. Discussion and Conclusion
In this paper, we have proposed a redundancy resolution algorithm for concentric tube robots, and shown that it can be implemented on robotic hardware. This approach can be employed using real time resolved rates control, making it suitable for teleoperation, and utilizes new understanding of elastic stability. Use of this control approach makes it possible to use highly curved concentric tube robots that are capable of maneuvering in tight spaces, thus increasing the realistic design space of these robots.
We have also shown that concentric tube robots can resolve redundancy to tune their compliance. This ability could be used to improve the capabilities of these tools in the hands of surgeons and to allow the user to change the properties of their manipulator on the fly. We have demonstrated this capability with simulations and an example experimental configuration. Future work on redundancy resolution stiffness control of concentric tube robots includes further evaluation of the control scheme’s performance with different robot configurations. Different stiffness goals, such as optimizing axial or lateral stiffness, could be explored as well. In addition, it may be worthwhile to perform user studies in which the user can select the desired tip stiffness behavior. Improved designs and stiffness modification may one day combine to enable physicians to perform new kinds of surgical procedures that cannot be attempted today.
Funding
This material is based upon work supported by the National Institutes of Health under awards R01 EB017467, R01 EB026901, and NIH-NIBIB training grant T32EB021937, as well as by the National Science Foundation Graduate Research Fellowship Program under Grant No. DGE-1445197. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the authors and do not necessarily reflect the views of the NIH, the NIBIB, or the NSF. All authors are with the Department of Mechanical Engineering and the Vanderbilt Institute for Surgery and Engineering at Vanderbilt University, Nashville, TN 37212, USA (patrick.l.anderson@vanderbilt.edu, robert.webster@vanderbilt.edu).
A Appendix A: Index to Multimedia Extensions
Table 5.
Extension | Media Type | Description |
---|---|---|
1 | Video | Demonstration of trajectory following instability avoidance experiments |
2 | Video | Demonstration of teleoperation instability avoidance experiments |
References
- Abah C, Orekhov AL and Simaan N (2018) Design considerations and redundancy resolution for variable geometry continuum robots. In: 2018 IEEE International Conference on Robotics and Automation (ICRA). IEEE, pp. 767–774. [Google Scholar]
- Anderson PA, Hendrick RJ and Webster III RJ (2017) Real-time redundancy resolution for concentric tube robots to avoid elastic instability. In: 2017 IEEE International Conference on Robotics and Automation (ICRA) C4 Surgical Robotics Workshop. pp. 1–4. [Google Scholar]
- Bajo A, Goldman RE, Wang L, Fowler D and Simaan N (2012) Integration and preliminary evaluation of an insertable robotic effectors platform for single port access surgery. In: 2012 IEEE International Conference on Robotics and Automation. IEEE, pp. 3381–3387. [Google Scholar]
- Bajo A and Simaan N (2016) Hybrid motion/force control of multi-backbone continuum robots. The International journal of robotics research 35(4): 422–434. [Google Scholar]
- Bergeles C and Dupont PE (2013) Planning stable paths for concentric tube robots. In: Intelligent Robots and Systems (IROS), 2013 IEEE/RSJ International Conference on. IEEE, pp. 3077–3082. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bergeles C, Gosline A, Vasilyev NV, Codd PJ, del Nido PJ and Dupont PE (2015) Concentric tube robot design and optimization based on task and anatomical constraints. IEEE Trans. on Robot 31(1): 67–84. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Berthet-Rayne P, Leibrandt K, Gras G, Fraisse P, Crosnier A and Yang GZ (2018) Inverse kinematics control methods for redundant snake-like robot teleoperation during minimally invasive surgery. IEEE Robotics and Automation Letters. [Google Scholar]
- Burgner J, Rucker DC, Gilbert HB, Swaney PJ, Russell PT, Weaver KD and Webster RJ (2014) A telerobotic system for transnasal surgery. IEEE/ASME Transactions on Mechatronics 19(3): 996–1006. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Camarillo DB, Milne CF, Carlson CR, Zinn MR and Salisbury JK (2008) Mechanics modeling of tendon-driven continuum manipulators. IEEE Transactions on Robotics 24(6): 1262–1273. [Google Scholar]
- Chan TF and Dubey RV (1995) A weighted least-norm solution based scheme for avoiding joint limits for redundant joint manipulators. IEEE Transactions on Robotics and Automation 11(2): 286–292. [Google Scholar]
- Chirikjian GS and Burdick JW (1994) A modal approach to hyperredundant manipulator kinematics. IEEE Transactions on Robotics and Automation 10(3): 343–354. [Google Scholar]
- Chirikjian GS and Burdick JW (1995) The kinematics of hyperredundant robot locomotion. IEEE Transactions on Robotics and Automation 11(6): 781–793. [Google Scholar]
- Dupont PE, Lock J, Itkowitz B and Butler E (2010) Design and control of concentric-tube robots. IEEE Trans. on Robot 26(2): 209–225. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Edelmann J, Petruska AJ and Nelson BJ (2017) Magnetic control of continuum devices. The International Journal of Robotics Research 36(1): 68–85. [Google Scholar]
- Fagogenis G, Bergeles C and Dupont PE (2016) Adaptive nonparametric kinematic modeling of concentric tube robots. In: 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, pp. 4324–4329. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gilbert HB, Hendrick RJ and Webster III RJ (2016) Elastic Stability of Concentric Tube Robots: A Stability Measure and Design Test. IEEE Transactions on Robotics 32(1): 20–35. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gilbert HB, Rucker DC and Webster III RJ (2016) Concentric tube robots: The state of the art and future directions. In: Robotics Research. Springer, pp. 253–269. [Google Scholar]
- Gilbert HB and Webster III RJ (2016) Rapid, reliable shape setting of superelastic nitinol for prototyping robots. IEEE robotics and automation letters 1(1): 98–105. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ha J, Park FC and Dupont PE (2014) Achieving elastic stability of concentric tube robots through optimization of tube precurvature. In: Intelligent Robots and Systems (IROS 2014), 2014 IEEE/RSJ International Conference on. IEEE, pp. 864–870. [Google Scholar]
- Ha J, Park FC and Dupont PE (2016) Elastic stability of concentric tube robots subject to external loads. IEEE Transactions on Biomedical Engineering 63(6): 1116–1128. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hendrick RJ, Gilbert HB and Webster III RJ (2015) Designing snap-free concentric tube robots: A local bifurcation approach. In: Proc. IEEE Int. Conf. on Robot. Autom. pp. 2256–2263. [Google Scholar]
- Khadem M, Da Cruz L and Bergeles C (2018) Force/velocity manipulability analysis for 3d continuum robots. In: 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, pp. 4920–4926. [Google Scholar]
- Khadem M, ONeill J, Mitros Z, da Cruz L and Bergeles C (2019) Autonomous steering of concentric tube robots for enhanced force/velocity manipulability. IEEE. [Google Scholar]
- Kim YJ, Cheng S, Kim S and Iagnemma K (2014) A stiffness-adjustable hyperredundant manipulator using a variable neutral-line mechanism for minimally invasive surgery. IEEE transactions on robotics 30(2): 382–395. [Google Scholar]
- Leibrandt K, Bergeles C and Yang GZ (2015) On-line collision-free inverse kinematics with frictional active constraints for effective control of unstable concentric tube robots. In: Intelligent Robots and Systems (IROS), 2015 IEEE/RSJ International Conference on. IEEE, pp. 3797–3804. [Google Scholar]
- Leibrandt K, Bergeles C and Yang GZ (2017a) Concentric tube robots: Rapid, stable path-planning and guidance for surgical use. IEEE Robotics & Automation Magazine 24(2): 42–53. [Google Scholar]
- Leibrandt K, Bergeles C and Yang GZ (2017b) Implicit active constraints for concentric tube robots based on analysis of the safe and dexterous workspace. In: Intelligent Robots and Systems (IROS), 2017 IEEE/RSJ International Conference on. IEEE, pp. 193–200. [Google Scholar]
- Luo KAXJ, Looi T, Sabetian S and Drake J (2018) Designing concentric tube manipulators for stability using topology optimization. In: 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, pp. 1764–1769. [Google Scholar]
- Mahvash M and Dupont PE (2011) Stiffness control of surgical continuum manipulators. IEEE Transactions on Robotics 27(2): 334–345. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Murray RM, Li Z and Sastry SS (1994) A Mathematical Introduction to Rootic Manipulation. CRC Press. [Google Scholar]
- Peirs J, Clijnen J, Reynaerts D, Van Brussel H, Herijgers P, Corteville B and Boone S (2004) A micro optical force sensor for force feedback during minimally invasive robotic surgery. Sensors and Actuators A: Physical 115(2–3): 447–455. [Google Scholar]
- Rucker DC, Jones BA and Webster III RJ (2010) A geometrically exact model for externally loaded concentric-tube continuum robots. IEEE Trans. on Robot 26(5): 769–780. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Rucker DC and Webster III RJ (2011) Computing jacobians and compliance matrices for externally loaded continuum robots. In: Robotics and Automation (ICRA), 2011 IEEE International Conference on. IEEE, pp. 945–950. [Google Scholar]
- Sarli N and Simaan N (2017) Minimal visual occlusion redundancy resolution of continuum robots in confined spaces. In: 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, pp. 6448–6454. [Google Scholar]
- Simaan N (2005) Snake-like units using flexible backbones and actuation redundancy for enhanced miniaturization. In: Robotics and Automation, 2005. ICRA 2005. Proceedings of the 2005 IEEE International Conference on IEEE, pp. 3012–3017. [Google Scholar]
- Swaney PJ, Gilbert HB, Webster III RJ, Russell III PT and Weaver KD (2015) Endonasal skull base tumor removal using concentric tube continuum robots: a phantom study. Journal of neurological surgery. Part B, Skull base 76(2): 145. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Torres LG, Kuntz A, Gilbert HB, Swaney PJ, Hendrick RJ, Webster III RJ and Alterovitz R (2015) A motion planning approach to automatic obstacle avoidance during concentric tube robot teleoperation. IEEE International Conference on Robotics and Automation : 2361–2367. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wampler II CW (1986) Manipulator inverse kinematic solutions based on vector formulations and damped least-squares methods. IEEE Transactions on Systems, Man, and Cybernetics 16(1): 93–101. [Google Scholar]
- Wirz R, Torres LG, Swaney PJ, Gilbert H, Alterovitz R, Webster III RJ, Weaver KD and Russell III PT (2015) An experimental feasibility study on robotic endonasal telesurgery. Neurosurgery 76(4): 479–484. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Xu R, Asadian A, Naidu AS and Patel RV (2013) Position control of concentric-tube continuum robots using a modified jacobian-based approach. In: 2013 IEEE International Conference on Robotics and Automation. IEEE, pp. 5813–5818. [Google Scholar]
- Yip MC and Camarillo DB (2014) Model-less feedback control of continuum manipulators in constrained environments. IEEE Trans. on Robot 30(4): 880–889. [Google Scholar]