Skip to main content
Sensors (Basel, Switzerland) logoLink to Sensors (Basel, Switzerland)
. 2021 Nov 9;21(22):7443. doi: 10.3390/s21227443

Adaptive Neural Network Control of Time Delay Teleoperation System Based on Model Approximation

Yaxiang Wang 1, Jiawei Tian 2, Yan Liu 2, Bo Yang 2, Shan Liu 2,*, Lirong Yin 3, Wenfeng Zheng 2
Editors: Sebastiano Battiato, Francesco Rundo, Alessandro Ortis
PMCID: PMC8623693  PMID: 34833523

Abstract

A bilateral neural network adaptive controller is designed for a class of teleoperation systems with constant time delay, external disturbance and internal friction. The stability of the teleoperation force feedback system with constant communication channel delay and nonlinear, complex, and uncertain constant time delay is guaranteed, and its tracking performance is improved. In the controller design process, the neural network method is used to approximate the system model, and the unknown internal friction and external disturbance of the system are estimated by the adaptive method, so as to avoid the influence of nonlinear uncertainties on the system.

Keywords: neural network method, adaptive method, teleoperation system, time delay, force feedback, friction and disturbance

1. Introduction

Teleoperation robot systems have developed rapidly and been applied to many fields, such as space robots [1], remote surgery robots [2,3], teleoperation mobile robots [4] and so on. The general remote operation robot system mainly includes: a master module, operator module, master controller, communication channel, slave controller, slave, environment and so on. The frame diagram is shown in Figure 1. However, in the actual teleoperation mechanical system, it is difficult to obtain accurate mechanical parameters of the robot, such as mass, length, center of mass or moment of inertia, etc., resulting in the system dynamics parameters (inertia vector matrix, centrifugal force matrix and gravity term matrix) not being accurate, as well as uncertain external interference and mechanical internal friction, which are common in robot workspace control [5]. The complex working environment or the robot’s mechanical structure is, therefore, more complicated or can be destroyed. After modeling using mathematical models, these may be random or time-varying nonlinear functions. Therefore, we cannot accurately establish the mathematical model of the system. That is, the mathematical model of the system contains uncertainty. These problems are often encountered in teleoperation systems, and their manifestations are quite variable. Moreover, the uncertainty of these teleoperation system models not only affects the performance of the system but also makes the entire system unstable [6]. Therefore, how to solve the above problems has been a wide concern in the field of control [7].

Figure 1.

Figure 1

The control structure of the bilateral teleoperation robot system.

The methods proposed in reference [8,9] cannot effectively solve the problem of system model uncertainty in the form of time-varying functions. However, the neural network can approach the linear and nonlinear model by learning, so the neural network can be integrated into the system control. Therefore, the adaptive neural network and fuzzy control method [10,11,12,13] have good performance for the system with time delay, nonlinear control, complexity and uncertainty, and the method is widely used in the field of robot control. However, the number of adaptive laws depends on the number of neural network points. The accuracy of model approximation can be improved by increasing the number of neural network points. Thus, it takes a long time to learn online. Therefore, it is of great significance to design a bilateral neural network adaptive controller with short online learning time for the teleoperation system with time-delay force feedback [14,15,16].

Based on the above discussion and analysis, this paper designs a bilateral neural network adaptive controller for a class of teleoperation systems with constant time delay, external interference and mechanical internal friction, which is closer to the actual dynamic model of the teleoperation system. Finally, it guarantees the existence of constant communication channel delay, and nonlinear, complex and uncertain constant delay. The stability of the teleoperation force feedback system is improved and its tracking performance is improved. In the controller design process, the neural network method is used to approximate the system model, and the unknown internal friction and external disturbance of the system are estimated by the adaptive method so as to avoid the influence of nonlinear uncertainties on the system.

1.1. Spatial Dynamic Model of Master Slave–Robot Joint

Without considering the joint friction and external interference, the general dynamic equations of the master robot and the slave robot of the teleoperation system can be expressed by the following Euler–Lagrange Equation [17]

Mqm(qm)q¨m+Cqm(qm,q˙m)q˙m+Gqm(qm)=τm+JmT(qm)Fh (1)
Mqs(qs)q¨s+Cqs(qs,q˙s)q˙s+Gqs(qs)=τsJsT(qs)Fe (2)

In order to simplify the description, we can see Table 1.

Table 1.

Symbol meaning.

Meaning Symbol
The master and slave robots i(i=m,s)
Joint angular position qin×1
Angular velocity q˙in×1
Angular acceleration q¨in×1
The inertia matrix Mqi(qi)n×n
The Coriolis force and centripetal force matrix Cqi(qi,q˙i)n×n
Jacobian matrix Ji(qi)n×n
Transposition of the Jacobian matrix JiT(qi)
The force exerted by the operator on the master robot Fhn×1
The interaction force between the slave robot and the environment module Fen×1

The dynamic equations of the master robot and slave robot in the teleoperation system [18], namely Equations (1) and (2), have the following properties:

Property 1.

The inertia matrix Mqi(qi) is symmetric and positive definite, with maximum and minimum values.

0<λmin{Mqi(qi)}IMqi(qi)λmax{Mqi(qi)}I< (3)

Property 2.

The matrix of Coriolis and centrifugal force Cqi(qi,q˙i) and satisfies: M˙qi(qi)2Cqi(qi,q˙i) is skew symmetric. Namely

ζT(M˙qi(qi)2Cqi(qi,q˙i))ζ=0,ζn×1 (4)

Property 3.

The terms on the left side of the dynamic Formulas (1) and (2) of the master robot and slave robot of the teleoperation system are transformed linearly, and the unknown constant parameter vector θd=[θd1,,θdr]T of the robot is defined as

Mqi(qi)q¨i+Cqi(qi,q˙i)q˙i+Gqi(qi)=τi=Yd(qi,q˙i,q¨i)θd (5)

Among them, Yd(qi,q˙i,q¨i)n×r is called the dynamic regression matrix, which is the known function matrix about the joint variables of the robot.

1.2. Space Dynamic Model of Combined Teleoperation System Joint

We can observe that the dynamic model of the master and slave robot is in the joint space, and the dynamic model of the operator and the environment is in the working space. Thus, the dynamic model of the teleoperation system cannot be unified, so the dynamic model is increased. It is difficult to design a bilateral controller [19,20]. Therefore, it is necessary to use the master robot and slave robot workspace kinematics model to transform the dynamic model of the operator module and environment module workspace into joint space. Finally, the joint space dynamic model of the master robot and slave robot is sorted out, and then the simplified joint space model of the teleoperation system is obtained. The joint space dynamic model of the operator and environment is obtained as follows

Fh=fh*MhJmq¨m(BhJm+MhJ˙m)q˙mKhh(qm) (6)
Fe=fe*+MeJsq¨s(BeJs+MeJ˙s)q˙sKeh(qs) (7)

The two sides of Equations (6) and (7) are multiplied by JmT and substituting into Equations (1) and (2), respectively, and the simplified joint space model of the teleoperation system is obtained

Mi(qi)q¨i+Ci(qi,q˙i)q˙i+Gi(qi)=τi, i=m,s (8)

among which

Mm(qm)=Mqm(qm)+JmTMhJm (9)
Cm(qm,q˙m)=Cqm(qm,q˙m)+JmTBhJm+JmTMhJ˙m (10)
Gm(qm)=Gqm(qm)+JmTKhhm(qm)JmTfh* (11)
Ms(qs)=Mqs(qs)+JsTMeJs (12)
Cs(qs,q˙s)=Cqs(qs,q˙s)+JsTBeJs+JsTMeJ˙s (13)
Gs(qs)=Gqs(qs)+JsTKehs(qs)+JsTfe* (14)

After unifying the dynamics of each module in the teleoperation system into the joint space, according to Property 1–3, we can deduce the mathematical models of the combined teleoperation system, Equation (8) has the following new properties: for all, they represent the master and the slave.

Property 4.

The inertial matrix Mi(qi) is symmetric and positive definite, with maximum and minimum values.

0<λmin{Mi(qi)}IMi(qi)λmax{Mi(qi)}I< (15)

Property 5.

For ξn×1 , the Coriolis matrix M˙i(qi) and the centrifugal force matrix Ci(qi,q˙i) satisfy

ξT(M˙i(qi)2Ci(qi,q˙i))ξ=2ξTBiζ (16)

Property 6.

Unify the mathematical models of each module in the teleoperation system into the joint space and substitute them into the joint space mathematical models of the master robot and the slave robot. After sorting out the dynamic models, the items on the left of Equation (8) are obtained. The unknown constant parameter vector of the robot can also be defined as θz=[θz1,,θzr]T . After linear transformation, it is obtained that the parameter vector θz of the robot is linear

Mi(qi)q¨i+Ci(qi,q˙i)q˙i+Gi(qi)=τi=Yz(qi,q˙i,q¨i)θz (17)

where, i=m,s , Yz(qi,q˙i,q¨i)n×r is called the dynamic regression matrix, which is the known function matrix about the joint variables of the robot.

2. Materials and Methods

2.1. Problem Statement

The main goal of this paper is to consider the existence of mechanical internal friction and external friction between master robot and slave robot in teleoperation system. Based on the position error control structure, a bilateral controller is designed for the teleoperation system to make the slave robot follow the position signal of the master robot, to improve the performance and ensure the stability of the system. The RBF (Radial Basis Function) neural network (RBFNN) is used to approximate the system model because RBFNN is a single hidden layer, feedforward neural network based on function approximation proposed in the late 1980s.

At present, the commonly used function approximation methods are neural network and fuzzy system approximation methods [21], namely neural network adaptive control and fuzzy adaptive control. In the process of control law design, Lyapunov’s direct method is used to design control law and adaptive law. By designing appropriate adaptive law parameters, the stability and convergence of the whole closed-loop nonlinear system are guaranteed. At present, there are two kinds of radial basis function and multi-layer neural networks. Through comparative analysis, it can be found that the former can approximate any nonlinear function, and can solve the problem that the system cannot be established by a mathematical model under the condition of fewer network points, and has good generalization ability and fast learning convergence speed. To sum up, this paper chooses RBF neural network, and the system dynamic model contains time delay signal [22].

The unknown friction and external disturbance of each joint between the master robot and the slave robot are taken into account in the teleoperation system studied in this chapter. Therefore, according to the general joint space dynamic model of the combined teleoperation system described in Section 1.2, Equations (35) and (36) can be used to describe a joint space dynamic model with internal friction The mathematical model of teleoperation system with external interference is as follows

Mi(qi)q¨i+Ci(qi,q˙i)q˙i+Gi(qi)+fi(qi,q˙i)+fci(q˙i)=τi, i=m,s (18)

Among them, fcm(q˙m),fcs(q˙s)n×1 represents the mechanical internal friction of the master robot and the slave robot is bounded, and fm(qm,q˙m),fs(qs,q˙s)n×1 represents the uncertain bounded external interference of the master robot and the slave robot, respectively [23].

In the teleoperation system based on position error control structure, there is a constant time delay Tm,Ts in the forward communication channel and the reverse communication channel.

em=qs(tTs)qm(t) (19)
es=qm(tTm)qs(t) (20)

The goal of the time-delay force feedback teleoperation system is to keep the control torque of the master robot and the slave robot bounded so as to ensure that the position tracking error of the master–slave robot in the system can converge to zero and make the system stable. Therefore, the sliding mode function is defined as

rm=e˙m+Λmem (21)
rs=e˙s+Λses (22)

where Λj=ΛjT>0,j=m,s , which is a constant diagonal matrix.

By substituting Equations (21) and (22) into Equation (18), the following results are obtained

Mi(qi)r¨i+Ci(qi,q˙i)r˙i=f˜i(Xi)τi+fi(qi,q˙i)+fci(q˙i), i=m,s (23)

Here, f˜m(Xm) and f˜s(Xs) are the uncertainties of the master robot model and the slave robot model of the system

f˜m(Xm)=Mm(qm)q¨s(tTs)+Mm(qm)Λme˙m+Cm(qm,q˙m)q˙s(tTs)+Cm(qm,q˙m)Λmem+Gm(qm) (24)
f˜s(Xs)=Ms(qs)q¨m(tTm)+Ms(qs)Λse˙s+Cs(qs,q˙s)q˙m(tTm)+Cs(qs,q˙s)Λses+Gs(qs) (25)

Usually, the uncertainty f˜j(Xj),j=m,s of teleoperation system model is nonlinear and unknown. Therefore, in order to make the teleoperation system have practical significance, we can use the method of model approximation to obtain the approximate value of the uncertainty f˜j(Xj) so as to solve the above problems. In the control of nonlinear systems, the performance of the controller can be improved by using function approximation method when there are nonlinear uncertainties [23]. This chapter chooses RBF neural network to approximate the system model uncertainty f˜j(Xj) .

2.2. Preliminary Knowledge

The following is the design and stability analysis of the bilateral controller of the teleoperation system with time-delay force feedback.

We choose to use RBFNN method to approximate the system model. Therefore, according to the Equations (24) and (25) of the uncertainties f˜j(Xj) of the system model, we can select the network input signals of the master controller and the slave controller as follows

Xm=[q¨s(tTs),q˙s(tTs),qs(tTs),q˙m(t),qm(t)]T (26)
Xs=[q¨m(tTm),q˙m(tTm),qm(tTm),q˙s(t),qs(t)]T (27)

RBFNN consists of two layers: the hidden layer, which is used to project the input network signal into a high-dimensional space, and the output layer, which is used to output the linear combination of output signals of hidden layer with adaptive parameter weight adjustment. It is a linear parameterized neural network and has excellent approximation performance. Suppose the uncertain continuous function is F0(X):p approximated by RBFNN

Fnn(X)=W0Tσ0(X) (28)

XΩXp represents the network input vector, W0T=[w01,w02,,w0l]l represents the weight of the parameters to be adjusted, here l>1 represents the number of neural network points, and σ0(X)=[σ01(X),σ02(X),,σ0l(X)]T represents the Gaussian basis functions, which are defined as

σ0(X)=e(Xvi)T(Xvi)η2,i=1,,l (29)

where, viΩX and η>0 denote the center and width of the Gaussian function, respectively. The working principle of RBFNN is shown in Figure 2.

Figure 2.

Figure 2

Schematic diagram of RBFNN working principle.

The conclusion of Reference [7] shows that for a compact set ΩXp , when it is large enough, the radial basis function neural network of Equation (19) can arbitrarily approximate the uncertain continuous function F0(X) . For any accuracy rate ε>0 , there are

F0(X)=W0*Tσ0(X)+δ0(X) (30)

where XΩXp is the estimation error, its upper boundary is ε , and W0* is the optimal weight vector and satisfies the following conditions

W0*:=argminW0l{supXΩX|F0(X)W0Tσ0(X)|} (31)

For the radial basis function neural network Equation (30), which contains Gaussian function Equation (31), assuming ρ:=12minijvivj , the following inequality is established.

σ0(X)m=03p(m+2)p1e2ρ2m2/η2:=s (32)

where s is the finite value, m is the number of convergent infinite sequence terms {3p(m+2)p1e2ρ2m2/η2} .

2.3. Design and Stability Analysis of Bilateral Controller

Firstly, for the telerobot system introduced in Section 2.2, we defined a high calculus Lyapunov–Krasovskii candidate function V(t) that satisfies the following requirements, and which is used to analyze the stability and location tracking performance of the operating system

V(t)=12rmTMm(qm)rm+12rsTMs(qs)rs+12λmθ˜m2+12λsθ˜s2+12γmd˜m2+12γsd˜s2 (33)

where let, j=m,s , θ˜j=θjθ^j , d˜j=djd^j , λj,γj>0 be a constant.

By deriving the two sides of Equation (33), V˙(t) is obtained by

V˙(t)=12rmTM˙m(qm)rm+rmTMm(qm)r˙m+12rsTM˙s(qs)rs+rsTMs(qs)r˙s+1λmθ˜mθ˜˙m+1λsθ˜sθ˜˙s+1γmd˜md˜˙m+1γsd˜sd˜˙s (34)

From Property 5, rjT(M˙j(qj)2Cj(qj,q˙j))rj=2rjTBirjT,j=m,s,i=h,e . Again, by estimation error of θj , θ˜j=θjθ^j where θ˜˙j=θ^˙j by estimation error of dj , d˜j=djd^j where d˜˙j=d^˙j . By substituting the above Equation into Equation (34), we can obtain the following results

V˙(t)=rmT(f˜m(Xm)τm+fcm(q˙m)+fm(qm,q˙m))2rmTBh(qm)rm+rsT(f˜s(Xs)τs+fcs(q˙s)+fs(qs,q˙s))2rsTBe(qm)rs1λmθ˜mθ^˙m1λsθ˜mθ^˙m1γmd˜md^˙m1γsd˜sd^˙s (35)

By using radial basis function neural network WjTσj(Xj)n , Wjn×n , the uncertain term f˜j(Xj),j=m,s is approximated

f˜j(Xj)=WjTσj(Xj)+δj(Xj) (36)

where δj(Xj) is the estimation error that satisfies δj(Xj)εj where εj>0 , which is the constant.

By substituting Equation (36) into Equation (35), the following results are obtained

V˙(t)=rmT(WmTσm(Xm)+δm(Xm)τm+fcm(q˙m)+fm(qm,q˙m))+rsT(WsTσs(Xs)+δs(Xs)τs+fcs(q˙s)+fs(qs,q˙s))2rmTBhrm2rsTBers1λmθ˜mθ^˙m1λsθ˜sθ^˙s1γmd˜md^˙m1γsd˜sd^˙s (37)

By using the properties of matrix norm inequality, the following inequalities can be obtained

rjTWjTσj(Xj)rjWjFσj(Xj)12aj2rjTrjθjσjTσj+12aj2 (38)

where, let θj=WjF2 be the weight of the radial basis function to be estimated and adjusted, aj is a normal number. According to Properties 2–4, the internal friction fcj(q˙j) between master robot and slave robot in the system is continuous and bounded, and the unknown external interference fj(qj,q˙j) of master robot and slave robot is continuous bounded, assuming dj(δj(Xj)+fcj(q˙j)+fj(qj,q˙j)) j=m,s , then

rjT(δj(Xj)+fcj(q˙j)+fj(qj,q˙j))rj(δj(Xj)+fcj(q˙j)+fj(qj,q˙j))rjdj (39)

Substituting Equations (38) and (29) into Lyapunov derivative Equation (37), we obtain the following results

V˙(t)i=m,s(riT(12ai2riθiσiTσiτi)+rjdj+12aj2)2rmTBhrm2rsTBers1λmθ˜mθ^˙m1λsθ˜sθ^˙s1γmd˜md^˙m1γsd˜sd^˙s (40)

We can design the neural network adaptive control law of time delay teleoperation system based on model approximation

τj=kjrj+rj2aj2θ^jσjTσj+rjrj+eajtd^j (41)

Here, j=m,s , kj is the normal number. Thus, from Equation (41), there are

rjTτj=kjrjTcjrj12aj2rjTcjrjθ^jσjTσj1rj+eajtrjTcjrjd^j (42)

By substituting Equation (42) into Equation (40), the following results are obtained

V˙(t)kmrmTrmksrsTrs+12am2+12as22rmTBhrm2rsTBers+i=m,s(1λiθ˜i(λi2ai2riTriσiTσiθ^˙i)+1γid˜i(γiriTriri+eaitsd^˙i))+rmdm+rsdsrmTrmrm+eamtdmrsTrsrs+eastds (43)

Therefore, we can design the neural network adaptive controller of the master robot and the slave robot based on model approximation

θ^˙j=λj2aj2rjTrjσjTσjψjθ^j (44)
d^˙j=γjrjTrjrj+eajtυjd^j (45)

where ψj , υj are the normal number. By substituting the Adaptive Law (44) and Equation (45) into Equation (43), the following results are obtained

V˙(t)kmrmTrmksrsTrs+12am2+12as22rmTBhrm2rsTBers+i=m,s(ψiλiθ˜iθ^i+υiγid˜id^i+ridiriTriri+eaitdi) (46)

Therefore, the time-delay force feedback teleoperation system based on model approximation in this paper includes a bilateral position control closed-loop, and the adaptive neural network control block diagram is shown in Figure 3. As can be seen from the figure, we combine the operator model with the master robot, and the environment model with the slave robot. In order to simplify the processed teleoperation system, two-sided controller Equation (41) and adaptive estimation law Equations (44) and (45) are designed to ensure the system stability. At the same time, this can solve the problems of time delay and nonlinear uncertainties of the system model, so as to improve the tracking performance and instantaneous performance of Equation (18) of time-delay force feedback teleoperation systems based on position error.

Figure 3.

Figure 3

Adaptive neural network control block diagram of time delay teleoperation system based on model approximation.

The stability of the closed-loop teleoperation system with time-delay force feedback, as shown in Figure 3, is discussed, and the position tracking performance between the master robot and the slave robot is analyzed.

In the case of contact, the closed-loop time-delay force feedback teleoperation system is controlled by two-sided neural network adaptive controller Equation (41) and adaptive law Equations (44) and (45). For this teleoperation system, the communication channel has constant time delay Tm,Ts .

It is stable under the neural network adaptive bilateral control law and adaptive law; that is, the tracking errors em,es are bounded at the joint space robot’s speed q˙m,q˙s , and when the time approaches infinity, the velocity q˙m,q˙s and tracking errors em,es of the joint space robot converge to a small area where it is close to zero.

For proof, from θ˜j=θjθ^j and d˜j=djd^j , j=m,s , there are

θ˜jθ^j=θ˜j(θjθ˜j)12θj212θ˜j2 (47)
d˜jd^j=d˜j(djd˜j)12dj212d˜j2 (48)

By substituting Equations (47) and (48) into Equation (46), the results are as follows

V˙(t)i=h,e,j=m,s(kjrjTrj+2rjTBirj+ψj2λjθ˜j2+υj2γjd˜j2)+j=m,s(ψj2λjθj2+υj2γjdj2+eajtdj+12aj2) (49)

where a0=min{2kjλm(Mj(qj)),ψj,υj,j=m,s} , and b0=j=m,s(ψj2λjθj2+υj2γjdj2+12aj2+dj) and if Bh,Be is a positive definite constant diagonal matrix, then Equation (49) can be written as follows

V˙(t)a0V+b0 (50)

The Equation (50) is integrated as follows

V(t)(V(0)b0a0)ea0t+b0a0 (51)

When t , there were V(t)b0a0 . Finally, we achieve the following results

rj2b0λm(Mj(qj))a0,t,j=m,s (52)

To sum up, by selecting appropriate parameters, when the time approaches infinity, the sliding mode function rm,rs can approach to the sliding mode of small area of 0, and the teleoperation system is stable under the bilateral neural network adaptive control law and adaptive law. That is, the tracking error em,es is bounded at the joint space robot’s speed q˙m,q˙s , and when the time approaches infinity, the velocity q˙m,q˙s and tracking error em,es of the joint space robot converge to a small area close to zero.

3. Results

In order to verify the effectiveness of the above control algorithm, the master robot and slave robot are simulated in the presence of contact with the operator and the environment. Simulink is used for simulation verification, and the S-function is used to establish the system model, and then the neural network adaptive control closed-loop system of the time-delay force feedback teleoperation system based on model approximation is built, as shown in Figure 3.

Considering the external interference and the internal friction of the robot, the dynamic models of the teleoperation system are Equation (18). In this paper, the master robot and slave robot in the teleoperation system adopt the 2-DOF, 2-link, rotary joint manipulator robot. Here, for the sake of simplicity and generality, the moment of inertia of the rod is ignored. The mathematical model of joint space dynamics is as follows

Mqi(qi)=[mi1li12+mi2li12+mi2li22+2mi2li1li2cos(qi2)mi2li22+mi2li1li2cos(qi2)mi2li22+mi2li1li2cos(qi2)mi2li22] (53)
Cqi(qi,q˙i)=[mi2li1li2q˙i2cos(qi2)mi2li1li2(q˙i1+q˙i2)sin(qi2)mi2li1li2q˙i1sin(qi2)0] (54)
Gqi(qi)=[(mi1li2+mi2li1)gcos(qi1)+mi2li2gcos(qi1+qi2)mi2li2gcos(qi1+qi2)] (55)

In addition, in the experiment, the external interference of the master robot and the slave robot is set as fi(qi,q˙i)=[0.1qi1q˙i1sin(t)0.1qi2q˙i2sin(t)]T . Set the internal friction of the master robot and the slave robot as fcm(q˙m)=[fd1q˙m1+k1sign(q˙m1)fd2q˙m2+k2sign(q˙m2)]T Here, fd1,fd2,k1,k2 is a constant, and fcs(q˙s)=[fd3q˙s1+k3sign(q˙s1)fd4q˙s2+k4sign(q˙s2)]T where fd1,fd2,k1,k2 are constant.

At the same time, the external force from the operator is selected as fh*=[25(1cos(0.05πt))0]T , and the external force from the interaction between robot and environment is selected as fe*=[00]T .

In the process of building a closed-loop teleoperation system, the mechanical constant parameters related to the dynamics of the master robot, slave robot, operator and environment are shown in Table 2.

Table 2.

Master–slave robot parameters, operator and environment parameters.

mm1 lm1 mm2 lm2 ms1 ls1 ms2 ls2
0.5 kg 0.6 m 0.5 kg 0.4 m 0.5 kg 0.6 m 0.5 kg 0.4 m
g fd1 fd2 fd3 fd4 k1 k2 k3
9.81 m/s2 1 2 3 3 3 2 4
k4 Mh Bh Kh Me Be Ke
6 0.2 kg 50 Ns/m 1000 N/m 0.1 kg 20 Ns/m 1000 N/m

In the simulation, the initial position of the master robot and slave robot is set as qm(0)=[0.4pi0.2pi]T , qs(0)=[0.25pi0.1pi]T . The time delay of the forward communication channel and reverse communication channel of the teleoperation system is Tm=Ts=0.6s .

In the simulation teleoperation system, the controller of the master robot and slave robot adopts Equation (41), which contains adaptive laws of Equations (44) and (45). After repeated debugging, the controller parameters in the teleoperation system are selected as km=ks=diag(30,30) , am=as=5 . Select the parameters Λm=Λs=5I in the sliding mode function. The parameters of the adaptive law are γm=γs=λm=λs=1 ψm=ψs=0.2 , υm=υs=0.01 . The neural network WmTσm(Xm) , where Xm10 , contains 50 network points, of which the center points are evenly distributed on; the neural network here contains 50, and its center points are evenly distributed on [10,10] . The simulation results of the experiment are shown in Figure 4, Figure 5, Figure 6, Figure 7 and Figure 8.

Figure 4.

Figure 4

Tracking performance between master and slave robots. (a) Tracking of the joint position of the master and slave robots; (b) Tracking error of the joint position of the master and slave robots.

Figure 5.

Figure 5

Master–slave robot adaptive parameters θj and dj . (a) Value of θj ; (b)Value of dj .

Figure 6.

Figure 6

Input torque of master–slave robot joint.

Figure 7.

Figure 7

em and τm under different control parameters. (a) The joint position tracking error em of the main robot; (b) Joint input torque τm of master robot.

Figure 8.

Figure 8

es and τs under different control parameters. (a) The joint position tracking error es of the slave robot; (b) Joint input torque τs of slave robot.

The tracking performance between the master robot and the slave robot is shown in Figure 4. Figure 4a shows the track of the joint position of the master robot and the slave robot of the teleoperation system. We can see that the slave robot of the teleoperation system can track the movement of the upper master robot and keep the teleoperation system stable under the condition of the contact motion and the constant time delay of the stable communication channel. Figure 4b shows the error between the joint angle of the master robot and that of the slave robot passing through the reverse channel, and the error between the joint angle of the slave robot and the joint angle signal of the master robot passing through the forward channel.

The values of the adaptive parameters are shown in (a,b) in Figure 5, respectively. Figure 6 shows the input torque diagram of joint 1 and joint 2 of the master robot and slave robot of the teleoperation system.

In order to further study how different controller parameters affect the control performance of the adaptive neural network controller, we carry out simulation experiments, and select different control parameters to compare and analyze the influence of control parameters on the control performance of the controller. The specific experiments are as follows: select three groups of different parameters, respectively, for the following three cases: km=ks=50I , am=as=10 ; km=ks=30I , am=as=5 ; km=ks=15I , am=as=2.5 . The simulation results are shown in Figure 7 and Figure 8.

Figure 9 shows the results of another method used for the time delay control system, which is an adaptive control of the teleoperation system based on position error structure [24]. Compared with the method mentioned in Figure 9, the teleoperation system studied in this paper also considers the unknown internal friction and external interference of each joint between the master robot and the slave robot. We can observe from it that the position curves of the master robot and the slave robot’s end almost overlap after about 3.5 s in Figure 9a. Adaptive control of the teleoperation system is based on position error structure. Compared with Figure 4a, the position curves of the master robot and the slave robot’s end almost overlap at about 3 s, the method applied in this paper enables the slave robot of the teleoperation system to track the position of the master robot faster, and, with regards to the degree of overlap between the subsequent two curves, the method in this article overlaps better than the method mentioned in Figure 9. The method in this paper can enable the slave robot of the teleoperation system to track the position of the master robot. Figure 9b shows the input torque of joint 1 and joint 2 of the master robot and slave robot of the teleoperation system. Compared with Figure 6, both delay force feedback teleoperation systems can maintain stability.

Figure 9.

Figure 9

Simulation results. (a) Master and slave robot end position trajectory; (b) Master and slave robot joint input torque.

4. Discussion

In this paper, aiming at the dynamic parameter uncertainty, nonlinear parameter uncertainty and time delay of the teleoperation system model linearization, in order to effectively improve the control performance and tracking performance of the teleoperation system, an adaptive neural network controller based on Lyapunov’s method is designed, which is integrated into the position error control structure. The stability of the closed-loop system and the boundedness of the position tracking error convergence are theoretically proved. Finally, the effectiveness of the proposed control scheme is verified by MATLAB Simulink numerical simulation, and the influence of the different controller parameters on the control performance of the system is studied. The effectiveness of our control method is proved by the above simulation data.

The advantages of the proposed controller are as follows [15,16,17]: (1) the RBF neural network is used to approximate the system model with communication delay signal, and the adaptive control method is combined. In this way, the unknown internal friction of each joint of the master–slave robot, the unknown external interference and the constant communication delay in the combined teleoperation system model can be dealt with, and it has good robustness. (2) The control method designed in this chapter contains less online update learning parameters, which reduces the online learning time, thus improving the tracking performance of the system, and is more easily applied to the actual time-delay force feedback teleoperation system. (3) This method not only guarantees the stability of the teleoperation system with time-delay force feedback but also has good control performance.

5. Conclusions

From Figure 4, we can see that the slave robot of the teleoperation system can track the movement of the upper master robot, and the teleoperation system can maintain the motion of the upper master robot under the condition of the contact motion and the constant time delay of the communication channel stable [13,14]. Figure 4b shows the error between the joint angle of the master robot and that of the slave robot passing through the reverse channel in the teleoperation system, and the error between the joint angle of the slave robot and the joint angle signal of the master robot passing through the forward channel. From the figure, we can see that the tracking error of the joint position of the master robot and the slave robot can approach 0 in about 5 s. By calculating the average tracking error of the closed-loop constant time-delay force feedback teleoperation system, the average tracking error of the main robot joint 1 is 0.0765 rad, the average tracking error of joint 2 is 0.0521 rad, the average tracking error of slave robot joint 1 is 0.0741 rad, and the average tracking error of joint 2, 0.0612 rad, can be achieved, which shows that the control method in this chapter has good control performance.

The three diagrams from Figure 4, Figure 5 and Figure 6 show that the teleoperation system with time-delay force feedback has good stability and transient performance under the bilateral control method of the teleoperation system designed in this paper.

Figure 7a,b show the position tracking error signal curve and input torque signal curve of the main robot joint 1 and joint 2 of the teleoperation system under three groups of different controller parameters. (a,b) in Figure 4, Figure 5, Figure 6 and Figure 7 show the position tracking error signal curve and input torque signal curve of the teleoperation system from the robot joint 1 and joint 2 under three groups of different controller parameters. From the comparison of the two graphs, it can be concluded that the larger the value of km,ks,am,as , the faster the convergence speed will be, the chattering phenomenon will occur, and the value of the corresponding control torque signal at that moment is greater.

Author Contributions

Conceptualization, B.Y. and W.Z.; methodology, Y.W.; software, S.L.; validation, Y.L. and J.T.; formal analysis, L.Y.; investigation, S.L.; resources, Y.L.; data curation, J.T.; writing—original draft preparation, Y.W. and Y.L.; writing—review and editing, S.L.; visualization, J.T.; supervision, W.Z.; project administration, L.Y.; funding acquisition, W.Z. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the Sichuan Science and Technology Program, grant number 2021YFQ0003.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

The data presented in this study are available on request from the corresponding author. The data are not publicly available due to that the experiment at current stage are not at the level to be published.

Conflicts of Interest

The authors declare no conflict of interest.

Footnotes

Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

References

  • 1.Bejczy A.K. Toward advanced teleoperation in space. Prog. Astronaut. Aeronaut. 1994;161:107. [Google Scholar]
  • 2.Wright J., Hartman F., Cooper B., Maxwell S., Morrison J. Driving on Mars with RSVP. IEEE Robot. Autom. Mag. 2006;13:37–45. doi: 10.1109/MRA.2006.1638014. [DOI] [Google Scholar]
  • 3.Bhattacharya S., Rawat D. Comparative study of remote surgery techniques; Proceedings of the 2015 IEEE Global Humanitarian Technology Conference (GHTC); Seattle, WA, USA. 8–11 October 2015; pp. 407–413. [Google Scholar]
  • 4.DiMaio S., Hanuschik M., Kreaden U. Surgical Robotics. Springer; Berlin, Germany: 2011. The da Vinci surgical system; pp. 199–217. [Google Scholar]
  • 5.Sun D., Naghdy F., Du H. Application of wave-variable control to bilateral teleoperation systems: A survey. Annu. Rev. Control. 2014;38:12–31. doi: 10.1016/j.arcontrol.2014.03.002. [DOI] [Google Scholar]
  • 6.Shahbazi M., Atashzar S.F., Patel R.V. A Systematic Review of Multilateral Teleoperation Systems. IEEE Trans. Haptics. 2018;11:338–356. doi: 10.1109/TOH.2018.2818134. [DOI] [PubMed] [Google Scholar]
  • 7.Huang W., Zheng W., Mo L. Distributed robust H∞ composite-rotating consensus of second-order multi-agent systems. Int. J. Distrib. Sens. Netw. 2017;13:1550147717722513. doi: 10.1177/1550147717722513. [DOI] [Google Scholar]
  • 8.Li Z., Cao X., Tang Y., Li R., Ye W. Bilateral teleoperation of holonomic constrained robotic systems with time-varying delays. IEEE Trans. Instrum. Meas. 2013;62:752–765. doi: 10.1109/TIM.2013.2246906. [DOI] [Google Scholar]
  • 9.Richert D., Macnab C.J., Pieper J.K. Adaptive haptic control for telerobotics transitioning between free, soft, and hard environments. IEEE Trans. Syst. Man Cybern. Part A Syst. Hum. 2011;42:558–570. doi: 10.1109/TSMCA.2011.2170066. [DOI] [Google Scholar]
  • 10.Liu Y., Chopra N. Control of semi-autonomous teleoperation system with time delays. Automatica. 2013;49:1553–1565. doi: 10.1016/j.automatica.2013.02.009. [DOI] [Google Scholar]
  • 11.Chen Z., Liang B., Zhang T., Wang X., Zhang B. Adaptive bilateral control for nonlinear uncertain teleoperation with guaranteed transient performance. Robotica. 2016;34:2205–2222. doi: 10.1017/S0263574714002847. [DOI] [Google Scholar]
  • 12.Zhou Y., Zheng W., Shen Z. A New Algorithm for Distributed Control Problem with Shortest-Distance Constraints. Math. Probl. Eng. 2016;2016:1604824. doi: 10.1155/2016/1604824. [DOI] [Google Scholar]
  • 13.Zhang T., Zhou C., Zhu Q. Adaptive variable structure control of MIMO nonlinear systems with time-varying delays and unknown dead-zones. Int. J. Autom. Comput. 2009;6:124–136. doi: 10.1007/s11633-009-0124-5. [DOI] [Google Scholar]
  • 14.Islam S., Liu P.X., Saddik A.E., Yang Y.B. Bilateral control of teleoperation systems with time delay. IEEE/ASME Trans. Mechatron. 2014;20:1–12. doi: 10.1109/TMECH.2013.2297354. [DOI] [Google Scholar]
  • 15.Yin S., Shi P., Yang H. Adaptive fuzzy control of strict-feedback nonlinear time-delay systems with unmodeled dynamics. IEEE Trans. Cybern. 2015;46:1926–1938. doi: 10.1109/TCYB.2015.2457894. [DOI] [PubMed] [Google Scholar]
  • 16.Wang T., Gao H., Qiu J. A combined adaptive neural network and nonlinear model predictive control for multirate networked industrial process control. IEEE Trans. Neural Netw. Learn. Syst. 2015;27:416–425. doi: 10.1109/TNNLS.2015.2411671. [DOI] [PubMed] [Google Scholar]
  • 17.Sanner R.M., Slotine J.J.E. Gaussian networks for direct adaptive control; Proceedings of the 1991 American Control Conference; Boston, MA, USA. 26–28 June 1991; pp. 2153–2159. [Google Scholar]
  • 18.Su X., Wu L., Shi P. A novel approach to output feedback control of fuzzy stochastic systems. Automatica. 2014;50:3268–3275. doi: 10.1016/j.automatica.2014.10.053. [DOI] [Google Scholar]
  • 19.Hua C., Guan X. Smooth dynamic output feedback control for multiple time-delay systems with nonlinear uncertainties. Automatica. 2016;68:1–8. doi: 10.1016/j.automatica.2016.01.007. [DOI] [Google Scholar]
  • 20.Liu Y., Tong S. Barrier Lyapunov functions for Nussbaum gain adaptive control of full state constrained nonlinear systems. Automatica. 2017;76:143–152. doi: 10.1016/j.automatica.2016.10.011. [DOI] [Google Scholar]
  • 21.Li Z., Cao X., Ding N. Adaptive fuzzy control for synchronization of nonlinear teleoperators with stochastic time-varying communication delays. IEEE Trans. Fuzzy Syst. 2011;19:745–757. doi: 10.1109/TFUZZ.2011.2143417. [DOI] [Google Scholar]
  • 22.Chen M., Tao G. Adaptive fault-tolerant control of uncertain nonlinear large-scale systems with unknown dead zone. IEEE Trans. Cybern. 2015;46:1851–1862. doi: 10.1109/TCYB.2015.2456028. [DOI] [PubMed] [Google Scholar]
  • 23.Wang H., Liu X., Liu K. Robust adaptive neural tracking control for a class of stochastic nonlinear interconnected systems. IEEE Trans. Neural Netw. Learn. Syst. 2015;27:510–523. doi: 10.1109/TNNLS.2015.2412035. [DOI] [PubMed] [Google Scholar]
  • 24.Liu S., Zhang X., Zheng W., Yang B. Adaptive control for time-delay teleoperation systems with uncertain dynamics. J. Phys. Conf. Ser. 2017;887:12074. doi: 10.1088/1742-6596/887/1/012074. [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Data Availability Statement

The data presented in this study are available on request from the corresponding author. The data are not publicly available due to that the experiment at current stage are not at the level to be published.


Articles from Sensors (Basel, Switzerland) are provided here courtesy of Multidisciplinary Digital Publishing Institute (MDPI)

RESOURCES