Skip to main content
Sensors (Basel, Switzerland) logoLink to Sensors (Basel, Switzerland)
. 2020 May 7;20(9):2671. doi: 10.3390/s20092671

Distributed Target Tracking in Challenging Environments Using Multiple Asynchronous Bearing-Only Sensors

Yifang Shi 1, Jee Woong Choi 2, Lei Xu 3, Hyung June Kim 4, Ihsan Ullah 5,*, Uzair Khan 5
PMCID: PMC7248723  PMID: 32392866

Abstract

In the multiple asynchronous bearing-only (BO) sensors tracking system, there usually exist two main challenges: (1) the presence of clutter measurements and the target misdetection due to imperfect sensing; (2) the out-of-sequence (OOS) arrival of locally transmitted information due to diverse sensor sampling interval or internal processing time or uncertain communication delay. This paper simultaneously addresses the two problems by proposing a novel distributed tracking architecture consisting of the local tracking and central fusion. To get rid of the kinematic state unobservability problem in local tracking for a single BO sensor scenario, we propose a novel local integrated probabilistic data association (LIPDA) method for target measurement state tracking. The proposed approach enables eliminating most of the clutter measurement disturbance with increased target measurement accuracy. In the central tracking, the fusion center uses the proposed distributed IPDA-forward prediction fusion and decorrelation (DIPDA-FPFD) approach to sequentially fuse the OOS information transmitted by each BO sensor. The track management is carried out at local sensor level and also at the fusion center by using the recursively calculated probability of target existence as a track quality measure. The efficiency of the proposed methodology was validated by intensive numerical experiments.

Keywords: multiple asynchronous BO sensors tracking, track management, OOS information, distributed tracking, LIPDA, DIPDA-FPFD

1. Introduction

Target tracking uses noisy observations received by sensors at discrete time instances to sequentially estimate the target state of interest evolving over time. A passive bearing-only (BO) sensor system is able to track a target in a stealthy manner combined with the superior estimation accuracy and low cost. These advantages made it useful in a wide range of military and civilian applications. These applications include but are not limited to control and navigation, surveillance, Internet of Things, just name a few [1,2]. Usually, the data collected from multiple BO sensors are integrated to give a much more accurate and comprehensive description of the targets of interest compared to that of single BO sensor configuration, also with the additional benefit of tackling the target non-observability problem [1].

Compared to centralized tracking architecture, the distributed tracking framework carries out the local tracking and information fusion in any member node of the multisensor system, and has the potential of application to large scale sensor networks, besides, it consumes less computation resources and communication bandwidth, while delivers comparable tracking performance to that of the centralized framework [1,3]. In this paper, target tracking using multiple BO sensors is implemented in a distributed architecture. In realistic multisensor target tracking system, one usually faces two main challenges. The first one is the presence of clutter measurement and target misdetection where the sensor measurements received at each scan contain detections originated not only from targets of interest, but also from thermal noise, terrain reflections, clouds, birds, etc. [4]. Such unwanted measurements are usually termed as clutter measurement disturbance and their number at each scan varies randomly. Both target-originated and clutter-originated measurements simultaneously exist at the measurement space and lead to the measurement origin uncertainty. To make matters worse, even when there are targets in the sensor’s field of view, they can go undetected due to targets occlusion or sensor jamming, resulting in the target misdetection [4]. The problems of clutter measurement disturbance and target misdetection collectively make it considerably difficult to robustly maintain the true tracks and estimate the states of the targets of interest. The second challenge is that the data transmitted from different local sensors unavoidably arrives in the fusion center in out-of-sequence (OOS), i.e., the data measured at earlier time arrives at the fusion center after the central tracks were already updated at the current time. This phenomenon is termed as the OOS information problem and usually happens in the realistic tracking system because of the diverse sensor sampling interval, varying measurement processing time and uncertain communication delay [5,6]. Consequently, updating the currently filtered track state with OOS information becomes nontrivial.

Much research paid attention to the clutter measurement disturbance and target misdetection problem. The authors in [7] first proposed a M/N logic track management methodology, which declares an initialized track to be true track if there are at least M scan gating successes among consecutive N scan gating procedure, while its track management performance may drastically deteriorate as the clutter measurement density increases and the target misdetection exacerbates. Later, the authors in [8,9] proposed using the sequential probability ratio test (SPRT) as the track quality measure to dynamically declare true tracks following targets of interest and recognize false tracks not following any targets of interest. However, the SPRT of each track can be any positive value and determining the track scoring threshold becomes a hard nut. [10] investigated adopting the probability of target visibility to score each tentative track, so as to distinguish true tracks from false tracks. The authors in [11,12] presented a recursively calculated probability of target existence (PTE) as a track quality measure for operating the track management, i.e., confirming true tracks and maintaining them since confirmation, recognizing false tracks and deleting them from memory. In addition to the fact that the PTE is a probability whose value lies between 0 and 1, it is very convenient to set the thresholding value. This shows a prominent improvement in track management [12,13]. The concept of PTE was further extended to deal with the target tracking in the situation of high clutter measurement density and high target misdetection probability by employing a multiple scan data association strategy in [14]. Recently, the authors in [15,16,17,18] introduced a shadowing filter as well as its varieties for target positioning and tracking. In contrast to the sequential tracking methods, the shadowing filters are developed based on a very simple principle: if the model is good enough, state estimations must be close to the observations and consistent with the model’s equations, which imposes a quadratic norm on the filter and guarantees not falling into the trap of local minimum. The availability of the proposed shadowing filters is verified in various tracking applications using real data, which shows novelty and efficiency over the widely used Kalman and particle filters.

The OOS information problem was pervasively studied previously. [19] suggests a straightforward solution by ignoring and directly discarding the OOS information in the tracking procedure, obviously, the useful target information contained in the OOS data are lost. To avoid this drawback, the authors in [20] proposed a reprocessing method which stores all the information collected from the OOS information time to the last track update time and then reprocesses them in a chronological order. This solution gives the optimal tracking performance at the cost of high computation and storage consumption, which is usually not feasible in most of the tracking system. [20,21] investigated an approximated OOS fusion method using the criteria of minimum mean square error under the constraint that only the most recent updates are saved. [22] proposed a fixed-point smoothing based OOS measurement (OOSM) methodology which delivers optimal tracking performance based on the best linear unbiased estimation (BLUE) principle; however, it requires additional storage apart from the state estimate and its associated error covariance. [23] proposed an optimal retrodiction-based OOSM filtering approach termed as A1 algorithm, and also its suboptimal but computationally efficient version called B1 algorithm with less storage requirement, whereas, both A1 and B1 algorithm assumed the OOS lag is less than a sampling interval. The authors in [24] introduced the first optimal solution for the general l-step-lag problem, called the fading information methodology, which updates the current target state using evaluated information from the OOSM on its subsequent states, but it is computationally complex. [25] proposed an augmented state Kalman filter (AS-KF) Bayesian approach to address the OOSM problem, which augments a sequence of recent state to the current state and carry out a batch-form updating strategy, whereas, it needs to approximate the OOSM time to some integer sampling time instance. The authors in [26] presented a single-step retrodiction-based solution for solving l-step-lag OOSM problem termed as the Al1 algorithm and also its computation and storage efficient version Bl1 algorithm. It achieves one-step solution by defining equivalent measurements at the current time that represents all the measurements with time stamps later than the OOSM, and show some priority in the sense of tracking performance and storage requirements among the above reviewed methods. More recently, the authors in [27] enhanced the Al1 and Bl1 algorithms by employing the RTS fixed lag smoothing approach for further improving the fusion performance using Infrared sensor and Laser Detection- Ranging sensor. [28] suggested a new methodology termed as the forward prediction fusion and decorrelation (FPFD) for tackling the OOSM problem without relying on the retrodiction technique, wherein, a tracklet is created and predicted forward and decorrelated from the actual track in the information space. It was proved in [28] that the FPFD method performs as well as the retrodiction-based approaches, while requiring less data storage in most case. The authors in [29] further extended the FPFD concept to tackling the OOS tracks’ fusion problem, and show its potential to be implemented in the real tracking system. While to the best of our knowledge, the above reviewed methodologies all assume an ideal tracking environments and neglect the track management problem in the presence of clutter measurement and target misdetection.

Inspired by enriching the existing work on the multiple BO asynchronous sensors tracking in realistic environments, this paper simultaneously considers the clutter measurement disturbance, target misdetection and the OOS information update problem in the multiple BO sensors tracking system. Within the framework of distributed fusion architecture, the proposed approach consists of a single sensor local tracking and the central fusion. After receiving sets of raw measurements, the local sensor carried out the local pseudo tracking using the proposed local integrated probabilistic data association (LIPDA) method, which tracks the measurement state rather than the target kinematic state (since target kinematic state is unobservable by a single BO sensor). Such a design enables eliminating most of the false tracks via the track management using the recursively computed PTE, resulting in tangibly reduced communication bandwidth and computation complexity, furthermore, the accuracy of target measurement can also be further improved. In the fusion center, we propose to use the distributed integrated probabilistic data association-forward prediction fusion and decorrelation (DIPDA-FPFD) method to sequentially update the current time-filtered track kinematic state using the OOS pseudo track information. Unlike the retrodiction-based methods that need to account for the complicated retrodiction noise, the proposed DIPDA-FPFD algorithm efficiently rules out the dependency between the central track hybrid state updated using OOS information and currently filtered central track hybrid state by employing a straightforward decorrelation technique in the information space. The track management procedure is also carried out in the fusion center to further exclude false tracks and also output target true tracks.

The rest of the paper is organized as follows: the problem statement is described in Section 2, and Section 3 gives an overview of the IPDA algorithm, the proposed multiple asynchronous BO sensors tracking methodology is detailed in Section 4, followed by the implementation considerations of the proposed methods in Section 5. Section 6 demonstrates the experiment validation, followed by a conclusion in Section 7.

2. Problem Statement

This paper considers target tracking in challenging environments with imperfect target detection in a two dimensional (2D) surveillance space by using multiple asynchronous BO sensors. To focus on the main tracking challenges, the targets being tracked are assumed to be point targets, and the BO sensors used here are assumed to be with infinite sensor resolution, i.e., the resolutions of deployed BO sensors are small enough to distinguish from different objects in the angle measurement space, and each received angle measurement has only one source, either from target of interest or clutter. The necessary system models are mathematically formulated in this section.

2.1. Target Model

The target randomly appears and disappears in the surveillance space, consequently, its existence is a random event and modeled by a binary random variable. Denoting the target existence at time tk by χk, which evolves as a first order Markov Chain in the time domain, and the probability that the target exists at time tk conditioned on it existed at time tk1 is mathematically described by [11]

p11=Pχk|χk11ΔTk,k1Tave, (1)

where ΔTk,k1 is the time interval of two consecutive scans, Tave denotes the average target existence duration and usually Tave>>Tk,k1. In this paper, that the possibility of target birth was treated by the random track initialization procedure, thus the probability that target exists at time tk given that it did not exist at time tk1 is assumed to be zero, i.e.,

p12=Pχk|χ¯k1=0. (2)

Once the target exists in the surveillance area, one needs to estimate its kinematic state. For the sake of simplicity and clarity, the dynamic model of the target of interest is assumed to be linear and described by

xk=Fk,k1xk1+wk, (3)

where the target kinematic state consists of 2D position xkp and velocity xkv, i.e., xk=(xkp)T (xkv)TT, and wk is the process noise, which is modeled by the additive white Gaussian noise, with zero mean and covariance Qk,k1,

Qk,k1=qTk,k133Tk,k122Tk,k122Tk,k1I2, (4)

where q denotes the power spectral density, ⊗ is the Kronecker product, I2 is the 2D identity matrix. Fk,k1 denotes the dynamic state transition matrix from time tk1 to tk, and given as

Fk,k1=1ΔTk,k101I2. (5)

The hybrid target state (χk,xk) modeled the above attempts to fully describe the statistics about the target behavior, wherein, the probability of target existence χk is used as an efficient track quality measure for track management, the kinematic state xk is only defined conditioning on the target existence χk.

2.2. Sensor Model

At each time k, sensor s receives a random set of measurements Zks with set cardinal number Mks, denoting the ith measurement of Zks by Zk,is. The measurement origin is unknown, because it may originate from the targets of interest or clutter. Denoting the set of received measurements up to and including time tk by Zk,s. Both the target measurement model and clutter measurement model are defined below.

2.2.1. Target Measurement

At time tk, each sensor returns a single measurement yk for each target of interest with a detection probability PD. A BO sensor can only measure the angle information of its line-of-sight in a 2D surveillance area, i.e., yk=θk, thus, the target measurement equation is a nonlinear function of the target and sensor kinematic state and given by

yk=hxk,sk+vk=tan1ykyksxkxks+vk, (6)

where sk=(skp)T (skv)TT=xks yks x˙ks y˙ksT denotes the kinematic state of sensor s at time tk, with  T denoting the transpose, vk is the sensor noise usually described as additive white Gaussian distribution, with zero mean and known covariance Rk.

2.2.2. Clutter Measurement

In practice, in addition to measurements originated from targets of interest, at time tk, the sensor also returns a set of clutter measurements. The number of clutter measurements at each time tk is random and usually follows a Poisson distribution, the intensity of each clutter measurement Zk,is in the surveillance is termed as clutter measurement density and denoted by ρ(Zk,is), which is usually assumed to be known but can also be estimated [30].

3. Overview of Automatic Target Tracking in Challenging Environments

The integrated probabilistic data association (IPDA) algorithm was validated and proved to be an effective approach for automatic target tracking in the presence of clutter disturbance and target misdetection. Since the proposed methodology composes of two parts: the local pseudo tracking and the central fusion, both of which need to deal with the problems of clutter measurement disturbance and target misdetection, the existing IPDA algorithm reviewed in this section is deployed as the cornerstone of the proposed algorithms introduced in Section 4. As a result, the content presented in this section is a prerequisite for introducing the algorithms developed in Section 4.

In the IPDA, the hybrid state (χk1,xk1) at time tk1 is mathematically described by a posterior probability density function (pdf) p(χk1,xk1|Zk1), consisting of the probability of target existence P(χk1|Zk1) and the posterior pdf of the target kinematic state p(xk1|χk1,Zk1) at time tk1, i.e.,

p(χk1,xk1|Zk1)=p(xk1|χk1,Zk1)P(χk1|Zk1), (7)

with

p(xk1|χk1,Zk1)N(xk1;x^k1|k1,Pk1|k1), (8)

where N(xk1;x^k1|k1,Pk1|k1) denotes the Gaussian distribution with mean x^k1|k1 and its error covariance Pk1|k1.

The IPDA recursively updates the posterior pdf of hybrid state from time tk1 to time tk based on system models defined in Section 2 and sensor measurements received at time tk. For simplicity, in the rest of the paper, the pdf of target kinematic state is implicitly conditioned on the target existence, i.e., p(xk1|χk1,Zk1)p(xk1|Zk1). One IPDA tracking cycle usually consists of track hybrid state prediction, gating and likelihood, data association, track hybrid state update, and is introduced in detail in the rest of this section.

3.1. Track Hybrid State Prediction

The predicted track hybrid state at time tk1 is denoted by p(χk,xk|Zk1) and can be decomposed into two parts,

pχk,xk|Zk1=pxk|Zk1Pχk|Zk1, (9)

where the predicted probability of target existence is obtained by

Pχk|Zk1=p11Pχk1|Zk1, (10)

and the predicted target kinematic state pdf is

pxk|Zk1=Nxk;x^k|k1,Pk|k1, (11)

where Nxk;x^k|k1,Pk|k1 denotes the predicted Gaussian with mean x^k|k1 and corresponding covariance Pk|k1, calculated by

x^k|k1=Fk,k1x^k1|k1, (12)
Pk|k1=Fk,k1Pk1|k1Fk,k1T+Qk,k1. (13)

3.2. Gating and Likelihood

To save computation and storage resources, the elliptical gating technique is used to select a set of measurements for track update.

Zk,ihx^k|k1TSk1Zk,ihx^k|k1g, (14)

with g is the gating threshold.

Sk=HkPk|k1HkT+Rk, (15)

where the measurement Jacobian matrix is given by

Hk=hxkxk/xk=x^k|k1. (16)

After gating procedure, a subset zk of sensor received measurements Zk at time tk is validated, with zk=zk,ii=1mk. The likelihood of the selected measurement zk,i is thus calculated by

pk,ipzk,i|Zk1=Nzk,i;hx^k|k1,SkPG, (17)

where PG denotes the gating probability, Nzk,i;hx^k|k1,Sk is the Gaussian distribution of zk,i with mean hx^k|k1 and covariance Sk.

3.3. Data Association

Since the measurement origin is uncertain, one needs to evaluate all possibilities of validated measurement’ origins, the association probability that each measurement zk,i originates from target by

βk,i=1δkPDPGpk,iρk,i,i>01PDPG,i=0, (18)

where PD is the target detection probability, ρk,i is the clutter measurement density of zk,i. i=0 denotes that none of the validated measurements zk originated from the target, with the likelihood ratio defined by

δk=1PDPG+PDPGi=1mkpk,iρk,i. (19)

3.4. Track Hybrid State Estimation

The updated track hybrid state is composed of two parts,

pχk,xk|Zk=pxk|ZkPχk|Zk, (20)

where the updated probability of target existence is calculated by

Pχk|Zk=δkPχk|Zk111δkPχk|Zk1, (21)

and the updated kinematic state pdf is still represented by a single Gaussian,

pxk|ZkNxk;x^k|k,Pk|k, (22)

where Nxk;x^k|k,Pk|k is the updated Gaussian of xk with mean x^k|k and covariance Pk|k, which is a Gaussian mixture of all the kinematic states updated using validated measurements zk, i.e.,

x^k|k,Pk|k=Gmixx^k|k,i,Pk|k,i,βk,ii=0mk, (23)

with Gmix denotes the standard Gaussian mixture operation, βk,i is the data association probability obtained in Equation (18), x^k|k,i and Pk|k,i are calculated as

x^k|k,i,Pk|k,i=KFUx^k|k1,Pk|k1,zk,i,Sk,Hk. (24)

where KFU denotes the standard update procedure of the Kalman filter, the predicted mean x^k|k1 and covariance Pk|k1 are given in Equations (12) and (13), the innovation covariance Sk and measurement Jacobian matrix Hk calculated in Equations (15) and (16). The recursively updated probability of target existence serves as a track quality measure used for track management, including timely recognizing true tracks then robustly maintaining them, and also quickly identifying false tracks not following any targets of interest thereafter deleting them from the memory.

4. Distributed Target Tracking in Challenging Environments Using Multiple Asynchronous BO Sensors

4.1. Framework of Proposed Methodology

A novel distributed fusion architecture for target tracking in challenging environments using multiple asynchronous BO sensors is proposed in this section. As can be seen from Figure 1, the framework of the proposed methodology consists of two steps: (1) firstly, a local IPDA (LIPDA) algorithm for local tracking in the presence of clutter measurement disturbance and target misdetection is used for each BO sensor. This is done to not only eliminate most of the clutter measurements which intensively reduces communication bandwidth between the local sensor and fusion center, but also tangibly refine target information; (2) secondly, the fusion center operates the proposed distributed IPDA-forward prediction fusion and decorrelation (DIPDA-FPFD) method for central fusion with OOS information aimed at obtaining maximum tracking performance improvement. Please note that the OOS information used for central fusion are actually sets of refined bearing measurements, which are transmitted by local BO sensors after implementing the LIPDA.

Figure 1.

Figure 1

Framework of the proposed methodology.

A more specific illustration on the proposed distributed tracking approach (taking two BO sensors as an example) is presented here. As shown in Figure 1, sensor 1 and 2 deploy the LIPDA for pseudo tracking using individually received raw measurements at time tτ and tη, respectively, and output two sets of refined bearing measurements Z^τ1 and Z^η2, which arrive in the fusion center at current time tτ and are regarded as OOS information due to tτ<tη<tk. The filtered central track hybrid state pdf p(xk,χk|Z^k) (obtained by filtering sets of refined bearing measurements gathered from all local BO sensors up to and including time tk, i.e., Z^k), is then sequentially updated via the proposed DIPDA-FPFD algorithm using the OOS information Z^τ1 and Z^η2, respectively, resulting in an improved central track hybrid state estimation pdf p(xk,χk|Z^k,Z^τ1,Z^η2).

4.2. Local IPDA (LIPDA)

Since a single BO sensor can only measure the bearing information of the line-of-sight (LOS) from the sensor to the target, the target’s kinematic state usually becomes unobservable (the case that sensor outmaneuvers the target to achieve the observability is not considered here), and the target measurement is nonlinear with respect to the target kinematic state. Instead of tracking the target kinematic state, the target measurement state is tracked in each local BO sensor using the proposed LIPDA algorithm, consequently, the measurement state can be completely (or partly) observed. The measurement tracking in the local sensors is called the pseudo tracking in this paper to differentiate from the conventional kinematic track tracking. Denoting the local pseudo track state (also termed as measurement state) at time tk by B=[θk θ˙k]T, where θk and θ˙k denote the bearing and bearing rate (the first derivative of bearing with respect to time), respectively. The measurement state propagation is modeled as

Bk=F˜k,k1Bk1+w˜k, (25)

where F˜k,k1 is the measurement state propagation matrix from time tk1 to tk and given by

F˜k,k1=1ΔTk,k101, (26)

w˜k is the measurement state process noise used to partially compensate the linearized propagation model error, and is approximated as the projection of the target kinematic state process noise described in Equation (3) [30],

w˜kBkxk,skxkwk, (27)

which is assumed to be a Gaussian with zero mean and covariance calculated by

Q˜k,k1xk,sk=Bkxk,skxkQk,k1Bkxk,skxkT. (28)

As can be seen above, Q˜k,k1 is a function of xk and sk. In this BO sensor system, xk cannot be uniquely determined given Bk, sk and Qk,k1. Consequently, a reasonable way to obtain Q˜k,k1 is to find the biggest trace of Q˜k,k1(xk,sk) subject to the constraint that the local measurement state equals Bk [30], i.e.,

Q˜k,k1=maxxk:Bkxk, sk=BktrQ˜k,k1xk,sk. (29)

The Jacobian of local measurement state Bk(xk,sk) with respect to xk is

Bkxk,skxk=θkxkpθkxkvθ˙kxkpθ˙kxkv. (30)

Maximizing the trace of Q˜k,k1(xk,sk) is equivalent to maximize the sum of main diagonal elements of Q˜k,k1(xk,sk), subject to the local measurement state at time tk equals to Bk. As can be seen from Equation (28), the value of each main diagonal element in Q˜k,k1(xk,sk) is dominated by the main diagonal elements of Qk,k1, thus, maximizing the trace of Q˜k,k1(xk,sk) is equivalent to maximize the coefficient vectors of the main diagonal elements of Qk,k1, i.e., maximizing vectors θkxkp and θ˙kxkv.

After mathematical transformation and simplification (see detailed derivation in the Appendix A), each elements of the Jacobian matrix above is calculated by

θkxkp=ixTcosθkixTrminsinθk, (31)
θkxkv=01×2, (32)
θ˙kxkp=2+3cosθkcos3θkrmin2sin3θvmaxtixT+vmaxsisTθk0,π3cos3θk+4cos2θk3cosθk2rmin2sin3θkvmaxtixT+vmaxsisTθkπ,2π, (33)
θ˙kxkv=ixTcosθkixTrminsinθk, (34)

where ix is the unit vector of the X-axis of the sonar s local Cartesian coordinate (XsOsYs defined in Section 6.2), is is the unit vector of the sonar s position vector in the global Cartesian coordinate (XOY defined in Section 6.2), 01×2 denotes the zero matrix with dimension 1×2, rmin is the minimum sonar detection range, vmaxt and vmaxs denote the maximum velocity of target and sonar, respectively.

Since the local BO sensor can only measure the bearing measurement, the local measurement equation is a linear function of the local measurement state,

θk=H˜kBk+vk, (35)

where vk is the additive white Gaussian noise with zero mean and covariance Rk, and H˜k=1 0 is the measurement matrix.

In each local sensor, a pseudo track hybrid state (χk,Bk) is recursively estimated by deploying the LIPDA algorithm, wherein, the main body of the LIPDA method is the same as the IPDA algorithm reviewed in Section 3, except that the local tracking models need to be specified by Equations (25) and (35). After completing the tracking loop, one is able to obtain the posterior pdf of pseudo track hybrid state as

pχk,Bk=pBk|ZkPχk|Zk, (36)

with the local measurement state assumed to be a single Gaussian,

pBk|Zk=NBk;B^k|k,Γk|k, (37)

where NBk;B^k|k,Γk|k is the updated Gaussian of local measurement state Bk, with mean B^k|k and corresponding covariance Γk|k.

The recursively updated probability of target existence Pχk|Zk is used as a pseudo track quality measure to operate the local pseudo track management aimed at excluding most of the existing false pseudo tracks which do not follow any target of interest. The probability of target existence is also used to confirm and maintain all the true pseudo track following targets. For details about the track management procedure, please refer to Section 5. Only the confirmed pseudo tracks are communicated to the fusion center for central fusion. Here, instead of the full local measurement state, only the bearing estimation and its corresponded error covariance are transmitted so as to further release the communication burden. As a result, after local pseudo tracking, each sensor transfers a set of refined bearing measurements to the fusion center, i.e., Z^ks=θk,is,σk,isi, with θk,is and σk,is denoting the ith refined bearing measurement and its error covariance of sensor s, respectively.

Remark 1.

In the fusion center, central tracks are initialized and then updated using refined bearing measurements transmitted from multiple local BO sensors. When a central track is sequentially updated by refined bearing measurements transmitted from different local BO sensors, the correlation between this central track (defined in the Cartesian kinematic state space) and the refined bearing measurements (defined in the angle state space) lies in two aspects: (1) due to the scan to scan dependence of refined bearing measurements from the same local pseudo track, the central track is correlated with the refined bearing measurements transmitted from the same BO sensor that contributes to initialize this central track, this correlation is additionally exacerbated by the recursive update of this central track scan to scan; (2) as can be seen in Equation (27), the process noise of the local pseudo state at different BO sensors is derived from the common Cartesian kinematic state process noise. Refined bearing measurements across different BO sensors are correlated, consequently, the central track is correlated with the refined bearing measurements transmitted from other BO sensors.

The exact correlation model is thus complex (interested readers please refer to [31]), and any solution which uses the exact correlation model to improve the tracking performance is likely to be very complicated and of limited value. To keep the simplicity of the proposed algorithms, this correlation is completely ignored in this paper.

4.3. Distributed IPDA-Forward Prediction Fusion and Decorrelation (DIPDA-FPFD) Technique

The main idea of the proposed DIPDA-FPFD methodology lies in the facts that it partially rules out the dependency in information between the central track hybrid state updated by OOS data and currently filtered central track hybrid state by employing a straightforward decorrelation procedure in the information space. The decorrelated track hybrid state estimation purely contributed by the OOS information is then fused with the filtered central track hybrid state to achieve an improved estimate. As demonstrated in Figure 2, the proposed DIPDA-FPFD algorithm composes of four steps: (1) forward predict the stored posterior hybrid state of central track c obtained at time tb to the current time tk to obtain p(xkc,χkc|Z^b); (2) forward predict the stored posterior hybrid state of central track c obtained at time tb to the OOS time tτ (tb is one step prior to tτ) to obtain p(xτc,χτc|Z^b), which is then updated using OOS information Z^τs transmitted by sensor s with time stamp tτ, and the obtained posterior hybrid state p(xτc,χτc|Z^b,Z^τs) is forward predicted to current time tk to get the p(xkc,χkc|Z^b,Z^τs); (3) decorrelate the obtained p(xkc,χkc|Z^b) and p(xkc,χkc|Z^b,Z^τs) in the information space in order to eliminate the common information accumulated till current time tk. This is done to get the information purely contributed by OOS information Z^τs, i.e., p(xkc,χkc|Z^τs);4) fuse the current-time filtered hybrid state p(xkc,χkc|Z^k) and p(xkc,χkc|Z^τs) in the information space to obtain the eventual posterior hybrid state pdf p(xkc,χkc|Z^k,Z^τs).

Figure 2.

Figure 2

Flowchart of the proposed DIPDA-FPFD.

The aim of the proposed DIPDA-FPFD algorithm is to update the current-time filtered central track hybrid state pdf p(xkc,χkc|Z^k) using the OOS information Z^τs so as to achieve an improved posterior hybrid state estimation p(xkc,χkc|Z^k,Z^τs). Each of the four parts of the proposed DIPDA-FPFD is presented in detail in the rest of this section.

4.3.1. Forward Predict Hybrid State without OOS Information from Time tb to tk

The forward predicted hybrid state pdf without OOS information is mathematically described by

pxkc,χkc|Z^b=Pχkc|Z^bpxkc|Z^b, (38)

where P(χkc|Z^b) denotes the forward predicted probability of target existence and is calculated by

Pχkc|Z^b=p11inttktbΔTk,k1Pχbc|Z^b, (39)

with int(a) denotes the integer part of a, P(χbc|Zb) denotes the posterior probability of target existence at time tb. The forward predicted kinematic state pdf p(xkc|Z^b) is represented by a Gaussian, i.e.,

pxkc|Z^b=Nxkc;x¯k|bc.P¯k|bc, (40)

where its mean and estimated error covariance are obtained by

x¯k|bc=Fk,bx^b|bc, (41)
P¯k|bc=Fk,bPb|bcFk,bT+Qk,b, (42)

where x^b|bc and Pb|bc are the mean and its estimation covariance of posterior kinematic state pdf of central track at time tb, state propagation matrix Fk,b and process noise Qk,b are defined in Equations (5) and (4), respectively.

4.3.2. Forward Predict Hybrid State with OOS Information from Time tτ to tk

Firstly predict the previously stored central track hybrid state p(xbc,χbc|Z^b) at time tb to tτ so as to obtain the predicted hybrid state p(xτc,χτc|Z^b). It is then followed by implementing the IPDA-EKF algorithm (reviewed in Section 3) to obtained the updated posterior hybrid state pdf using the OOS information set Z^τs at time tτ, resulted in p(xτc,χτc|Z^b,Z^τs), which consists of

pχτc,xτc|Z^b,Z^τs=Pχτc|Z^b,Z^τspxτc|Z^b,Z^τs, (43)

with the posterior kinematic state pdf represented by a single Gaussian,

pxτc|Z^b,Z^τs=Nxτc;x^τ|b,τc,Pτ|b,τc, (44)

The forward predicted central track hybrid state pdf is

pχkc,xkc|Z^b,Z^τs=Pχkc|Z^b,Z^τspxkc|Z^b,Z^τs, (45)

with the probability of target existence at time tτ predicted by

Pχkc|Z^b,Z^τs=p11inttktτΔTk,k1+1Pχτc|Z^b,Z^τs, (46)

and the predicted kinematic state pdf at time tk represented by a single Gaussian

pxkc|χkc,Z^b,Z^τs=Nxkc;x¯k|b,τc,P¯k|b,τc, (47)

with its mean and error covariance given by

x¯k|b,τc=Fk,τx^τ|b,τc, (48)
P¯k|b,τc=Fk,τPτ|b,τcFk,τT+Qk,τ. (49)

4.3.3. Decorrelate OOS Information Updated Hybrid State

To rule out the common information between the current-time filtered hybrid state and the OOS information updated hybrid state, p(xkc,χkc|Z^b,Z^τs) is de-correlated by directly subtracting the duplicated information contained in p(xkc,χkc|Z^b), and one obtains the central track hybrid state solely updated by OOS information Z^τs at time tk, i.e.,

pχkc,xkc|Z^τs=Pχkc|Z^τspxkc|Z^τs, (50)

where

Pχkc|Z^τs=Pχkc|Z^b,Z^τsPχkc|Z^b, (51)

its kinematic state pdf is represented by a single Gaussian, i.e., p(xkc|χkc,Z^τs)=N(xkc;x^k|τc,Pk|τc), which is calculated in the information space,

Pk|τc1=P¯k|b,τc1P¯k|bc1, (52)
Pk|τc1x^k|τc=P¯k|b,τc1x¯k|b,τcP¯k|bc1x¯k|bc. (53)

4.3.4. Fuse the Current-Time Filtered Hybrid State Using OOS Information

The eventually fused central track hybrid state pdf contains the updated probability of target existence and the fused kinematic states pdf, i.e.,

pχkc,xkc|Z^k,Z^τs=Pχkc|Z^k,Z^τspxkc|Z^k,Z^τs, (54)

where the fused probability of target existence is calculated by

Pχkc|Z^k,Z^τs=Pχkc|Z^k+Pχkc|Z^τsPχkc|Z^kPχkc|Z^τs, (55)

and its fused kinematic state pdf is still represented by a single Gaussian p(xkc|Z^k,Z^τs)=N(xkc;x^k|k,τc,Pk|k,τc), which is obtained by fusion in the information space,

Pk|k,τc1=P^k|kc1+Pk|τc1, (56)
Pk|k,τc1x^k|k,τc=P^k|kc1x^k|kc+Pk|τc1x^k|τc. (57)

If there are OOS information from other sensors arrived at time tk, the procedures in this subsection are repeated one sensor by one sensor. After updated with all the OOS information at time tk, the fused hybrid states are renominated as pχkc,xkc|Z^k,Z^τs for next central track hybrid state fusion.

5. Implementation

5.1. Pseudo Track/Track Management

As far as track management is concerned, there is no difference in management for pseudo tracks in local sensor and tracks at the fusion center. Therefore, pseudo tracks and tracks will be termed as tracks in this subsection. Both true tracks following the targets of interest and false tracks not following any targets of interest are initiated and they survive in the subsequent recursions. As a consequence, an efficient track management technique is critically important, which is able to quickly confirm true tracks and maintain them in the sequel, and also to recognize false tracks as many as possible and then delete them from the memory. We use the recursively updated probability of target existence as a track quality measure to implement the real time track management.

Each initialized track is given a tentative status, once its recursively calculated probability of target existence exceeds a predefined confirmation threshold τc, this track is upgraded to a confirmed status which indicates it is following the target of interest and thus maintained to be confirmed. A confirmed true track may become false alarm and terminated if its probability of target existence falls below a predefined termination threshold τt, this may happen if the confirmed track is misled into following any clutter or target of non-interest. Additionally, a tentative track may also directly become a false track in a few scans after initialization. Once a track is declaimed to be a false track, it is deleted from memory.

5.2. Storage Consideration

When fusing the current-time filtered hybrid state using OOS information, the proposed DIPDA-FPFD algorithm needs to store the previously filtered hybrid state estimation of central tracks. The stored necessity information includes:

  • ti where i=b,b+1,,k1,k, which requires kb+1 scalars indicating the time stamp for which the central track is updated, with OOS information arrives at the fusion center between tb and tb+1.

  • (x^i|ic)i=bi=k, requires m(kb+1) scalars that indicates the mean of the filtered kinematic state of central track c from time tkb to tk, with m denotes the dimension of the kinematic state.

  • (P^i|ic)i=bi=k, requires (kb+1)m(m+1)/2 scalars that indicates the error covariance of the filtered kinematic state estimation of central track c from time tkb to tk.

It is obvious that the tracking system requires to store tremendous information as the OOS lag increases. While in the real application the storage memory is usually limited, thus the maximum OOS lag (kb)max is predefined to enable to store previously filtered central track hybrid state information in a sliding time window.

6. Simulation Validation

We consider a 2D maritime target tracking scenario in challenging environments using three asynchronous BO sensors. As depicted in Figure 3, the target starts at position (20, 30) km and moves from the west to east with a nearly constant velocity 26 m/s, Three sonars are statically deployed at the positions (48, 15) km, (52.5, 15) km, (57, 15) km, with each surveillance range rmax=32 km. The sonar received BO measurement is corrupted by a Gaussian noise with zero mean and variance R=(2o)2, and the number of clutter measurements returned by each sonar at each scan follows a Poisson distribution with mean m¯c and these clutter measurements are uniformly distributed between the bearing range of 0 to 2π, thus the clutter measurement density satisfies ρ=m¯c/(2π). The detection probability PD of each sensor is assumed to be equal. The sampling interval of each sonar is same and equals to T=1 s, among the three sonars, the third sonar s3 is designed to be asynchronous compared to the other two sonars, and transmits its local information to the fusion center with a random time delay l. As can be seen from Figure 3, the target firstly appears at the surveillance area of sonar s1, then enters the surveillance area of sonar s2 and s3 successively, after collectively observed by three sonars for some time, the target moves out of the surveillance area of sonar s1 at first, then out of sonar s2 surveillance area, and finally disappears at the surveillance area of sonar s3. The experiment repeats for 100 Monte Carlo runs, with 2500 s for each run duration.

Figure 3.

Figure 3

The target trajectory and surveillance areas of BO sonars.

To fully investigate the proposed methods, two experiments in the cases of different mean number of clutter measurements m¯c, target detection probability PD, and OOS lag l are conducted in this section, i.e., (1) case 1: m¯c=10, PD=0.8, l=1,3,10; (2) case 2: m¯c=60, PD=0.6, l=1,3,10; (3) case 3: m¯c=60, PD=0.4, l=1,3,10. Compared to case 1, cases 2 and 3 are more challenging with lower target detection probability and higher clutter measurement density, among the three cases, case 3 simulates the lowest target detection probability.

6.1. Local Tracking Results

In the local tracking, the measurement state is tracked so as to eliminate most of the clutter disturbances and also to improve the accuracy of the target information. Consequently, the numerical statistics results of local pseudo tracking are demonstrated below in tables. Please note that only the local tracking results of sensor s2 are explicitly shown here, the results of other two sensors are quite similar to that of sensor s2 and thus omitted.

As shown in Table 1, Table 2 and Table 3, the local tracking in sonar s2 at case 1, 2, and 3 both initiates hundreds of thousands of tentative pseudo tracks whose total number over the entire experiment time increases exponentially, while, by using the efficient pseudo track management technique embedded in the proposed LIPDA, the total number of pseudo tracks eventually transmitted to the fusion center was reduced by 70%∼80% in case 1, by 30%∼80% in case 2, and by 12%∼40% in case 3, which greatly release the communication burden from the local sonar to fusion center, and also decrease the computation complexity in the fusion center.

Table 1.

Total number of initialized and transmitted pseudo tracks in sonar s2 at case 1.

Scan Index 500 1000 1500 2000 2500
# of initialized
pseudo tracks
207,144 409,344 611,521 814,362 1,020,037
# of transmitted
pseudo tracks
25,297 81,277 138,342 188,992 214,774
Reduced rate (%) 87.79 80.14 77.38 76.79 78.94

Table 2.

Total number of initialized and transmitted pseudo tracks in sonar s2 at case 2.

Scan Index 500 1000 1500 2000 2500
# of initialized
pseudo tracks
70,258 130,507 187,483 238,134 293,029
# of transmitted
pseudo tracks
14,935 63,964 112,198 160,006 187,107
midrule Reduced rate (%) 78.75 50.99 40.16 32.81 36.15

Table 3.

Total number of initialized and transmitted pseudo tracks in sonar s2 at case 3.

Scan Index 500 1000 1500 2000 2500
# of initialized
pseudo tracks
18,621 48,633 78,536 103,614 119,274
# of transmitted
pseudo tracks
16,229 33,495 47,700 61,795 75,722
Reduced rate (%) 12.84 31.13 39.26 40.36 36.51

The root mean square errors (RMSEs) of the estimated target bearing by the local tracking and directly observed by the sonar s2 in cases 1, 2, and 3 are demonstrated in Figure 4, Figure 5 and Figure 6, respectively. As can be clearly seen, after operating the local pseudo tracking with proposed LIPDA, the accuracy of the target bearing measurement was substantially improved, i.e., the bearing bias is reduced by around 1.4° in case 1, by about 0.3°1.1° in case 2, and by near 0.1°1.0° in case 3. As can be seen from Figure 6, the proposed LIPDA method gives oscillating target bearing estimates in case 3, and shows trivial improvement over the raw observation at some instances. This is because the target detection probability in case 3 is too low for the proposed local tracking algorithm to always guarantee consistent and substantial pseudo tracking benefits.

Figure 4.

Figure 4

RMSE of estimated target bearing and the raw bearing observed by sonar s2 at case 1.

Figure 5.

Figure 5

RMSE of estimated target bearing and the raw bearing observed by sonar s2 at case 2.

Figure 6.

Figure 6

RMSE of estimated target bearing and the raw bearing observed by sonar s2 at case 3.

6.2. Central Tracking Results

In the fusion center, the refined bearing measurements transmitted by each sonar are sequentially fused using the proposed DIPDA-FPFD algorithm, among them, the information transferred by sonar s3 arrives in the fusion center with out of sequence. For fair comparison, the reprocessing method in [14] is enhanced by incorporating the distributed IPDA algorithm (termed as DIPDA-Re) for dealing with the problem of target misdetection and clutter disturbance. The DIPDA-Re serves as the upper performance benchmark since it delivers the best fusion performance via reprocessing the OOSMs in a chronological order. Please note that the DIPDA-Re method is not a realistic online multisensor OOSMs fusion algorithm because it needs to store all local pseudo tracks information from last fusion time till to next OOSMs coming, the fusion operation can be tremendously delayed and it also requires huge storage memory. Besides, the straightforward discarded approach proposed in [13] is also enhanced by enabling its track management capability in the presence of clutter and target misdetection and termed as DIPDA-D, which is implemented as the low benchmark.

To fairly evaluate the track management performance among the three central fusion methods, the parameters of each method (including initial probability of target existence, confirmation threshold and termination threshold) are tuned to deliver similar number of confirmed false tracks (CFTs), then their averaged numbers of confirmed true tracks (CTTs) are compared. The averaged number of CTTs of each central fusion method in case 1 is shown in Figure 7, with each method delivering 1 CFT during the entire experiment time. At the beginning, it takes hundreds of seconds for each method to fully initiate all CTTs, the upper benchmark-DIPDA-Re gives the most averaged number of CTTs, followed by our proposed DIPDA-FPFD method with 1, 3, 10 lag, the averaged number of CTTs decreases as the OOS lag increases, indicating that our proposed method is a suboptimal solution, the low benchmark gives the least number of CTTs. At the end of the experiment, the DIPDA-D loses the target rapidly while the other methods still robustly maintain all the CTTs. The reason is that the target is out of the field of views (FOVs) of sonar s1 and s2, and only observed by the asynchronous sonar s3, the DIPDA-D directly discards all the OOS information transmitted by sonar s3, the PTEs of central tracks cannot be updated using new information thus rapidly reduce below the track termination threshold.

Figure 7.

Figure 7

Averaged number of CTTs of DIPDA-D, DIPDA-Re, DIPDA-FPFD with different lags (case 1).

The range and velocity estimation RMSEs in case 1 are presented in Figure 8 and Figure 9. As can be seen, both the range and velocity estimation errors drastically reduce once the target enters the common FOV of sonar s1 and s2 which make the target kinematic state observable, and then converge to steady values. Among the three fusion methods, the DIPDA-D method delivers the biggest position and velocity estimation errors, because it directly discards valuable target information, the DIPDA-Re method gives the best tracking accuracy in both position and velocity estimation due to its reprocessing implementation on the OOS information, followed by our proposed DIPDA-FPFD method with 1, 3, 10 lag, the 10 lag case delivers slightly increased position and velocity estimation errors because of intensively increased OOS lag, but its performance is still comparable to the upper benchmark method.

Figure 8.

Figure 8

RMSE of estimated target range of DIPDA-D, DIPDA-Re, DIPDA-FPFD with different lags (case 1).

Figure 9.

Figure 9

RMSE of estimated target velocity of DIPDA-D, DIPDA-Re, DIPDA-FPFD with different lags (case 1).

To verify the robustness of the proposed methods, another two much more challenging experiments are conducted. To give fair comparisons, the track management parameters of each method are tuned to deliver 3 and 7 CFTs for case 2 and case 3, respectively. As shown in Figure 10, it takes longer time for each central fusion method in cases 2 to fully initiate averaged number of CTTs compared to that in case 1, this is because case 2 is set to be with lower target detection probability and much worse clutter disturbance. The estimated target range and velocity RMSEs of case 2 are shown in Figure 11 and Figure 12, respectively. Besides, Figure 13 demonstrates the averaged number of CTTs of each compared method in case 3, which shows slower CTT initiating speed and fewer CTTs than that in case 2, due to further reduced target detection probability. The estimated target range and velocity RMSEs of case 3 are present in Figure 14 and Figure 15, respectively. Both cases 2 and 3 show deteriorated tracking accuracy compared to that of case 1 due to reduced target detection probability and increased clutter measurement disturbance. However, in terms of both track management and tracking accuracy, our proposed DIPDA-FPFD method with 1, 3, 10 lag still delivers comparable tracking results as the optimal benchmark DIPDA-Re approach, and intensively outperforms the DIPDA-D method.

Figure 10.

Figure 10

Averaged number of CTTs of DIPDA-D, DIPDA-Re, DIPDA-FPFD with different lags (case 2).

Figure 11.

Figure 11

RMSE of estimated target range of DIPDA-D, DIPDA-Re, DIPDA-FPFD with different lags (case 2).

Figure 12.

Figure 12

RMSE of estimated target velocity of DIPDA-D, DIPDA-Re, DIPDA-FPFD with different lags (case 2).

Figure 13.

Figure 13

Averaged number of CTTs of DIPDA-D, DIPDA-Re, DIPDA-FPFD with different lags (case 3).

Figure 14.

Figure 14

RMSE of estimated target range of DIPDA-D, DIPDA-Re, DIPDA-FPFD with different lags (case 3).

Figure 15.

Figure 15

RMSE of estimated target velocity of DIPDA-D, DIPDA-Re, DIPDA-FPFD with different lags (case 3).

Aside from tracking performance, the computational complexity and storage requirement of each method in case 2 are also compared in Table 4 and Table 5. All algorithms are implemented in MATLAB 2017b on system with Intel(R) Core(TM) i7-4700MQ, 2.40 GHz processor, 8GB memory and Windows 10 platform. The computational complexity of each algorithm is evaluated by its averaged elapsed time per scan. The storage requirement of each algorithm at every scan is evaluated using the number of scalars necessarily stored in the fusion center for tracking purpose. As shown in Table 4, the averaged elapsed time of the proposed DIPDA-FPFD with respect to different OOS lags are about 37 milliseconds, much less than that of the DIPDA-Re method which requires around 1040 milliseconds per scan to process the data, with the DIPDA-D method consuming the least computation time. Furthermore, in contrast to the 1000 milliseconds’ sonar sampling interval, it can be found that the proposed DIPDA-FPFD is capable of being implemented in real time while the DIPDA-Re gives delayed tracking results, and more output delay can be expected as the OOS lag increases. This is because the DIPDA-Re method needs to reprocess all the local sonars’ transmitted information to be in a chronological sequence, which consumes tremendous computation resource. As can be seen from Table 5, among the three compared algorithms, the DIPDA-Re requires the most storage memory when fusing the locally transmitted asynchronous information, followed by the proposed DIPDA-FPFD and the DIPDA-D. This is due to the fact that the DIPDA-Re needs to store all local pseudo tracks information from last fusion time till to next OOSMs coming, while the proposed DIPDA-FPFD only needs to store the state information of central tracks, whose number is much less compared to that of the local pseudo tracks. The DIPDA-D method consumes the least storage resource due to its straightforwardly discarding the OOSMs.

Table 4.

Computational complexity of each compared method (take case 2 for example).

DIPDA-FPFD DIPDA-D DIPDA-Re
1 Lag 3 Lag 10 Lag / 1 Lag 3 Lag 10 Lag
Sonar’s sampling
interval (ms)
1000
Averaged elapsed
time per scan (ms)
37.03 37.04 37.07 36.81 1037.42 1038.22 1041.02
Real time or delayed
implementation
real time real time delayed

Table 5.

Storage requirement of each compared method at different scans (take case 2 for example, lmax=10), storage requirement is evaluated by the stored number of scalars.

Scan Index 400 1300 2100
Method
DIPDA-FPFD 28,182 24,948 25,872
DIPDA-Re 117,214 113,118 11,554
DIPDA-D 3782 3472 3596

As a conclusion, the proposed method is able to deliver comparative tracking performance as the optimal DIPDA-Re method, while requiring much less computation and storage resources, as well as being able to be implemented in real time. Meanwhile, our proposed method gives much improved tracking performance over the low benchmark DIPDA-D method.

7. Conclusions

This paper proposes a novel approach for target tracking using multiple asynchronous BO sensors in the presence of clutter measurement disturbance and target misdetection. The proposed LIPDA algorithm for local measurement tracking eliminates most of false alarms and greatly improves the accuracy of the target bearing measurements. Additionally, in the fusion center, the proposed DIPDA-FPFD algorithm enables fusing the OOS information efficiently and also to operate the track management which confirms and maintains true tracks, recognizes false tracks and then deleting them from memory. The proposed methods can be directly applied in the realistic tracking applications, such as maritime surveillance, environment monitoring and autonomous driving, to name a few.

The proposed approach is able to deal with slightly maneuvering target tracking, but may deteriorate in the case of classical target maneuvering situation. This is because of the accumulated linearized errors of local measurement state model in the local tracking, and the unique motion model assumption used in the central tracking. Extending the proposed methods to deal with the classical target maneuvering problem is non-trivial but not straightforward. When incorporating the target maneuvering problem into the proposed framework, one should simultaneously consider the maneuvering impact in both the local and central tracking. A possible direction can be deriving a more complicated but accurate measurement state evolving model for the local pseudo track tracking, and deploying the interactive multiple models (IMM) or variable structure interactive multiple models (VSIMM) methods for the central tracking. Another future work will be extending the proposed methods to track multiple closely spaced targets.

Acknowledgments

This work was supported in part by the National Natural Science Foundation of China under grant 61901151, and the Zhejiang Provincial Natural Science Foundation with grant number LQ19F010009 and LZ20F010002, and the National Defense Science and Technology Key Laboratory Fundation with grant number 6142804180407, this work was also supported in part by Hanwha Systems, Republic of Korea, under the grant U-17-015.

Nomenclature

The fundamental notations and acronyms used in this paper are properly defined in this section.

A. Acronyms
BO Bearing-only
OOSM Out-of-sequence measurement
IPDA Integrated probabilistic data association
IPDA-EKF Integrated probabilistic data association-extended Kalman filter
LIPDA Local integrated probabilistic data association
DIPDA-FPFD Distributed integrated probabilistic data association-forward prediction fusion and decorrelation
SPRT Sequential probability ratio test
PTE Probability of target existence
LOS Line-of-sight
RMSE Root mean square error
DIPDA-Re Distributed integrated probabilistic data association-reprocessing
DIPDA-D Distributed integrated probabilistic data association-discarding
CFT Confirmed false track
CTT Confirmed true track
Gmix Gaussian mixture
pdf Probability density function
B. Notations
p11 The probability that target exists at time k given that it existed at time k1
ΔTk,k1 The time interval of two consecutive scans
Tave The averaged target existence duration
χk The event of target existence at time tk
xk The target kinematic state at time tk, with position component xkp and velocity component xkv
Bk The pseudo track state at time tk
Fk,k1 The kinematic state transition matrix from time tk1 to tk
F˜k,k1 The measurement state transition matrix from time tk1 to tk
wk The process noise of target dynamic model, with zero mean and covariance Qk,k1
w˜k The process noise of measurement state model, with zero mean and covariance Q˜k,k1
Zks The set of measurements received by sensor s at time tk with cardinality Mks
Zk,is The ith measurement of Zks
Zk,s The set of sensor s received measurements up to and including time tk
Zk The set of measurements collected by all sensors up to and including time tk
zk The set of selected measurements at time tk, with cardinality mk
zk,i The ith measurement of zk
Z^ks The set of refined bearing measurements of sensor s at time tk
Z^k The set of refined bearing measurements collected by all sensors up to and including time tk
PD Target detection probability
sk The sensor kinematic state at time tk, with position component skp and velocity component skv
vk The sensor noise with zero mean and covariance Rk
N(x;x^,P) The Gaussian distribution of variable x with mean x^ and its error covariance P
(x^k1|k1,Pk1|k1) Mean and covariance of posterior kinematic state estimate at time tk1
(x^k|k1,Pk|k1) Mean and covariance of predicted kinematic state estimate at time tk
pk,i The likelihood of measurement zk,i
PG The probability that target measure falls into the validation gate
ρk,i The clutter measurement density of zk,i
βk,i The association probability that each measurement zk,i originates from the target
(x^k|k,i,Pk|k,i) Mean and covariance of kinematic state updated using zk,i at time tk
(B^k|k,Γk|k) Mean and covariance of posterior local measurement state estimate at time tk
ix The unit vector of the X-axis of the sonar s local Cartesian coordinate
is The unit vector of the sonar s position vector in the global Cartesian coordinate
(vmaxt,vmaxs) The maximum velocity of target and sonar s, respectively
(x¯k|bc,P¯k|bc) Mean and covariance of predicted kinematic state of central track c from tb to tk
(x^τ|b,τc,Pτ|b,τc) Mean and covariance of track c kinematic state updated by Z^τs at time tτ
(x¯k|b,τc,P¯k|b,τc) Mean and covariance of track c predicted kinematic state from time tτ to tk
(x^k|τc,Pk|τc) Mean and covariance of track c kinematic state purely updated by Z^τs at time tk
(x^k|k,τc,Pk|k,τc) Mean and covariance of fused track c kinematic state at time tk

Appendix A

The geometry of the target and BO sensor in the 2D Cartesian coordinate system is depicted in Figure A1.

Figure A1.

Figure A1

Geometry between the target and BO sensor.

The Jacobian of local measurement state B(xk,sk) with respect to xk is obtained as

Bkxk,skxk=θkxkpθkxkvθ˙kxkpθ˙kxkv. (A1)

As can be seen from Figure A1, the relative position vector between the target and sonar satisfies rst=xkpskp, with rs and rt denoting the position vector of the sonar and target in the global Cartesian coordinate (XOY), respectively, and ix is the unit vector of the X-axis of the local sonar Cartesian coordinate (XsOsYs). The BO measurement at time k is defined by

θk=cos1ixTrstixTrstcos1ixTrst. (A2)

The bearing rate θ˙k is obtained by

θ˙k=θt=11cos2θtixTist=1sinθixTtist+ixTistt, (A3)

where

ixTt=01×2, (A4)

and

istt=rstrstt=rsttrstrstrsttrst2, (A5)

with rstt and rstt calculated respectively by

rstt=xkpskpt=xkvskv, (A6)
rstt=trstTrst=121rstrstTtrst+rstTrstt=12rstxkvskvTrst+rstTxkvskv =12rstrstTxkvskv+rstTxkvskv=istTxkvskv. (A7)

Substituting Equations (A6) and (A7) into (A5), one gets

istt=xkvskvrstrstistTxkvskvrst2=rstxkvskvistTxkvskvrstrst2. (A8)

Applying Equations (A4) and (A8) to (A3), one has

θ˙k=1sinθixTrstxkvskvistTxkvskvrstrst2 =1sinθrstixTxkvskvixTistTxkvskvrstrst2 =istTxkvskvixTrstrstixTxkvskvsinθrst2 =istTxkvskvixTistixTxkvskvsinθrst =istTxkvskvcosθixTxkvskvsinθrst. (A9)

Based on the expression of Equations (A2) and (A9), one needs to work out each partitioned matrix in the Jacobian of local measurement state defined at (A1).

θkxkp=xkpcos1ixTist=11cos2θkxkpixTist=1sinθkixTxkpist+ixTistxkp, (A10)

where

ixTxkp=01×2, (A11)

and

istxkp=rstrstxkp=rstxkprstrstrstxkprst2. (A12)

To figure out Equation (A12), one needs to firstly calculate the rstxkp and rstxkp, given below,

rstxkp=xkpskpxkp=xkpxkpskpxkp=I202=I2, (A13)
rstxkp=xkprstTrst=121rstTrstrstTxkprst+rstTrstxkp=121rstrstTrstxkp+rstTrstxkp =121rstrstTI2+rstTI2=12rst2rstT=istT. (A14)

Substituting Equations (A13) and (A14) into (A12), one gets the finalized expression,

istxkp=I2rstrstistTrst2=I2ististTrst. (A15)

Finally, applying Equations (A11) and (A15) to (A10), one obtains

θkxkp=1sinθixTI2ististTrst=ixTististTixTrstsinθk=istTcosθkixTrstsinθk. (A16)

Since the bearing measurement is only the function of the target-sonar relative position, thus, one has

θkxkv=01×2, (A17)

and

θ˙kxkv=xkvistTxkvskvcosθixTxkvskvsinθrst=istTcosθkixTrstsinθk, (A18)

with

θ˙kxkp=xkpistTxkvskvcosθkixTxkvskvsinθkrst=xkpistTxkvskvcosθkixTxkvskvsinθkrstsinθkrst2istTxkvskvcosθkixTxkvskvxkpsinθkrstsinθkrst2. (A19)

After complicated mathematical transformation and simplification, the above item is eventually obtained by

θ˙kxkp=xkvskvTcosθksin2θk+ixTxkvskvistT+2istTxkvskvcos3θk3istTxkvskvcosθkistT+istTxkvskvixTxkvskvcosθkixTrst2sin3θkθk0,πxkvskvTcosθksin2θk+ixTxkvskvcos2θkistTistTxkvskvcosθkcos2θkistT+istTxkvskvcos2θkixTxkvskvcosθkixTrst2sin3θkθkπ,2π. (A20)

Maximizing the Jacobian matrix defined in Equation (A1) is equivalent to maximizing the trace of the same Jacobian matrix, then one needs to maximize the coefficient vectors of the main diagonal elements of Qk,k1, i.e., simultaneously maximize θkxkp and θ˙kxkv by adjusting the target kinematic state in the global Cartesian coordinate under the constraint that the target measurement state equals to [θk θ˙k]T. One has

θkxkp=θ˙kxkv=istTcosθkixTrstsinθk. (A21)

As can be seen from Figure A1, when the target lies at the opposite side of the X-axis of the local sonar Cartesian coordinate, i.e., ist=ix, the nominator istTcosθkixT gains the maximum vector norm, besides, when the target-sonar distance equals the minimum sonar detection range, i.e., rst=rmin, the denominator rstsinθk gets the minimized value. As a result, when the target satisfies ist=ix and rst=rmin, θkxkp and θ˙kxkv simultaneously achieves the maximized value, and equals

θkxkp=θ˙kxkv=ixTcosθkixTrminsinθk. (A22)

And also, substituting ist=ix and rst=rmin into Equation (A20), one can get

θ˙kxkp=2+3cosθkcos3θkrmin2sin3θvmaxtixT+vmaxsisTθk0,π3cos3θk+4cos2θk3cosθk2rmin2sin3θkvmaxtixT+vmaxsisTθkπ,2π. (A23)

where vmaxt and vmaxs denote the maximum velocity of target and sonar, respectively.

Author Contributions

Conceptualization, Y.S. and I.U.; Formal analysis, J.W.C. and H.J.K.; Methodology, Y.S. and I.U.; Validation, L.X. and U.K.; Writing—original draft, Y.S. All authors have read and agreed to the published version of the manuscript.

Conflicts of Interest

The authors declare no conflict of interest.

References

  • 1.Hall D., Chong C.Y., Linas J., Liggins M. Distributed Data Fusion for Network-Centric Operations. CRC Press, Inc.; Boca Raton, FL, USA: 2012. [Google Scholar]
  • 2.Hou J., Yang Y., Gao T. Variational Bayesian Based Adaptive Shifted Rayleigh Filter for Bearings-Only Tracking in Clutters. Sensors. 2019;19:1512. doi: 10.3390/s19071512. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Dias S.S., Bruno M.S. Cooperative target tracking using decentralized particle filtering and RSS sensors. IEEE Trans. Signal Process. 2013;61:5–18. doi: 10.1109/TSP.2013.2262276. [DOI] [Google Scholar]
  • 4.Challa S., Morelande M.R., Mušicki D., Evans R.J. Fundamentals of Object Tracking. Cambridge University Press; New York, NY, USA: 2011. [Google Scholar]
  • 5.Koch W. Tracking and Sensor Data Fusion: Methodological Framework and Selected Applications. Springer; Berlin, Germany: 2014. [Google Scholar]
  • 6.Liu M., Huai T., Zheng R., Zhang S. Multisensor Multi-Target Tracking Based on GM-PHD Using Out-Of-Sequence Measurements. Sensors. 2019;19:4315. doi: 10.3390/s19194315. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Bar-Shalom Y., Li X.R. Multitarget-Multisensor Tracking: Principles, Techniques and Software. YBS Publishing; Storrs, CT, USA: 1995. [Google Scholar]
  • 8.Reid D.B. An algorithm for tracking multiple targets. IEEE Trans. Autom. Control. 1979;24:843–854. doi: 10.1109/TAC.1979.1102177. [DOI] [Google Scholar]
  • 9.Blackman S.S. Multiple hypothesis tracking for multiple target tracking. IEEE Aerosp. Electron. Syst. Mag. 2004;19:5–18. doi: 10.1109/MAES.2004.1263228. [DOI] [Google Scholar]
  • 10.Colegrove B.S., Pardini S. PDAF with multiple clutter regions and target models. IEEE Trans. Aerosp. Electron. Syst. 2003;39:110–124. doi: 10.1109/TAES.2003.1188897. [DOI] [Google Scholar]
  • 11.Mušicki D., Evans R., Stankovic S. Integrated probabilistic data association. IEEE Trans. Autom. Control. 1994;39:1237–1241. doi: 10.1109/9.293185. [DOI] [Google Scholar]
  • 12.Mušicki D., Evans R. Joint integrated probabilistic data association: JIPDA. IEEE Trans. Aerosp. Electron. Syst. 2004;40:1093–1099. doi: 10.1109/TAES.2004.1337482. [DOI] [Google Scholar]
  • 13.Ji R., Liang Y., Xu L.F., Zhang W.Y. Concave Optimization-Based Approach for Joint Multi-Target Track Initialization. IEEE Access. 2019;2019:108551–108560. doi: 10.1109/ACCESS.2019.2933650. [DOI] [Google Scholar]
  • 14.Mušicki D., Evans R., La Scala B.F. Integrated track splitting filter-efficient multi-scan single target tracking in clutter. IEEE Trans. Aerosp. Electron. Syst. 2007;43:1409–1425. [Google Scholar]
  • 15.Zaitouny A., Stemler T., Algar S. Optimal Shadowing Filter for a Positioning and Tracking Methodology with Limited Information. Sensors. 2019;19:931. doi: 10.3390/s19040931. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Zaitouny A., Stemler T., Judd K. Tracking Rigid Bodies Using Only Position Data: A Shadowing Filter Approach Based on Newtonian Dynamics. Digit. Signal Process. 2017;67:81–90. doi: 10.1016/j.dsp.2017.04.004. [DOI] [Google Scholar]
  • 17.Zaitouny A., Stemler T., Small M. Tracking a single pigeon using a shadowing filter algorithm. Ecol. Evol. 2017;7:4419–4431. doi: 10.1002/ece3.2976. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Zaitouny A., Stemler T., Small M. Modelling and tracking the flight dynamics of flocking pigeons based on real GPS data (small flock) Ecol. Model. 2017;344:62–72. doi: 10.1016/j.ecolmodel.2016.11.010. [DOI] [Google Scholar]
  • 19.Karl B., Ander R., Karl-Eric A. Rao-blackwellized particle filter with out-of-sequence measurement processing. IEEE Trans. Signal Process. 2014;62:6454–6467. [Google Scholar]
  • 20.Blackman S.S., Popoli R. Design and Analysis of Modern Tracking Systems. Artech House; Fitchburg, MA, USA: 1999. [Google Scholar]
  • 21.Hilton R.D., Martin D.A., Blair W.D. Tracking with Time-Delayed Data in Multisensor Systems. Naval Surface Warfare Center; Dahlgren, VA, USA: 1993. NSWCDD/TR-93/351. [Google Scholar]
  • 22.Zhang K., Li X.R., Zhu Y. Optimal update with out-of-sequence measurements for distributed filtering; Proceedings of the Fifth International Conference on Information Fusion; Annapolis, MD, USA. 8–11 July 2002; pp. 8–11. [Google Scholar]
  • 23.Bar-Shalom Y. Update with out-of-sequence measurements in tracking: Exact solution. IEEE Trans. Aerosp. Electron. Syst. 2002;38:769–777. doi: 10.1109/TAES.2002.1039398. [DOI] [Google Scholar]
  • 24.Nettleton E.W., Durrant-Whyte H. Delayed and asequent data in decentralized sensing networks; Proceedings of the Intelligent Systems and Advanced Manufacturing; Boston, MA, USA. 28–31 October 2001. [Google Scholar]
  • 25.Challa S., Evans R.J., Wang X. A Bayesian solution and its approximations to out-of-sequence measurement problem. J. Inf. Fusion. 2003;4:185–199. doi: 10.1016/S1566-2535(03)00037-X. [DOI] [Google Scholar]
  • 26.Bar-Shalom Y., Mallick M., Chen H. One-step solution for the general out-of-sequence measurement problem in tracking. IEEE Trans. Aerosp. Electron. Syst. 2004;40:27–37. doi: 10.1109/TAES.2004.1292140. [DOI] [Google Scholar]
  • 27.Ullah I., Qureshi M., Khan U., Memon S., Shi Y.F., Peng D.L. Multisensor-based target-tracking algorithm with out-of-sequence-measurements in cluttered environment. Sensors. 2018;18:4043. doi: 10.3390/s18114043. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Françoi R., Benaskeur A.R. Forward prediction-based approach to target-tracking with Out-of-Sequence Measurements; Proceedings of the 47th IEEE Conference on Decision and Control; Cancun, Mexico. 9–11 December 2008; pp. 1326–1333. [Google Scholar]
  • 29.Duraisamy B., Schwarz T. Track to Track Fusion Incorporating Out of Sequence Track Based on Information Matrix Fusion; Proceedings of the IEEE International Conference on Intelligent Transportation Systems; Las Palmas, Spain. 15–18 September 2015; pp. 2651–2658. [Google Scholar]
  • 30.Song T.L., Kim T.H., Mušicki D. Distributed (nonlinear) target tracking in clutter. IEEE Trans. Aerosp. Electron. Syst. 2015;51:654–668. doi: 10.1109/TAES.2014.130151. [DOI] [Google Scholar]
  • 31.Yang K., Bar-Shalom Y., Willett P. Track-to-track fusion with cross-covariances from Radar and IR/EO Sensor; Proceedings of the 22th International Conference on Information Fusion; Ottawa, ON, Canada. 2–5 July 2019; pp. 1–5. [Google Scholar]

Articles from Sensors (Basel, Switzerland) are provided here courtesy of Multidisciplinary Digital Publishing Institute (MDPI)

RESOURCES