This paper was converted on www.awesomepapers.org from LaTeX by an anonymous user.
Want to know more? Visit the Converter page.

A Directed Spanning Tree Adaptive Control Framework for Time-Varying Formations thanks: The revised version of this work has been accepted by IEEE Transactions on Control of Network Systems, doi: 10.1109/TCNS.2021.3050332.

Dongdong Yue,  Simone Baldi,  Jinde Cao, 
Qi Li,  and Bart De Schutter
D. Yue and Q. Li are with School of Automation, and Key Laboratory of Measurement and Control of CSE, Ministry of Education, Southeast University, Nanjing, China (e-mail: yueseu@gmail.com; liq@jstd.gov.cn).S. Baldi is with School of Mathematics, Southeast University, Nanjing, China and with Delft Center for Systems and Control, Delft University of Technology, Delft, The Netherlands (e-mail: S.Baldi@tudelft.nl).J. Cao is with School of Mathematics, and Jiangsu Provincial Key Laboratory of Networked Collective Intelligence, Southeast University, Nanjing, China (e-mail: jdcao@seu.edu.cn).B. De Schutter is with Delft Center for Systems and Control, Delft University of Technology, Delft, The Netherlands (e-mail: B.DeSchutter@tudelft.nl).
Abstract

In this paper, the time-varying formation and time-varying formation tracking problems are solved for linear multi-agent systems over digraphs without the knowledge of the eigenvalues of the Laplacian matrix associated to the digraph. The solution to these problems relies on a framework that generalizes the directed spanning tree adaptive method, which was originally limited to consensus problems. Necessary and sufficient conditions for the existence of solutions to the formation problems are derived. Asymptotic convergence of the formation errors is proved via graph theory and Lyapunov analysis.

Index Terms:
Adaptive control, directed graphs, multi-agent systems, formation control.

I Introduction

Formation control of multi-agent systems has captured increasing attention due to applications in spacecraft formation flying, search and rescue operations, intelligent transport system, to name a few [1, 2]. By designing appropriate feasibility conditions, results on time-varying formation (TVF) [3, 4, 5], and time-varying formation tracking (TVFT) [6, 7, 8] have extended the time-invariant formation case. These designs rely on consensus-based methodologies [9, 10, 11, 12] to accomplish the formation in a distributed way (i.e. using local information only). However, a common notable problem in such methods is the required knowledge of the smallest nonzero eigenvalue of the communication Laplacian matrix, which might be unknown in large networks.

It is known that by suitably designing time-varying coupling weights in the network, the knowledge of the Laplacian eigenvalues can be overcome: this was shown for consensus [13, 14, 15], containment [16], or TVF [17, 18, 19] problems over undirected or detail-balanced/strongly-connected digraphs. For more general digraphs, the analysis is challenging due to the complexity of the Laplacian. To address this complexity, a distributed adaptive control method has recently been studied for synchronization/consensus problems in [20, 21, 22]: this method exploits the presence of a directed spanning tree (DST) in the network. However, a unifying DST-based adaptive control framework encompassing TVF and TVFT problems is not available. Most notably, it is unclear how to design appropriate feasibility conditions for time-varying formations in the DST framework. These observations motivate this study.

The main contribution of this paper is a unifying DST-based adaptive control framework addressing TVF and TVFT: not only does the proposed framework still avoid the knowledge of the Laplacian eigenvalues, but it also help to establish necessary and sufficient conditions for such time-varying formations from a different perspective. For TVF without leaders, a novel class of feasibility conditions is proposed, which is more efficient to check than the feasibility conditions in the state of the art. The proposed conditions generalize in a natural unified way in the presence of one or more leaders.

The paper is organized as follows: Section II gives some preliminaries and formulates the problems. Sections III-IV present the main results for TVF and TVFT, respectively. Numerical examples are provided in Section V. Section VI concludes this paper.

II Preliminaries and Problem Statement

II-A Notations

Let \mathbb{R}, +\mathbb{R}^{+}, n\mathbb{R}^{n}, n×p\mathbb{R}^{n\times p} represent the sets of real scalars, real positive scalars, nn-dimensional column vectors, n×pn\times p matrices, respectively. Let In\textbf{I}_{n} and 1n\textbf{1}_{n} be the n×nn\times n identity matrix, and the column vector with nn elements being one, respectively. Zero vectors and zero matrices are all denoted by 0. For a vector xx, let x\|x\| denote the Euclidean norm. For a real symmetric matrix AA, λM(A)\lambda_{\text{M}}(A) (resp. λm(A)\lambda_{\text{m}}(A)) is its maximum (resp. minimum) eigenvalue, and A>0A>0 (resp. A0A\geq 0) means that AA is positive definite (resp. semi-definite). Denote N={1,2,,N}\mathcal{I}_{N}=\{1,2,\cdots,N\} as the set of natural numbers up to NN. Denote col(x1,,xN)=(x1T,,xNT)T\text{col}(x_{1},\cdots,x_{N})=({x_{1}}^{T},\cdots,{x_{N}}^{T})^{T} as the column vectorization. The abbreviation diag()\text{diag}(\cdot) is the diagonalization operator and ’N-S’ is short for ’necessary and sufficient’. The cardinality of a set is denoted by |||\cdot| and the difference (resp. union) of the sets 𝒮1\mathcal{S}_{1} and 𝒮2\mathcal{S}_{2} is denoted by 𝒮1𝒮2\mathcal{S}_{1}\setminus\mathcal{S}_{2} (resp. 𝒮1𝒮2\mathcal{S}_{1}\bigcup\mathcal{S}_{2}). Moreover, \otimes stands for the Kronecker product.

II-B Graph Theory

A weighted digraph 𝒢(𝒱,,𝒜)\mathcal{G}(\mathcal{V},\mathcal{E},\mathcal{A}) is specified by the node set 𝒱={1,,N}\mathcal{V}=\{1,\cdots,N\}, the edge set ={eij|ij,ij}\mathcal{E}=\{e_{ij}|i\rightarrow j,i\neq j\} and the weighted adjacency matrix 𝒜=(aij)N×N\mathcal{A}=(a_{ij})\in\mathbb{R}^{N\times N}. In the matrix 𝒜\mathcal{A}, aij>0a_{ij}>0 if ejie_{ji}\in\mathcal{E}, indicating that jj (resp. ii) is an in-neighbor (resp. out-neighbor) of ii (resp. jj), which can be denoted by j𝒩1(i)j\in\mathcal{N}_{1}(i) (resp. i𝒩2(j)i\in\mathcal{N}_{2}(j)). Let 𝒟2(i)=|𝒩2(i)|\mathcal{D}_{2}(i)=|\mathcal{N}_{2}(i)| be the out-degree of ii. Moreover, =(ij)N×N\mathcal{L}=(\mathcal{L}_{ij})\in\mathbb{R}^{N\times N} is the Laplacian matrix of 𝒢\mathcal{G}, which is defined as: ij=aij\mathcal{L}_{ij}=-a_{ij}, if iji\neq j, and ii=k=1,kiNaik\mathcal{L}_{ii}=\sum_{k=1,k\neq i}^{N}a_{ik}, iN\forall i\in\mathcal{I}_{N}. A path of 𝒢\mathcal{G} from node 11 to ss corresponds to an ordered sequence of edges (e1,p1,ep1,p2,,eps,s)(e_{1,p_{1}},e_{p_{1},p_{2}},\cdots,e_{p_{s},s}). A digraph 𝒢\mathcal{G} is weakly-connected if every pair of nodes are connected by a path disregarding the directions. A directed spanning tree (DST) of 𝒢\mathcal{G} is a subgraph where there is a node called the root, that has no in-neighbors, such that one can find a path from the root to every other node. In a DST, if jj is an in-neighbor of ii, one can also say that jj is a parent node, and ii is a child node. Moreover, a node is called a stem if it has at least one child, and a leaf otherwise.

II-C Problem Statement

Let 𝒢(𝒱,,𝒜)\mathcal{G}(\mathcal{V},\mathcal{E},\mathcal{A}) denote the digraph that characterizes the communication topology among NN agents, where the weights in 𝒜\mathcal{A} represent the communication strengths. The dynamics of the agents are given by

x˙i=Axi+Bui,iN\displaystyle\dot{x}_{i}=Ax_{i}+Bu_{i},\quad i\in\mathcal{I}_{N} (1)

where xinx_{i}\in\mathbb{R}^{n} is the state of agent ii and uimu_{i}\in\mathbb{R}^{m} is its control input to be designed. Let the pair (A,B)(A,B) be stabilizable.

Definition 1 (TVF)

The multi-agent system (1) is said to achieve the time-varying formation (TVF) defined by the time-varying vector h(t)=col(h1(t),h2(t),,hN(t))h(t)=\text{col}(h_{1}(t),h_{2}(t),\cdots,h_{N}(t)) if, for any initial states, there holds

limt((xihi)(xjhj))\displaystyle\lim_{t\rightarrow\infty}((x_{i}-h_{i})-(x_{j}-h_{j})) =0,i,jN.\displaystyle=0,\ \forall i,j\in\mathcal{I}_{N}. (2)

Now consider the case where there are MM leader agents, M1M\geq 1, in the network 𝒢\mathcal{G}. Without loss of generality, let the first MM agents be the leaders, and the rest be the followers:

x˙l=Axl,lM,\displaystyle\dot{x}_{l}=Ax_{l},\quad\quad\quad\quad l\in\mathcal{I}_{M},
x˙i=Axi+Bui,iNM.\displaystyle\dot{x}_{i}=Ax_{i}+Bu_{i},\quad i\in\mathcal{I}_{N}\setminus\mathcal{I}_{M}. (3)

As leaders have no in-neighbors, the Laplacian matrix of 𝒢\mathcal{G} can be partitioned as

=(0012)\mathcal{L}=\left(\begin{array}[]{cc}0&0\\ \mathcal{L}_{1}&\mathcal{L}_{2}\end{array}\right) (4)

where 1(NM)×M\mathcal{L}_{1}\in\mathbb{R}^{(N-M)\times M} and 2(NM)×(NM)\mathcal{L}_{2}\in\mathbb{R}^{(N-M)\times(N-M)}.

Definition 2 ([7])

A follower is called well-informed if all leaders are its in-neighbors, and is uninformed if no leader is its in-neighbor.

Definition 3 (TVFT)

The multi-agent system (II-C) is said to achieve the time-varying formation tracking (TVFT) defined by the time-varying vector hF(t)=h^{F}(t)= col(hM+1(t),hM+2(t),,hN(t))\text{col}(h_{M+1}(t),h_{M+2}(t),\cdots,h_{N}(t)) and by positive constants βl\beta_{l}, lMl\in\mathcal{I}_{M}, satisfying l=1Mβl=1\sum_{l=1}^{M}\beta_{l}=1 if, for any initial states, there holds

limt(xihil=1Mβlxl)=0,iNM.\displaystyle\lim_{t\rightarrow\infty}\big{(}x_{i}-h_{i}-\sum_{l=1}^{M}\beta_{l}x_{l}\big{)}=0,\ \forall i\in\mathcal{I}_{N}\setminus\mathcal{I}_{M}. (5)

For the special case M=1M=1, (5) becomes

limt(xihix1)=0,i=2,,N.\displaystyle\lim_{t\rightarrow\infty}\big{(}x_{i}-h_{i}-x_{1}\big{)}=0,\quad i=2,\cdots,N. (6)

The goal of this paper is to solve the problems outlined by (2), (5) and (6) without the knowledge of the Laplacian eigenvalues, by consistently generalizing the DST idea.

III DST-Based Distributed Adaptive TVF

This section appropriately extends the DST-based adaptive control method to solve the TVF problem of Definition 1. The following is a standard connectivity assumption ([3, 5], etc).

Assumption 1

The digraph 𝒢\mathcal{G} has at least one DST.

Under Assumption 1, one can select a DST 𝒢¯(𝒱,¯,𝒜¯)\bar{\mathcal{G}}(\mathcal{V},\bar{\mathcal{E}},\bar{\mathcal{A}}) of 𝒢\mathcal{G}. Note that finding a DST can also be conducted in a distributed manner, but it requires the agents to exchange more information. As in [21], we assume that 𝒢¯\bar{\mathcal{G}} is known. Without loss of generality, let node 11 be the root of the 𝒢¯\bar{\mathcal{G}}. Correspondingly, let ¯\bar{\mathcal{L}} be the Laplacian matrix of 𝒢¯\bar{\mathcal{G}} and 𝒩¯2(i)\bar{\mathcal{N}}_{\text{2}}(i) be the set of out-neighbors of ii in 𝒢¯\bar{\mathcal{G}}.

Let iki_{k} denote the unique parent of node k+1k+1 in 𝒢¯\bar{\mathcal{G}} for kN1k\in\mathcal{I}_{N-1}, then ¯={eik,k+1|kN1}\bar{\mathcal{E}}=\{e_{i_{k},k+1}|k\in\mathcal{I}_{N-1}\}\subset\mathcal{E}. For compactness, define di(t)=xi(t)hi(t)d_{i}(t)=x_{i}(t)-h_{i}(t) as the formation state, i.e., the distance between the current state and the desired formation offset of agent ii. Denote x=col(x1,,xN)x=\text{col}(x_{1},\cdots,x_{N}), d=col(d1,,dN)d=\text{col}(d_{1},\cdots,d_{N}).

We propose the DST-based adaptive TVF controller as:

ui=K0xi+K1di+K2j𝒩1(i)αij(t)(didj)\displaystyle u_{i}=K_{0}x_{i}+K_{1}d_{i}+K_{2}\sum_{j\in\mathcal{N}_{1}(i)}\alpha_{ij}(t)(d_{i}-d_{j}) (7)

with the time-varying coupling weights

αij(t)={aij,ifeji¯,a¯k+1,ik(t),ifeji¯.\displaystyle\alpha_{ij}(t)=\left\{\begin{array}[]{ll}a_{ij},&\text{if}\quad e_{ji}\in\mathcal{E}\setminus\bar{\mathcal{E}},\\ \bar{a}_{k+1,i_{k}}(t),&\text{if}\quad e_{ji}\in\bar{\mathcal{E}}.\end{array}\right. (10)
a¯˙k+1,ik=ρk+1,ik((dikdk+1)\displaystyle\dot{\bar{a}}_{k+1,i_{k}}=\rho_{k+1,i_{k}}\Big{(}(d_{i_{k}}-d_{k+1})-
j𝒩¯2(k+1)(dk+1dj))TΓ(dikdk+1).\displaystyle\quad\qquad\qquad\sum\limits_{j\in\bar{\mathcal{N}}_{2}(k+1)}(d_{k+1}-d_{j})\Big{)}^{T}\Gamma(d_{i_{k}}-d_{k+1}). (11)

In (7)-(III), K0K_{0}, K1K_{1}, K2K_{2}, and Γ\Gamma are gains to be designed, and ρk+1,ik+\rho_{k+1,i_{k}}\in\mathbb{R}^{+}. In (7), αij(t)\alpha_{ij}(t) is the coupling weight between agent ii and its in-neighbor jj, which is time-varying only if the corresponding edge appears in 𝒢¯\bar{\mathcal{G}}, i.e., j=ikj=i_{k} and i=k+1i=k+1 for some kN1k\in\mathcal{I}_{N-1}, and constant otherwise.

Remark 1

The structure of controller (7) is as follows. The gain K0K_{0} is to be designed to make the time-varying formation h()h(\cdot) feasible; the gain K1K_{1} is needed to control the average formation signal dave=1NjNdjd_{\text{ave}}=\frac{1}{N}\sum_{j\in\mathcal{I}_{N}}d_{j}; the gain K2K_{2} is a consensus gain. Different from the related literature [3, 5], the DST structure is explicitly used in the control law (7)-(III).

III-A Technical lemmas

Lemma 1 (N-S condition for TVF)

Under Assumption 1, and for any DST 𝒢¯\bar{\mathcal{G}}, define Ξ(N1)×N\Xi\in\mathbb{R}^{(N-1)\times N} as

Ξkj={1,ifj=k+1,1,ifj=ik,0,otherwise.\displaystyle\Xi_{kj}=\left\{\begin{array}[]{ll}-1,&\text{if}\quad j=k+1,\\ 1,&\text{if}\quad j=i_{k},\\ 0,&\text{otherwise}.\end{array}\right. (15)

Then, the TVF for multi-agent system (1) can be achieved if and only if

limt(ΞIn)d(t)=0.\displaystyle\lim_{t\rightarrow\infty}\|(\Xi\otimes\textbf{I}_{n})d(t)\|=0. (16)
Proof:

From Lemma 3.2 in [21], (16) holds if and only if limtdi(t)dj(t)=0,i,jN\lim_{t\rightarrow\infty}\|d_{i}(t)-d_{j}(t)\|=0,\forall i,j\in\mathcal{I}_{N}. Then, Lemma 1 holds following Definition 1 and the definition of di(t)d_{i}(t). In fact, ΞT\Xi^{T} is the incidence matrix associated to 𝒢¯\bar{\mathcal{G}}. ∎

Lemma 2 (Auxiliary matrix QQ)

Under Assumption 1, and for any DST 𝒢¯\bar{\mathcal{G}}, define Q(N1)×(N1)Q\in\mathbb{R}^{(N-1)\times(N-1)} as Q=Q~+Q¯Q=\tilde{Q}+\bar{Q} with Q~kj=c𝒱¯j+1(~k+1,c~ik,c)\tilde{Q}_{kj}=\sum_{c\in\bar{\mathcal{V}}_{j+1}}(\tilde{\mathcal{L}}_{k+1,c}-\tilde{\mathcal{L}}_{i_{k},c}) and Q¯kj=c𝒱¯j+1(¯k+1,c¯ik,c).\bar{Q}_{kj}=\sum_{c\in\bar{\mathcal{V}}_{j+1}}(\bar{\mathcal{L}}_{k+1,c}-\bar{\mathcal{L}}_{i_{k},c}). Here, 𝒱¯j+1\bar{\mathcal{V}}_{j+1} represents the vertex set of the subtree rooting at node j+1j+1 and ~=¯\tilde{\mathcal{L}}=\mathcal{L}-\bar{\mathcal{L}}. Then, there holds

Ξ=QΞ\displaystyle\Xi\mathcal{L}=Q\Xi (17)

where Ξ\Xi is defined in (15). Moreover, Q¯\bar{Q} can be explicitly written as

Q¯kj={a¯j+1,ij,ifj=k,a¯j+1,ij,ifj=ik1,0,otherwise.\displaystyle\bar{Q}_{kj}=\left\{\begin{array}[]{ll}\bar{a}_{j+1,i_{j}},&\text{if}\quad j=k,\\ -\bar{a}_{j+1,i_{j}},&\text{if}\quad j=i_{k}-1,\\ 0,&\text{otherwise}.\end{array}\right. (21)
Proof:

See the appendix. The proof revises and completes the results in [21], [22], since step 1) of the proof (=JΞ\mathcal{L}=\mathcal{L}J\Xi) is missing there. ∎

Remark 2

Lemma 2 states that the information of the Laplacian \mathcal{L} can be transferred into a reduced-order matrix QQ through a commutative-like multiplication law (17). For the off-diagonal elements of Q¯\bar{Q}, Q¯kj=Q¯jj\bar{Q}_{kj}=-\bar{Q}_{jj} if and only if j+1j+1 is the parent of k+1k+1 in 𝒢¯\bar{\mathcal{G}}.

Lemma 3 (Feasibility conditions)

Under Assumption 1, let us consider controller (7) with time-varying coupling weights (10) for any DST 𝒢¯\bar{\mathcal{G}}. Suppose that the origin of the linear time-varying system

d˙L=(IN1(A+BK0+BK1)+Q(t)BK2)dL\displaystyle\dot{d}_{L}=(\textbf{I}_{N-1}\otimes(A+BK_{0}+BK_{1})+Q(t)\otimes BK_{2})d_{L}

is globally asymptotically stable, where Q(t)=Q~+Q¯(t)Q(t)=\tilde{Q}+\bar{Q}(t) with fixed Q~\tilde{Q} defined as in Lemma 2, and

Q¯kj(t)={a¯j+1,ij(t),ifj=k,a¯j+1,ij(t),ifj=ik1,0,otherwise.\displaystyle\bar{Q}_{kj}(t)=\left\{\begin{array}[]{ll}\bar{a}_{j+1,i_{j}}(t),&\text{if}\quad j=k,\\ -\bar{a}_{j+1,i_{j}}(t),&\text{if}\quad j=i_{k}-1,\\ 0,&\text{otherwise}.\end{array}\right. (26)

Then, the TVF problem can be solved by controller (7) if and only if

limt(A+BK0)(hik\displaystyle\lim_{t\rightarrow\infty}(A+BK_{0})(h_{i_{k}} (t)hk+1(t))\displaystyle(t)-h_{k+1}(t))
(h˙ik(t)h˙k+1(t))=0\displaystyle-(\dot{h}_{i_{k}}(t)-\dot{h}_{k+1}(t))=0 (27)

holds kN1\forall k\in\mathcal{I}_{N-1}.

Proof:

Let d¯k(t)=dik(t)dk+1(t)\bar{d}_{k}(t)=d_{i_{k}}(t)-d_{k+1}(t) be the error vector between the parent and the child nodes of the directed edge eik,k+1e_{i_{k},k+1}, kN1k\in\mathcal{I}_{N-1}, and denote d¯=col(d¯1,,d¯N)\bar{d}=\text{col}(\bar{d}_{1},\cdots,\bar{d}_{N}). Then, d¯=(ΞIn)d\bar{d}=(\Xi\otimes\textbf{I}_{n})d. From Lemma 1, it remains to prove that limtd¯(t)=0\lim_{t\rightarrow\infty}\|\bar{d}(t)\|=0 under the given conditions.

Based on (1) and (7), the dynamics of x(t)x(t) is given by

x˙=(IN(A+BK0\displaystyle\dot{x}=(\textbf{I}_{N}\otimes(A+BK_{0} +BK1))x+((t)BK2)d\displaystyle+BK_{1}))x+(\mathcal{L}(t)\otimes BK_{2})d
(INBK1)h\displaystyle-(\textbf{I}_{N}\otimes BK_{1})h (28)

where (t)\mathcal{L}(t) is the Laplacian matrix of 𝒢\mathcal{G} at time tt due to the adaptive mechanisms. Then, it follows from (III-A) and the definitions of dd and d¯\bar{d} that

d¯˙=\displaystyle\dot{\bar{d}}= (IN1(A+BK0+BK1))d¯+(Ξ(t)BK2)d\displaystyle(\textbf{I}_{N-1}\otimes(A+BK_{0}+BK_{1}))\bar{d}+(\Xi\mathcal{L}(t)\otimes BK_{2})d
+(Ξ(A+BK0))h(ΞIn)h˙\displaystyle+(\Xi\otimes(A+BK_{0}))h-(\Xi\otimes\textbf{I}_{n})\dot{h}
=\displaystyle= (IN1(A+BK0+BK1)+Q(t)BK2)d¯\displaystyle(\textbf{I}_{N-1}\otimes(A+BK_{0}+BK_{1})+Q(t)\otimes BK_{2})\bar{d}
+(Ξ(A+BK0))h(ΞIn)h˙\displaystyle+(\Xi\otimes(A+BK_{0}))h-(\Xi\otimes\textbf{I}_{n})\dot{h} (29)

where Lemma 2 is used to get the second equality. Given that the linear system (3) asymptotically converges to zero, one knows that limtd¯(t)=0\lim_{t\rightarrow\infty}\|\bar{d}(t)\|=0 if and only if

limt(Ξ(A+BK0))h(t)(ΞIn)h˙(t)=0.\displaystyle\lim_{t\rightarrow\infty}(\Xi\otimes(A+BK_{0}))h(t)-(\Xi\otimes\textbf{I}_{n})\dot{h}(t)=0. (30)

From the definition of Ξ\Xi, condition (3) is equivalent to (30). This completes the proof. ∎

III-B Main result

The design process of the TVF controller is summarized in Algorithm 1, and analyzed in the following theorem.

Algorithm 1 TVF Controller Design
  1. 1.

    Find a constant K0K_{0} such that the formation feasibility condition

    (A+BK0)(hik\displaystyle(A+BK_{0})(h_{i_{k}} (t)hk+1(t))\displaystyle(t)-h_{k+1}(t))
    (h˙ik(t)h˙k+1(t))=0\displaystyle-(\dot{h}_{i_{k}}(t)-\dot{h}_{k+1}(t))=0 (31)

    holds kN1\forall k\in\mathcal{I}_{N-1} for any DST 𝒢¯\bar{\mathcal{G}}. If such K0K_{0} exists, continue; else, the algorithm terminates without solutions;

  2. 2.

    Choose K1K_{1} such that (A+BK0+BK1,B)(A+BK_{0}+BK_{1},B) is stabilizable (using, e.g., pole placement). For some η\eta, θ+\theta\in\mathbb{R}^{+}, solve the following LMI:

    (A+BK0+BK1)P+\displaystyle(A+BK_{0}+BK_{1})P+ P(A+BK0+BK1)T\displaystyle P(A+BK_{0}+BK_{1})^{T}
    ηBBT+θP0\displaystyle-\eta BB^{T}+\theta P\leq 0 (32)

    to get a P>0P>0;

  3. 3.

    Set K2=BTP1K_{2}=-B^{T}P^{-1}, Γ=P1BBTP1\Gamma=P^{-1}BB^{T}P^{-1} and choose scalars ρk+1,ik+\rho_{k+1,i_{k}}\in\mathbb{R}^{+}.

Theorem 1 (Main result for TVF)

Under Assumption 1, and feasibility condition (1), the TVF problem in Definition 1 is solved by controller (7) with adaptive coupling weights (10)-(III), along the designs in Algorithm 1.

Proof:

The feasibility condition (1) guarantees that (3) holds kN1\forall k\in\mathcal{I}_{N-1}. Moreover,

d¯˙=\displaystyle\dot{\bar{d}}= (IN1(A+BK0+BK1)+Q(t)BK2)d¯,\displaystyle(\textbf{I}_{N-1}\otimes(A+BK_{0}+BK_{1})+Q(t)\otimes BK_{2})\bar{d}, (33)

where Q(t)Q(t) is defined as in Lemma 3 based on 𝒢¯\bar{\mathcal{G}}. In the following, it will be proved that the designed controller guarantees limtd¯(t)=0\lim_{t\rightarrow\infty}\bar{d}(t)=0. As such, the proof of the theorem will be complete according to Lemma 3.

Consider the Lyapunov candidate

V1(t)=12d¯T(\displaystyle V_{1}(t)=\frac{1}{2}\bar{d}^{T}( IN1P1)d¯\displaystyle\textbf{I}_{N-1}\otimes P^{-1})\bar{d}
+k=1N112ρk+1,ik(a¯k+1,ik(t)ϕk+1,ik)2\displaystyle+\sum_{k=1}^{N-1}\frac{1}{2\rho_{k+1,i_{k}}}(\bar{a}_{k+1,i_{k}}(t)-\phi_{k+1,i_{k}})^{2} (34)

where PP is a solution to (2) and ϕk+1,ik+\phi_{k+1,i_{k}}\in\mathbb{R}^{+}, kN1k\in\mathcal{I}_{N-1} are to be decided later.

By (33) and (III), the derivative of V1V_{1} is

V˙1=\displaystyle\dot{V}_{1}= d¯T(IN1P1(A+BK0+BK1)\displaystyle\bar{d}^{T}(\textbf{I}_{N-1}\otimes P^{-1}(A+BK_{0}+BK_{1})
+Q(t)P1BK2)d¯\displaystyle\qquad\qquad\qquad\qquad+Q(t)\otimes P^{-1}BK_{2})\bar{d}
+\displaystyle+ k=1N1(a¯k+1,ikϕk+1,ik)(d¯kj+1𝒩¯2(k+1)d¯j)TΓd¯k.\displaystyle\sum_{k=1}^{N-1}(\bar{a}_{k+1,i_{k}}-\phi_{k+1,i_{k}})(\bar{d}_{k}-\sum_{j+1\in\bar{\mathcal{N}}_{2}(k+1)}\bar{d}_{j})^{T}\Gamma\bar{d}_{k}. (35)

Based on Lemma 2, one has

k=1N1a¯k+1,ik(d¯kj+1𝒩¯2(k+1)d¯j)TΓd¯k\displaystyle\sum_{k=1}^{N-1}\bar{a}_{k+1,i_{k}}(\bar{d}_{k}-\sum_{j+1\in\bar{\mathcal{N}}_{2}(k+1)}\bar{d}_{j})^{T}\Gamma\bar{d}_{k}
=\displaystyle= k=1N1(Q¯kk(t)d¯k+j=1,jkN1Q¯jk(t)d¯j)TΓd¯k\displaystyle\sum_{k=1}^{N-1}(\bar{Q}_{kk}(t)\bar{d}_{k}+\sum_{j=1,j\neq k}^{N-1}\bar{Q}_{jk}(t)\bar{d}_{j})^{T}\Gamma\bar{d}_{k}
=\displaystyle= k=1N1j=1N1Q¯jk(t)d¯jTΓd¯k\displaystyle\sum_{k=1}^{N-1}\sum_{j=1}^{N-1}\bar{Q}_{jk}(t)\bar{d}_{j}^{T}\Gamma\bar{d}_{k} (36)

Let us define Φ(N1)×(N1)\Phi\in\mathbb{R}^{(N-1)\times(N-1)} as

Φkj={ϕj+1,ij,ifj=k,ϕj+1,ij,ifj=ik1,0,otherwise.\displaystyle\Phi_{kj}=\left\{\begin{array}[]{ll}\phi_{j+1,i_{j}},&\text{if}\quad j=k,\\ -\phi_{j+1,i_{j}},&\text{if}\quad j=i_{k}-1,\\ 0,&\text{otherwise}.\end{array}\right. (40)

Then, it follows from (III-B)-(40) that

V˙1=\displaystyle\dot{V}_{1}= d¯T(IN1P1(A+BK0+BK1)\displaystyle\bar{d}^{T}(\textbf{I}_{N-1}\otimes P^{-1}(A+BK_{0}+BK_{1})
+Q(t)P1BK2)d¯\displaystyle\qquad\qquad\qquad\qquad+Q(t)\otimes P^{-1}BK_{2})\bar{d}
+k=1N1j=1N1(Q¯jk(t)Φjk)d¯jTΓd¯k\displaystyle+\sum_{k=1}^{N-1}\sum_{j=1}^{N-1}(\bar{Q}_{jk}(t)-\Phi_{jk})\bar{d}_{j}^{T}\Gamma\bar{d}_{k}
=\displaystyle= d¯T(IN1P1(A+BK0+BK1)\displaystyle\bar{d}^{T}(\textbf{I}_{N-1}\otimes P^{-1}(A+BK_{0}+BK_{1})
+Q(t)P1BK2)d¯\displaystyle\qquad\qquad\qquad\qquad+Q(t)\otimes P^{-1}BK_{2})\bar{d}
+d¯T((Q¯(t)Φ)Γ)d¯.\displaystyle+\bar{d}^{T}((\bar{Q}(t)-\Phi)\otimes\Gamma)\bar{d}. (41)

Define d~=(IN1P1)d¯\tilde{d}=(\textbf{I}_{N-1}\otimes P^{-1})\bar{d}, and substitute K2,ΓK_{2},\Gamma designed in Algorithm 1 into (III-B). Then, one has

V˙1=\displaystyle\dot{V}_{1}= d~T(IN1(A+BK0+BK1)P\displaystyle\tilde{d}^{T}(\textbf{I}_{N-1}\otimes(A+BK_{0}+BK_{1})P
Q(t)BBT)d~\displaystyle\qquad\qquad\qquad\qquad-Q(t)\otimes BB^{T})\tilde{d}
+d~T((Q¯(t)Φ)BBT)d~\displaystyle+\tilde{d}^{T}((\bar{Q}(t)-\Phi)\otimes BB^{T})\tilde{d}
=\displaystyle= d~T(IN1(A+BK0+BK1)P)d~\displaystyle\tilde{d}^{T}(\textbf{I}_{N-1}\otimes(A+BK_{0}+BK_{1})P)\tilde{d}
d~T((Q~+Φ)BBT)d~\displaystyle-\tilde{d}^{T}((\tilde{Q}+\Phi)\otimes BB^{T})\tilde{d}
=\displaystyle= 12d~T(IN1((A+BK0+BK1)P\displaystyle\frac{1}{2}\tilde{d}^{T}\Big{(}\textbf{I}_{N-1}\otimes\big{(}(A+BK_{0}+BK_{1})P
+P(A+BK0+BK1)T)\displaystyle\qquad\qquad\qquad+P(A+BK_{0}+BK_{1})^{T}\big{)}
(Q~+Q~T+Φ+ΦT)BBT)d~.\displaystyle-(\tilde{Q}+\tilde{Q}^{T}+\Phi+\Phi^{T})\otimes BB^{T}\Big{)}\tilde{d}. (42)

Now we show that by appropriately selecting ϕk+1,ik\phi_{k+1,i_{k}}, kN1k\in\mathcal{I}_{N-1}, it can be fulfilled that

Φ+ΦT=\displaystyle\Phi+\Phi^{T}=
(2ϕ2,i1ϕ21ϕN2,1ϕN1,1ϕ212ϕ3,i2ϕN1,2ϕN2,12ϕN1,iN2ϕN1,N2ϕN1,1ϕN1,2ϕN1,N22ϕN,iN1)\displaystyle\left(\begin{array}[]{ccccc}2\phi_{2,i_{1}}&\phi_{21}&\cdots&\phi_{N-2,1}&\phi_{N-1,1}\\ \phi_{21}&2\phi_{3,i_{2}}&\cdots&\cdots&\phi_{N-1,2}\\ \vdots&\vdots&\ddots&\vdots&\vdots\\ \phi_{N-2,1}&\vdots&\cdots&2\phi_{N-1,i_{N-2}}&\phi_{N-1,N-2}\\ \phi_{N-1,1}&\phi_{N-1,2}&\cdots&\phi_{N-1,N-2}&2\phi_{N,i_{N-1}}\\ \end{array}\right) (48)

is positive definite. To see this, let us denote Ψ1=(2ϕ2,i1)\Psi_{1}=\left(\begin{array}[]{c}2\phi_{2,i_{1}}\\ \end{array}\right) and Ψk=(Ψk1φkφkT2ϕk+1,ik)\Psi_{k}=\left(\begin{array}[]{cc}\Psi_{k-1}&\varphi_{k}\\ \varphi_{k}^{T}&2\phi_{k+1,i_{k}}\\ \end{array}\right), where φk=(ϕk1,ϕk2,,ϕk,k1)T\varphi_{k}=(\phi_{k1},\phi_{k2},\cdots,\phi_{k,k-1})^{T}, k=2,,N1k=2,\cdots,N-1. Clearly, Ψ1>0\Psi_{1}>0 by choosing ϕ2,i1>0\phi_{2,i_{1}}>0. Now suppose Ψk1>0\Psi_{k-1}>0, k2k\geq 2. Note that |ϕkj||ϕj+1,ij||\phi_{kj}|\leq|\phi_{j+1,i_{j}}|, jk1\forall j\in\mathcal{I}_{k-1}. Then, one has φkTΨk11φkλM(Ψk11)j=2kϕj,ij12\varphi_{k}^{T}\Psi_{k-1}^{-1}\varphi_{k}\leq\lambda_{\text{M}}(\Psi_{k-1}^{-1})\sum_{j=2}^{k}\phi_{j,i_{j-1}}^{2}. By choosing ϕk+1,ik>j=2kϕj,ij122λm(Ψk1)\phi_{k+1,i_{k}}>\frac{\sum_{j=2}^{k}\phi_{j,i_{j-1}}^{2}}{2\lambda_{\text{m}}(\Psi_{k-1})}, one has Ψk>0\Psi_{k}>0 according to the Schur complement [23, Chapter 2.1]. By mathematical induction, Φ+ΦT=ΨN1\Phi+\Phi^{T}=\Psi_{N-1} is positive definite.

Moreover, since Q~\tilde{Q} is fixed, one can always choose sufficiently large ϕk+1,ik\phi_{k+1,i_{k}}, kN1k\in\mathcal{I}_{N-1}, such that λm(Q~+Q~T+Φ+ΦT)η\lambda_{\text{m}}(\tilde{Q}+\tilde{Q}^{T}+\Phi+\Phi^{T})\geq\eta where η\eta is defined in (2). Then, it follows from (III-B) and (2) that

V˙1\displaystyle\dot{V}_{1}\leq 12d~T(IN1((A+BK0+BK1)P\displaystyle\frac{1}{2}\tilde{d}^{T}\Big{(}\textbf{I}_{N-1}\otimes\big{(}(A+BK_{0}+BK_{1})P
+P(A+BK0+BK1)TηBBT))d~\displaystyle\qquad+P(A+BK_{0}+BK_{1})^{T}-\eta BB^{T}\big{)}\Big{)}\tilde{d}
\displaystyle\leq θ2d~T(IN1P)d~=θ2d¯T(IN1P1)d¯0\displaystyle-\frac{\theta}{2}\tilde{d}^{T}(\textbf{I}_{N-1}\otimes P)\tilde{d}=-\frac{\theta}{2}\bar{d}^{T}(\textbf{I}_{N-1}\otimes P^{-1})\bar{d}\leq 0 (49)

which implies that the signals d¯(t)\bar{d}(t) and a¯k+1,ik(t)\bar{a}_{k+1,i_{k}}(t) in V1(t)V_{1}(t) are bounded. Note that V˙1(t)=0\dot{V}_{1}(t)=0 implies that d¯=0\bar{d}=0, thus by LaSalle’s invariance principle, one has limtd¯(t)=0\lim_{t\rightarrow\infty}\bar{d}(t)=0. This completes the proof. ∎

Remark 3

The LMI (2) is feasible for some P>0P>0 if and only if (A+BK0+BK1,B)(A+BK_{0}+BK_{1},B) is stabilizable, which can be realized since (A,B)(A,B) is stabilizable. Note that different formation vectors h()h(\cdot) might lead to different solutions P,K0,K1P,K_{0},K_{1}.

Remark 4

In state-of-the-art TVF, the number of feasibility conditions is of the order N(N1)2\frac{N(N-1)}{2} (i.e., one condition for each pair of connected agents) [5, 17]. The proposed number of feasibility conditions in (1) is N1N-1, i.e., exploiting the DST structure leads to the minimum number of conditions: note that N1N-1 is the minimum number of edges such that 𝒢\mathcal{G} is weakly-connected.

IV DST-Based Distributed Adaptive TVFT

In this section, we propose a novel generalized DST-based adaptive controller to solve the TVFT problem of Definition 3. We address the general case with multiple leaders, and give a corollary for the special case with a single leader.

Definition 4

The digraph 𝒢\mathcal{G} is said to have a generalized DST rooting at the leadership, if the followers are either well-informed or uninformed, and for each uninformed follower, there exists at least one well-informed follower that has a directed path to it.

Assumption 2

The digraph 𝒢\mathcal{G} has at least one generalized DST rooting at the leadership.

Remark 5

TVFT with multiple leaders is also considered in [7, 24], where it is required that the coupling weights from any leader to different well-informed followers are identical and known a priori. Assumption 2 relaxes that requirement.

IV-A Auxiliary system, technical lemma and control law

Let us introduce an auxiliary multi-agent system with an induced communication graph 𝒢(𝒱,,𝒜)\mathcal{G}^{\prime}(\mathcal{V}^{\prime},\mathcal{E}^{\prime},\mathcal{A}^{\prime}). Define 𝒱=NM+1\mathcal{V}^{\prime}=\mathcal{I}_{N-M+1} where the agent with index 11 is the leader and ={e1j,j>1|j+M1\mathcal{E}^{\prime}=\{e^{\prime}_{1j},j>1|j+M-1 is well-informed in 𝒢}{ejp,j,p>1|ej+M1,p+M1}\mathcal{G}\}\bigcup\{e^{\prime}_{jp},j,p>1|e_{j+M-1,p+M-1}\in\mathcal{E}\}. The adjacency matrix 𝒜=(ajp)\mathcal{A}^{\prime}=(a^{\prime}_{jp}) where ajp>0a^{\prime}_{jp}>0 if epje^{\prime}_{pj}\in\mathcal{E}^{\prime}, and ajp=0a^{\prime}_{jp}=0 otherwise.

To clarify Assumption 2 and the induced graph 𝒢\mathcal{G}^{\prime}, see Fig. 1. It is clear that the multiple leaders are merged as a single joint leader in 𝒢\mathcal{G}^{\prime}.

Refer to caption
Figure 1: A communication graph 𝒢\mathcal{G} with three leaders (with indexes 1,2,31,2,3) which satisfies Assumption 2, and the induced graph 𝒢\mathcal{G}^{\prime} with a single leader (with index 1).

In the auxiliary multi-agent system, let yjy_{j} and vjv_{j} be the state and control input of agent jj. For the leader, define y1=l=1Mβlxly_{1}=\sum_{l=1}^{M}\beta_{l}x_{l} and h10h^{\prime}_{1}\equiv 0. For the followers, define yj=xj+M1y_{j}=x_{j+M-1}, hj=hj+M1h^{\prime}_{j}=h_{j+M-1}, for j=2,,NM+1j=2,\cdots,N-M+1. Let dj=yjhjd^{\prime}_{j}=y_{j}-h^{\prime}_{j}, jNM+1j\in\mathcal{I}_{N-M+1}. Then, the dynamics of yjy_{j} satisfies

y˙1=Ay1,\displaystyle\dot{y}_{1}=Ay_{1},
y˙j=Ayj+Bvjj=2,,NM+1,\displaystyle\dot{y}_{j}=Ay_{j}+Bv_{j}\quad j=2,\cdots,N-M+1, (50)

where vj=uj+M1v_{j}=u_{j+M-1}, and the initial state values are determined by those of multi-agent system (II-C).

Lemma 4 (N-S condition for TVFT)

Under Assumption 2, the multi-agent system (II-C) achieves the TVFT with multiple leaders defined by hF(t)=col(hM+1(t),h^{F}(t)=\text{col}(h_{M+1}(t), hM+2(t),,hN(t))h_{M+2}(t),\cdots,h_{N}(t)) and by βl\beta_{l}, lMl\in\mathcal{I}_{M}, if and only if the auxiliary system (IV-A) achieves the TVFT defined by hF(t)=col(h2(t),h3(t),,hNM+1(t))h^{\prime}_{F}(t)=\text{col}(h^{\prime}_{2}(t),h^{\prime}_{3}(t),\cdots,h^{\prime}_{N-M+1}(t)) with a single leader.

Proof:

According to the definitions of yjy_{j} and hjh^{\prime}_{j}, it is obvious that limt(yj(t)hj(t)y1(t))=0\lim_{t\rightarrow\infty}(y_{j}(t)-h^{\prime}_{j}(t)-y_{1}(t))=0, j=2,,NM+1j=2,\cdots,N-M+1, is equivalent to limt(xi(t)hi(t)l=1Mβlxl(t))=0\lim_{t\rightarrow\infty}(x_{i}(t)-h_{i}(t)-\sum_{l=1}^{M}\beta_{l}x_{l}(t))=0, iNM\forall i\in\mathcal{I}_{N}\setminus\mathcal{I}_{M}. ∎

Under Assumption 2, there is at least one DST in 𝒢\mathcal{G}^{\prime} rooting at the leader. Then, one can choose such a DST 𝒢^(𝒱,^,𝒜^)\hat{\mathcal{G}}^{\prime}(\mathcal{V}^{\prime},\hat{\mathcal{E}}^{\prime},\hat{\mathcal{A}}^{\prime}). Let jkj_{k} denote the unique parent of node k+1k+1 in 𝒢^\hat{\mathcal{G}}^{\prime} for kNMk\in\mathcal{I}_{N-M}. Let 𝒩1(j)\mathcal{N}^{\prime}_{1}(j) be the set of in-neighbors of jj in 𝒢\mathcal{G}^{\prime} and 𝒩^2(j)\hat{\mathcal{N}}^{\prime}_{\text{2}}(j) be the set of out-neighbors of jj in 𝒢^\hat{\mathcal{G}}^{\prime}.

The generalized DST-based distributed adaptive TVFT controller for follower ii of (II-C), iNMi\in\mathcal{I}_{N}\setminus\mathcal{I}_{M}, is proposed as:

ui=viM+1,\displaystyle u_{i}=v_{i-M+1}, (51)
vj=K0hj+K2p𝒩1(j)αjp(t)(djdp),\displaystyle v_{j}=K_{0}h^{\prime}_{j}+K_{2}\sum_{p\in\mathcal{N}^{\prime}_{1}(j)}\alpha^{\prime}_{jp}(t)(d^{\prime}_{j}-d^{\prime}_{p}), (52)
αjp(t)={ajp,ifepj^,a^k+1,jk(t),ifepj^\displaystyle\alpha^{\prime}_{jp}(t)=\left\{\begin{array}[]{ll}a^{\prime}_{jp},&\text{if}\quad e_{pj}\in\mathcal{E}^{\prime}\setminus\hat{\mathcal{E}}^{\prime},\\ \hat{a}^{\prime}_{k+1,j_{k}}(t),&\text{if}\quad e_{pj}\in\hat{\mathcal{E}}^{\prime}\end{array}\right. (55)
a^˙k+1,jk=ρk+1,jk((djkdk+1)\displaystyle\dot{\hat{a}}^{\prime}_{k+1,j_{k}}=\rho_{k+1,j_{k}}\Big{(}(d^{\prime}_{j_{k}}-d^{\prime}_{k+1})-
p𝒩^2(k+1)(dk+1dp))TΓ(djkdk+1).\displaystyle\quad\qquad\qquad\sum\limits_{p\in\hat{\mathcal{N}}^{\prime}_{2}(k+1)}(d^{\prime}_{k+1}-d^{\prime}_{p})\Big{)}^{T}\Gamma(d^{\prime}_{j_{k}}-d^{\prime}_{k+1}). (56)

In order to illustrate the idea of the auxiliary multi-agent system, the information flow of the closed-loop system xix_{i}, iNMi\in\mathcal{I}_{N}\setminus\mathcal{I}_{M}, is sketched in Fig. 2. Instead of directly designing the controllers for multi-agent system (II-C), an auxiliary multi-agent system is defined as in (IV-A), and some interaction between them is constructed: at stage (52), each leader xlx_{l} of (II-C) broadcast its βl\beta_{l}-scaled state to the single leader of (IV-A), and each follower broadcast its state to the corresponding follower, respectively; at stage (51), each follower of (IV-A) responds to the corresponding follower of (II-C) with its control input. Then, the original TVFT problem in (II-C) is successfully transformed into the TVFT with a single leader in (IV-A). It should be pointed out that only the local information, i.e., the states of xsx_{s}, s𝒩1(i)s\in\mathcal{N}_{1}(i), are included in the loop of xix_{i} from Fig. 2.

Refer to caption
Figure 2: The information flow of the closed-loop system xix_{i}, iNMi\in\mathcal{I}_{N}\setminus\mathcal{I}_{M}.

IV-B Main result

The design process of the TVFT controller is summarized in Algorithm 2, and analyzed in the following theorem.

Algorithm 2 TVFT Controller Design
  1. 1.

    Find a constant K0K_{0} such that the formation tracking feasibility condition

    (A+BK0)hi(t)h˙i(t)=0\displaystyle(A+BK_{0})h_{i}(t)-\dot{h}_{i}(t)=0 (57)

    holds iNM\forall i\in\mathcal{I}_{N}\setminus\mathcal{I}_{M}. If such K0K_{0} exists, continue; else, the algorithm terminates without solutions;

  2. 2.

    Choose η\eta, θ+\theta\in\mathbb{R}^{+}, and solve the following LMI:

    AP+PATηBBT+θP0\displaystyle AP+PA^{T}-\eta BB^{T}+\theta P\leq 0 (58)

    to get a P>0P>0;

  3. 3.

    Set K2=BTP1K_{2}=-B^{T}P^{-1}, Γ=P1BBTP1\Gamma=P^{-1}BB^{T}P^{-1} and choose scalars ρk+1,ik+\rho_{k+1,i_{k}}\in\mathbb{R}^{+}.

Theorem 2 (Main result for TVFT)

Under Assumption 2, and feasibility condition (57). The TVFT problem in Definition 3 can be solved by controller (51)-(IV-A) with ρk+1,jk+\rho_{k+1,j_{k}}\in\mathbb{R}^{+}, and K2K_{2}, Γ\Gamma designed as in Algorithm 2.

Proof:

The condition that (57) holds iNM\forall i\in\mathcal{I}_{N}\setminus\mathcal{I}_{M} is equivalent to (A+BK0)hj(t)h˙j(t)=0(A+BK_{0})h^{\prime}_{j}(t)-\dot{h}^{\prime}_{j}(t)=0, j{2,,NM+1}\forall j\in\{2,\cdots,N-M+1\}, which means that the TVFT defined by hF=col(h2,h3,,hNM+1)h^{\prime}_{F}=\text{col}(h^{\prime}_{2},h^{\prime}_{3},\cdots,h^{\prime}_{N-M+1}) is feasible for the auxiliary multi-agent system (IV-A). According to Lemma 4, it remains to show that (52)-(IV-A) solves the TVFT for multi-agent system (IV-A) defined by hFh^{\prime}_{F} with a single leader.

Extensions of Lemma 1 and Lemma 2 apply to 𝒢\mathcal{G}^{\prime} and 𝒢^\hat{\mathcal{G}}^{\prime}, and are not repeated for compactness. Let h=col(h1,hF)h^{\prime}=\text{col}(h^{\prime}_{1},h^{\prime}_{F}) d^k(t)=dik(t)dk+1(t)\hat{d}^{\prime}_{k}(t)=d^{\prime}_{i_{k}}(t)-d^{\prime}_{k+1}(t) be the error vector between the parent and the child nodes of the directed edge e^ik,k+1\hat{e}^{\prime}_{i_{k},k+1}, kNMk\in\mathcal{I}_{N-M}, and denote d^=col(d^1,,d^NM+1)\hat{d}^{\prime}=\text{col}(\hat{d}^{\prime}_{1},\cdots,\hat{d}^{\prime}_{N-M+1}). Then d^=(ΞIn)d\hat{d}^{\prime}=(\Xi^{\prime}\otimes\textbf{I}_{n})d^{\prime}. Let Q(t)=Q~+Q^(t)Q^{\prime}(t)=\tilde{Q}^{\prime}+\hat{Q}^{\prime}(t) where Ξ\Xi^{\prime} and Q~\tilde{Q}^{\prime} is defined as in Lemma 1 and 2, respectively, based on 𝒢^\hat{\mathcal{G}}^{\prime} and

Q^kj(t)={a^j+1,ij(t),ifj=k,a^j+1,ij(t),ifj=ik1,0,otherwise.\displaystyle\hat{Q}^{\prime}_{kj}(t)=\left\{\begin{array}[]{ll}\hat{a}^{\prime}_{j+1,i_{j}}(t),&\text{if}\quad j=k,\\ -\hat{a}^{\prime}_{j+1,i_{j}}(t),&\text{if}\quad j=i_{k}-1,\\ 0,&\text{otherwise}.\end{array}\right. (62)

where the time-varying weights are defined in (52).

With (51), the closed-loop state dynamics of the leader-following multi-agent system (IV-A) can be obtained as

y˙=\displaystyle\dot{y}= (INM+1A)y+((t)BK2)d\displaystyle(\textbf{I}_{N-M+1}\otimes A)y+(\mathcal{L}^{\prime}(t)\otimes BK_{2})d^{\prime}
+(INM+1BK0)h.\displaystyle+(\textbf{I}_{N-M+1}\otimes BK_{0})h^{\prime}. (63)

Then, it follows from (IV-B) and the definitions of dd and d^\hat{d} that

d^˙=\displaystyle\dot{\hat{d}}^{\prime}= (INMA)d^+(Ξ(t)BK2)d\displaystyle(\textbf{I}_{N-M}\otimes A)\hat{d}^{\prime}+(\Xi^{\prime}\mathcal{L}^{\prime}(t)\otimes BK_{2})d^{\prime}
+(Ξ(A+BK0))h(ΞIn)h˙\displaystyle+(\Xi^{\prime}\otimes(A+BK_{0}))h^{\prime}-(\Xi^{\prime}\otimes\textbf{I}_{n})\dot{h}^{\prime}
=\displaystyle= (INMA+Q(t)BK2)d^\displaystyle(\textbf{I}_{N-M}\otimes A+Q^{\prime}(t)\otimes BK_{2})\hat{d}^{\prime}
+(Ξ(A+BK0))h(ΞIn)h˙\displaystyle+(\Xi^{\prime}\otimes(A+BK_{0}))h^{\prime}-(\Xi\otimes\textbf{I}_{n})\dot{h}^{\prime} (64)

where (t)\mathcal{L}^{\prime}(t) is the time-varying Laplacian matrix of 𝒢(t)\mathcal{G}^{\prime}(t). Under the feasibility condition (57), one has

d^˙=(INMA+Q(t)BK2)d^.\displaystyle\dot{\hat{d}}^{\prime}=(\textbf{I}_{N-M}\otimes A+Q^{\prime}(t)\otimes BK_{2})\hat{d}^{\prime}. (65)

Consider the Lyapunov candidate as

V2(t)=12d^T(\displaystyle V_{2}(t)=\frac{1}{2}\hat{d}^{\prime T}( INMP1)d^\displaystyle\textbf{I}_{N-M}\otimes P^{-1})\hat{d}^{\prime}
+k=1NM12ρk+1,ik(a^k+1,ik(t)δk+1,ik)2\displaystyle+\sum_{k=1}^{N-M}\frac{1}{2\rho_{k+1,i_{k}}}(\hat{a}^{\prime}_{k+1,i_{k}}(t)-\delta_{k+1,i_{k}})^{2} (66)

where PP is a solution of (58) and δk+1,ik+\delta_{k+1,i_{k}}\in\mathbb{R}^{+}, kNMk\in\mathcal{I}_{N-M}. Following similar steps as in the proof of Theorem 1, one has limtd^(t)=0\lim_{t\rightarrow\infty}\hat{d}^{\prime}(t)=0. In this case, the TVFT with a single leader is realized in (IV-A), meanwhile, the TVFT with multiple leaders is realized in (II-C). This completes the proof. ∎

In the special case when M=1M=1, the auxiliary multi-agent system (IV-A) coincides with the original one, thus, it can be removed. The DST-based adaptive TVFT controller can be directly designed for follower ii, i=2,,Ni=2,\cdots,N, as:

ui=K0hi+K2j𝒩1(i)αij(t)(didj)\displaystyle u_{i}=K_{0}h_{i}+K_{2}\sum_{j\in\mathcal{N}_{1}(i)}\alpha_{ij}(t)(d_{i}-d_{j}) (67)
αij(t)={aij,ifeji^,a^k+1,ik(t),ifeji^\displaystyle\alpha_{ij}(t)=\left\{\begin{array}[]{ll}a_{ij},&\text{if}\quad e_{ji}\in\mathcal{E}\setminus\hat{\mathcal{E}},\\ \hat{a}_{k+1,i_{k}}(t),&\text{if}\quad e_{ji}\in\hat{\mathcal{E}}\end{array}\right. (70)

and adaptive laws a^˙k+1,ik\dot{\hat{a}}_{k+1,i_{k}} as in (III). Here, d1(t)=x1(t)d_{1}(t)=x_{1}(t). Immediately, we have the following corollary.

Corollary 1 (Single leader case)

Suppose there exists a DST 𝒢^\hat{\mathcal{G}} rooting at the leader. Under feasibility condition (57), the TVFT with a single leader is solved by (67)-(70) and a^˙k+1,ik\dot{\hat{a}}_{k+1,i_{k}} as in (III), along the designs in Algorithm 2.

Remark 6

With a single leader, Assumption 2 degenerates to the standard assumption of existence of a DST rooting at the leader ([10, 6], etc). The benefit of Theorem 2 is thus to provide a natural unifying framework for the DST adaptive method in the presence of one or more leaders.

Remark 7

The TVFT problem with a single leader can be seen as a special type of the TVF problem where h1()0h_{1}(\cdot)\equiv 0 for the leader. By comparing (7) with (67), it can be seen that K1=K0K_{1}=-K_{0} in (67). This means that there is no separate term for the average formation signal, since the formation reference is known a prior as the of leader’s trajectory.

V Numerical examples

In this section, three numerical examples for TVF, TVFT with three leaders and with a single leader are implemented to validate the theoretical results. In all three examples, the initial positions of the agents (followers) are chosen from a Gaussian distribution with standard deviation 55, and the initial coupling weights of the edges are chosen from a uniform distribution in the interval (0,0.1)(0,0.1).

Example 1 (TVF)
Refer to caption
Figure 3: Communication graphs. The DSTs are highlighted with red color, and (R), (L) are the root and leader nodes.
Refer to caption
Figure 4: Example 1 (TVF): Trajectories of the agents xi(t)x_{i}(t), where the circles and triangles are used to mark the agents i6i\in\mathcal{I}_{6} and the agents i126i\in\mathcal{I}_{12}\setminus\mathcal{I}_{6}, respectively, at t=0t=0, 1010 and 2020.
Refer to caption
Figure 5: Example 1 (TVF): Coupling weights αij(t)\alpha_{ij}(t) and global formation error E(t)E(t) with proposed adaptive method.
Refer to caption
Figure 6: Example 1 (TVF): Coupling weights αij\alpha_{ij} and global formation error E(t)E(t) with nonadaptive adaptive method (same initial αij\alpha_{ij} as in Fig. 5).

Consider a second-order system modelled by (1) with N=12N=12, A=(0112),B=(01).A=\left(\begin{array}[]{cc}0&1\\ -1&2\\ \end{array}\right),B=\left(\begin{array}[]{c}0\\ 1\\ \end{array}\right).

The agents interact on the digraph 𝒢1\mathcal{G}_{1} in Fig. 3. The required TVF is a pair of nested hexagons with hi(t)=(6sin(t+(i1)π3),6cos(t+(i1)π3))Th_{i}(t)=(6\sin(t+\frac{(i-1)\pi}{3}),6\cos(t+\frac{(i-1)\pi}{3}))^{T} for i6i\in\mathcal{I}_{6}, and hi(t)=(3sin(t+(i1)π3),3cos(t+(i1)π3))Th_{i}(t)=(3\sin(t+\frac{(i-1)\pi}{3}),3\cos(t+\frac{(i-1)\pi}{3}))^{T} for i126i\in\mathcal{I}_{12}\setminus\mathcal{I}_{6}.

Let K0=(0,2)K_{0}=(0,-2). It can be verified via condition (1) that the desired formation is feasible for the selected DST. Since A+BK0A+BK_{0} is stabilizable, we can assign K1=(0,0)K_{1}=(0,0). Let η=2\eta=2, θ=1\theta=1, and solve LMI (2) to give a solution P=(1/31/31/32/3)P=\left(\begin{array}[]{cc}1/3&-1/3\\ -1/3&2/3\\ \end{array}\right). Following Algorithm 1, one has K2=(3,3)K_{2}=(-3,-3), and Γ=(9999)\Gamma=\left(\begin{array}[]{cc}9&9\\ 9&9\\ \end{array}\right). Let ρk+1,ik=0.1\rho_{k+1,i_{k}}=0.1.

The trajectories of the agents are in Fig. 4, showing how the nested hexagons are formed and rotate. Let ei(t)=di(t)davee_{i}(t)=d_{i}(t)-d_{\text{ave}} (see Remark 1), iNi\in\mathcal{I}_{N}. The global formation error E(t)=1Ni=1Nei(t)2E(t)=\sqrt{\frac{1}{N}\sum_{i=1}^{N}\|e_{i}(t)\|^{2}} converges to zero, as shown in Fig. 5. Fig. 5 also shows that the weights αij\alpha_{ij} are time-varying on the DST (solid lines) and kept constant otherwise (dashed lines). For comparison, Fig. 6 shows that if all weights are kept constant (αij=αij(0)\alpha_{ij}=\alpha_{ij}(0)), no TVF may be achieved (global formation error does not converge to zero).

Example 2 (TVFT with Three Leaders)
Refer to caption
Figure 7: Example 2 (TVFT with Three Leaders): Snapshots at t=0t=0, 2020, 3030, and 5050. Three filled pentagrams, five circles and an unfilled pentagram are used to mark leaders, followers, and the average of the leaders, respectively.
Refer to caption
Figure 8: Example 2 (TVFT with Three Leaders): Coupling weights αjp(t)\alpha^{\prime}_{jp}(t) in 𝒢\mathcal{G}^{\prime}, and global formation tracking error E(t)E(t) with proposed adaptive method.
Refer to caption
Figure 9: Example 2 (TVFT with Three Leaders): Coupling weights αjp\alpha^{\prime}_{jp} in 𝒢\mathcal{G}^{\prime}, and global formation tracking error E(t)E(t) with nonadaptive control (same initial αjp\alpha^{\prime}_{jp} as in Fig. 8).

Consider a third-order multi-agent system modelled by (II-C) with N=8N=8, M=3M=3, and

A=(0111212103),B=(001).A=\left(\begin{array}[]{ccc}0&1&1\\ 1&2&1\\ -2&-10&-3\\ \end{array}\right),B=\left(\begin{array}[]{c}0\\ 0\\ 1\\ \end{array}\right).

The communication graph is the digraph 𝒢\mathcal{G} in Fig. 1. The followers are required to form a time-varying pentagram described by

hi(t)=(3sin(t+2(i4)π5)3cos(t+2(i4)π5)6cos(t+2(i4)π5)),i=4,5,8,h_{i}(t)=\left(\begin{array}[]{c}3\sin(t+\frac{2(i-4)\pi}{5})\\ -3\cos(t+\frac{2(i-4)\pi}{5})\\ 6\cos(t+\frac{2(i-4)\pi}{5})\\ \end{array}\right),\quad i=4,5\cdots,8,

while tracking the average of the states of the leaders, i.e., β1=β2=β3=1/3\beta_{1}=\beta_{2}=\beta_{3}=1/3.

Let K0=(0,4,0)K_{0}=(0,4,0). It can be verified that the defined hi()h_{i}(\cdot) is feasible. Let η=2\eta=2, θ=1\theta=1, and ρk+1,jk=0.1\rho_{k+1,j_{k}}=0.1. Following Algorithm 2, one has K2=(2.3066,6.8257,2.4970)K_{2}=(-2.3066,-6.8257,-2.4970), and Γ=(5.320615.74445.759615.744446.589517.04345.759617.04346.2349)\Gamma=\left(\begin{array}[]{ccc}5.3206&15.7444&5.7596\\ 15.7444&46.5895&17.0434\\ 5.7596&17.0434&6.2349\end{array}\right).

The initial value of the leaders are chosen as x1(0)=(5,5,10)Tx_{1}(0)=(5,5,10)^{T}, x2(0)=(10,5,5)Tx_{2}(0)=(-10,-5,-5)^{T}, x3(0)=(5,10,5)Tx_{3}(0)=(5,-10,5)^{T}. Several snapshots of the agents are in Fig. 7, showing that the pentagram emerges and rotates around the average of the three leaders. Similarly, we define the global formation tracking error E(t)=1N3i=4Ndi(t)l=13βlxl(t)2E(t)=\sqrt{\frac{1}{N-3}\sum_{i=4}^{N}\|d_{i}(t)-\sum_{l=1}^{3}\beta_{l}x_{l}(t)\|^{2}}. The trajectories of αij\alpha^{\prime}_{ij} in 𝒢\mathcal{G}^{\prime} (see Fig. 1) and E(t)E(t) are provided in Fig. 8. Once more, a constant coupling strategy fails to accomplish the TVFT task, as shown in Fig. 9.

Example 3 (TVFT with a Single Leader)
Refer to caption
Figure 10: Example 3 (TVFT with a Single Leader): Trajectories of the agents xi(t)x_{i}(t), where three triangles, four squares and a pentagram are used to mark the agents i{2,3,4}i\in\{2,3,4\}, i{5,6,7,8}i\in\{5,6,7,8\}, and the leader i=1i=1, respectively, at t=0t=0, 1010 and 2020.
Refer to caption
Figure 11: Example 3 (TVFT with a Single Leader): Coupling weights αij(t)\alpha_{ij}(t) and global formation tracking error E(t)E(t) with proposed adaptive method.
Refer to caption
Figure 12: Example 3 (TVFT with a Single Leader): Global formation tracking error E(t)E(t) with nonadaptive control (left) and with adaptive controller (3) (right).

Consider a network of second-order agents with N=8N=8, M=1M=1, A=(0100),B=(01),A=\left(\begin{array}[]{cc}0&1\\ 0&0\\ \end{array}\right),B=\left(\begin{array}[]{c}0\\ 1\\ \end{array}\right), and digraph 𝒢2\mathcal{G}_{2} in Fig. 3.

The desired formation is an equilateral triangle-like formation around the leader, which is specified by hi(t)=(4sin(t+2(i2)π3+π),4cos(t+2(i2)π3+π))Th_{i}(t)=(4\sin(t+\frac{2(i-2)\pi}{3}+\pi),4\cos(t+\frac{2(i-2)\pi}{3}+\pi))^{T} for i{2,3,4}i\in\{2,3,4\}, and hi(t)=(2sin(t+(i5)π2),2cos(t+(i5)π2))Th_{i}(t)=(2\sin(t+\frac{(i-5)\pi}{2}),2\cos(t+\frac{(i-5)\pi}{2}))^{T} for i{5,6,7,8}i\in\{5,6,7,8\}.

Let K0=(1,0)K_{0}=(-1,0). It can be verified via condition (57) that the desired formation is feasible. Let η=2\eta=2, θ=1\theta=1, and solve the LMI (58) to give a solution P=(0.65130.65130.65130.8256)P=\left(\begin{array}[]{cc}0.6513&-0.6513\\ -0.6513&0.8256\\ \end{array}\right). Following Algorithm 2, one has K2=(5.7356,5.7356)K_{2}=(-5.7356,-5.7356), and Γ=(32.896932.896932.896932.8969)\Gamma=\left(\begin{array}[]{cc}32.8969&32.8969\\ 32.8969&32.8969\\ \end{array}\right). We choose ρk+1,ik=0.1\rho_{k+1,i_{k}}=0.1.

The initial value of the leader is chosen as x1(0)=(0.5,0.5)Tx_{1}(0)=(0.5,0.5)^{T}. The trajectories of the agents are in Fig. 10, showing how the triangle emerges and rotates around the leader. If we define the global formation tracking error as E(t)=1N1i=2Ndi(t)x1(t)2E(t)=\sqrt{\frac{1}{N-1}\sum_{i=2}^{N}\|d_{i}(t)-x_{1}(t)\|^{2}}, we can see from Fig. 11 that it converges to zero (see also the time-varying weights αij\alpha_{ij} on the DST). Fig. 12 (left) shows that also in this case the TVFT may not be achieved with nonadaptive control.

The DST framework is not the only possible framework to remove the knowledge of the Laplacian eigenvalues: alternative frameworks have been proposed for consensus [25] and group TVFT [24]. Let us include a comparison with the adaptive method used in [25, 24], which can be written as:

ui=K0hi+K2j𝒩1(i)(ci(t)+ξiP1ξi)(didj)\displaystyle u_{i}=K_{0}h_{i}+K_{2}\sum_{j\in\mathcal{N}_{1}(i)}(c_{i}(t)+\xi_{i}P^{-1}\xi_{i})(d_{i}-d_{j})
c˙i=ξiTΓξiξi=j𝒩1(i)aij(didj).\displaystyle\dot{c}_{i}=\xi_{i}^{T}\Gamma\xi_{i}\qquad\xi_{i}=\sum_{j\in\mathcal{N}_{1}(i)}a_{ij}(d_{i}-d_{j}). (71)

Note that in (3) all coupling weights in the network are made adaptive. We select the same initial conditions, and ci(0)=10c_{i}(0)=10; the global formation tracking error is shown in Fig. 12 (right). As compared to Fig. 11 (right), it is interesting to note that adapting the gains on a DST instead of on the entire network leads to faster convergence of the formation errors.

VI Conclusions

A directed spanning tree (DST) adaptive framework has been developed for time-varying formation and formation tracking of linear multi-agent systems. The proposed framework provides a natural generalization of the DST based adaptive method in the presence of one or more leaders: necessary and sufficient conditions for solving the proposed framework have been derived. Future topics may include generalizing the proposed DST framework in the sense of cluster formation, partial state information, nonlinear agents and nonzero inputs of the leaders.

[Proof of Lemma 2] Inspired by [20] and [21], an auxiliary matrix JJ is introduced to analyze Lemma 2. Define JN×(N1)J\in\mathbb{R}^{N\times(N-1)} as

Jik={0,ifi𝒱¯k+1,1,otherwise\displaystyle J_{ik}=\left\{\begin{array}[]{ll}0,&\text{if}\quad i\in\bar{\mathcal{V}}_{k+1},\\ 1,&\text{otherwise}\end{array}\right. (74)

where 𝒱¯k+1\bar{\mathcal{V}}_{k+1} represents the vertex set of the subtree of 𝒢¯\bar{\mathcal{G}} rooting at node k+1k+1. The proof will proceed along three steps:

  1. 1.

    Proving that =JΞ\mathcal{L}=\mathcal{L}J\Xi;

  2. 2.

    Proving that Q=ΞJQ=\Xi\mathcal{L}J;

  3. 3.

    Proving (17) and (21), i.e., the statements of the lemma.

Step 1) Let us denote X=JΞX=J\Xi. Then, Xij=k=1N1JikΞkjX_{ij}=\sum_{k=1}^{N-1}J_{ik}\Xi_{kj}, i,jNi,j\in\mathcal{I}_{N}. We classify the discussions according to the value of jj in order to clarify the matrix XX.

Case 1: j=1j=1. Then, Xi1=k=1,ik=1N1JikX_{i1}=\sum_{k=1,i_{k}=1}^{N-1}J_{ik}.

Since J1k=1J_{1k}=1, k\forall k, then X11=𝒟¯2(1)X_{11}=\bar{\mathcal{D}}_{2}(1), which is the out-degree of the root in 𝒢¯\bar{\mathcal{G}}; When i>1i>1, there exists a unique k¯N1\bar{k}\in\mathcal{I}_{N-1} satisfying ik¯=1i_{\bar{k}}=1, such that i𝒱¯k¯+1i\in\bar{\mathcal{V}}_{\bar{k}+1}, implying that Jik¯=0J_{i\bar{k}}=0. Thus, Xi1=𝒟¯2(1)1X_{i1}=\bar{\mathcal{D}}_{2}(1)-1.

To sum up, Xi1={𝒟¯2(1),i=1,𝒟¯2(1)1,i>1.X_{i1}=\left\{\begin{array}[]{ll}\bar{\mathcal{D}}_{2}(1),&i=1,\\ \bar{\mathcal{D}}_{2}(1)-1,&i>1.\end{array}\right.

Case 2: jj is a stem. Then, Xij=k=1,ik=jN1JikJi,j1X_{ij}=\sum_{k=1,i_{k}=j}^{N-1}J_{ik}-J_{i,j-1}.

  1. i.

    When i𝒱¯ji\notin\bar{\mathcal{V}}_{j}, Xij=k=1,ik=jN1Jik1X_{ij}=\sum_{k=1,i_{k}=j}^{N-1}J_{ik}-1. Then, k\forall k satisfying ik=ji_{k}=j, i𝒱¯k+1i\notin\bar{\mathcal{V}}_{k+1}. Thus, Xij=𝒟¯2(j)1X_{ij}=\bar{\mathcal{D}}_{2}(j)-1.

  2. ii.

    When i𝒱¯ji\in\bar{\mathcal{V}}_{j}, Xij=k=1,ik=jN1JikX_{ij}=\sum_{k=1,i_{k}=j}^{N-1}J_{ik}. If i=ji=j, then k\forall k satisfying ik=ji_{k}=j, Jik=1J_{ik}=1. Thus Xjj=𝒟¯2(j)X_{jj}=\bar{\mathcal{D}}_{2}(j). If iji\neq j, there exists a unique k¯\bar{k} satisfying ik¯=ji_{\bar{k}}=j, such that i𝒱¯k¯+1i\in\bar{\mathcal{V}}_{\bar{k}+1}, implying that Jik¯=0J_{i\bar{k}}=0. Then, Xij=𝒟¯2(j)1X_{ij}=\bar{\mathcal{D}}_{2}(j)-1.

To sum up, Xij={𝒟¯2(j),i=j,𝒟¯2(j)1,ijX_{ij}=\left\{\begin{array}[]{ll}\bar{\mathcal{D}}_{2}(j),&i=j,\\ \bar{\mathcal{D}}_{2}(j)-1,&i\neq j\end{array}\right. when jj is a stem.

Case 3: jj is a leaf. Then, Xij=Ji,j1X_{ij}=-J_{i,j-1}.

In this case, 𝒱¯j={j}\bar{\mathcal{V}}_{j}=\{j\}, meaning that Ji,j1=0J_{i,j-1}=0 if and only if i=ji=j. Then Xij={0,i=j,1,ij.X_{ij}=\left\{\begin{array}[]{ll}0,&i=j,\\ -1,&i\neq j.\end{array}\right.

Summarizing all three cases, the matrix XX can be written in a unified way as Xij={𝒟¯2(j),i=j,𝒟¯2(j)1,ij.X_{ij}=\left\{\begin{array}[]{ll}\bar{\mathcal{D}}_{2}(j),&i=j,\\ \bar{\mathcal{D}}_{2}(j)-1,&i\neq j.\end{array}\right. Then,

(X)ij\displaystyle(\mathcal{L}X)_{ij} =k=1NikXkj\displaystyle=\sum_{k=1}^{N}\mathcal{L}_{ik}X_{kj}
=kjik(𝒟¯2(j)1)+ij𝒟¯2(j)\displaystyle=\sum_{k\neq j}\mathcal{L}_{ik}(\bar{\mathcal{D}}_{2}(j)-1)+\mathcal{L}_{ij}\bar{\mathcal{D}}_{2}(j)
=(𝒟¯2(j)1)k=1Nik+ij=ij.\displaystyle=(\bar{\mathcal{D}}_{2}(j)-1)\sum_{k=1}^{N}\mathcal{L}_{ik}+\mathcal{L}_{ij}=\mathcal{L}_{ij}.

So, =JΞ\mathcal{L}=\mathcal{L}J\Xi is proved.

Step 2) Let us denote Y=ΞJY=\Xi\mathcal{L}J. Then,

Ykj\displaystyle Y_{kj} =i=1N(Ξ)kiJij=i=1N(s=1NΞkssi)Jij\displaystyle=\sum_{i=1}^{N}(\Xi\mathcal{L})_{ki}J_{ij}=\sum_{i=1}^{N}(\sum_{s=1}^{N}\Xi_{ks}\mathcal{L}_{si})J_{ij}
=s=1NΞksi=1NsiJij=i=1Nik,iJiji=1Nk+1,iJij\displaystyle=\sum_{s=1}^{N}\Xi_{ks}\sum_{i=1}^{N}\mathcal{L}_{si}J_{ij}=\sum_{i=1}^{N}\mathcal{L}_{i_{k},i}J_{ij}-\sum_{i=1}^{N}\mathcal{L}_{k+1,i}J_{ij}
=i=1,i𝒱¯k+1N(ik,ik+1,i)\displaystyle=\sum_{i=1,i\notin\bar{\mathcal{V}}_{k+1}}^{N}(\mathcal{L}_{i_{k},i}-\mathcal{L}_{k+1,i})

where the definitions of Ξ\Xi and JJ are used to get the last two equalities, respectively. Since \mathcal{L} has zero row sums, we have

Ykj\displaystyle Y_{kj} =c𝒱¯k+1(k+1,cik,c)\displaystyle=\sum_{c\in\bar{\mathcal{V}}_{k+1}}(\mathcal{L}_{k+1,c}-\mathcal{L}_{i_{k},c})
=c𝒱¯j+1(~k+1,c~ik,c)+c𝒱¯j+1(¯k+1,c¯ik,c)\displaystyle=\sum_{c\in\bar{\mathcal{V}}_{j+1}}(\tilde{\mathcal{L}}_{k+1,c}-\tilde{\mathcal{L}}_{i_{k},c})+\sum_{c\in\bar{\mathcal{V}}_{j+1}}(\bar{\mathcal{L}}_{k+1,c}-\bar{\mathcal{L}}_{i_{k},c})
=Q~kj+Q¯kj=Qkj.\displaystyle=\tilde{Q}_{kj}+\bar{Q}_{kj}=Q_{kj}.

Then, Q=ΞJQ=\Xi\mathcal{L}J is proved.

Step 3) Let both sides Q=ΞJQ=\Xi\mathcal{L}J multiply Ξ\Xi, one has QΞ=ΞJΞ=ΞQ\Xi=\Xi\mathcal{L}J\Xi=\Xi\mathcal{L}, then (17) holds. To prove the explicit form of Q¯\bar{Q} in (21), one can can distinguish three cases based on the relationships between the edge e¯ik,k+1\bar{e}_{i_{k},k+1} and the subtree 𝒱¯j+1\bar{\mathcal{V}}_{j+1}:

Case 1: k+1𝒱¯j+1k+1\notin\bar{\mathcal{V}}_{j+1}. Then, it is obvious that Q¯kj=0\bar{Q}_{kj}=0.

Case 2: k+1𝒱¯j+1k+1\in\bar{\mathcal{V}}_{j+1} and ik𝒱¯j+1i_{k}\notin\bar{\mathcal{V}}_{j+1}. In this case, the only possible value of kk is k=jk=j. Then,

Q¯kj\displaystyle\bar{Q}_{kj} =c𝒱¯j+1(¯k+1,c¯ik,c)\displaystyle=\sum_{c\in\bar{\mathcal{V}}_{j+1}}(\bar{\mathcal{L}}_{k+1,c}-\bar{\mathcal{L}}_{i_{k},c})
=¯k+1,k+1=¯j+1,j+1=a¯j+1,ij.\displaystyle=\bar{\mathcal{L}}_{k+1,k+1}=\bar{\mathcal{L}}_{j+1,j+1}=\bar{a}_{j+1,i_{j}}.

Case 3: ik𝒱¯j+1i_{k}\in\bar{\mathcal{V}}_{j+1}. Then,

  1. i.

    When ik=j+1i_{k}=j+1,

    Q¯kj\displaystyle\bar{Q}_{kj} =c𝒱¯j+1(¯k+1,c¯ik,c)\displaystyle=\sum_{c\in\bar{\mathcal{V}}_{j+1}}(\bar{\mathcal{L}}_{k+1,c}-\bar{\mathcal{L}}_{i_{k},c})
    =¯k+1,ik¯ik,ik+¯k+1,k+1¯ik,k+1\displaystyle=\bar{\mathcal{L}}_{k+1,i_{k}}-\bar{\mathcal{L}}_{i_{k},i_{k}}+\bar{\mathcal{L}}_{k+1,k+1}-\bar{\mathcal{L}}_{i_{k},k+1}
    =¯ik,ik=a¯j+1,ij.\displaystyle=-\bar{\mathcal{L}}_{i_{k},i_{k}}=-\bar{a}_{j+1,i_{j}}.
  2. ii.

    When ik>j+1i_{k}>j+1,

    Q¯kj\displaystyle\bar{Q}_{kj} =c𝒱¯j+1(¯k+1,c¯ik,c)\displaystyle=\sum_{c\in\bar{\mathcal{V}}_{j+1}}(\bar{\mathcal{L}}_{k+1,c}-\bar{\mathcal{L}}_{i_{k},c})
    =¯k+1,iik1¯ik,iik1+¯k+1,ik¯ik,ik\displaystyle=\bar{\mathcal{L}}_{k+1,i_{i_{k}-1}}-\bar{\mathcal{L}}_{i_{k},i_{i_{k}-1}}+\bar{\mathcal{L}}_{k+1,i_{k}}-\bar{\mathcal{L}}_{i_{k},i_{k}}
    +¯k+1,k+1¯ik,k+1\displaystyle\qquad+\bar{\mathcal{L}}_{k+1,k+1}-\bar{\mathcal{L}}_{i_{k},k+1}
    =¯ik,iik1+¯k+1,ik¯ik,ik+¯k+1,k+1=0.\displaystyle=-\bar{\mathcal{L}}_{i_{k},i_{i_{k}-1}}+\bar{\mathcal{L}}_{k+1,i_{k}}-\bar{\mathcal{L}}_{i_{k},i_{k}}+\bar{\mathcal{L}}_{k+1,k+1}=0.

Summarizing all three cases, the matrix Q¯\bar{Q} can also be given in a unified way as Q¯kj={a¯j+1,ij,ifj=k,a¯j+1,ij,ifj=ik1,0,otherwise.\bar{Q}_{kj}=\left\{\begin{array}[]{ll}\bar{a}_{j+1,i_{j}},&\text{if}\quad j=k,\\ -\bar{a}_{j+1,i_{j}},&\text{if}\quad j=i_{k}-1,\\ 0,&\text{otherwise}.\end{array}\right. Then (21) is proved, which completes the proof.

References

  • [1] K.-K. Oh, M.-C. Park, and H.-S. Ahn, “A survey of multi-agent formation control,” Automatica, vol. 53, pp. 424–440, 2015.
  • [2] J. Hu, P. Bhowmick, F. Arvin, A. Lanzon, and B. Lennox, “Cooperative control of heterogeneous connected vehicle platoons: An adaptive leader-following approach,” IEEE Robot. Autom. Lett., vol. 5, no. 2, pp. 976–983, 2020.
  • [3] Y. Liu and Y. Jia, “An iterative learning approach to formation control of multi-agent systems,” Syst. Control Lett., vol. 61, no. 1, pp. 148–154, 2012.
  • [4] L. Brinón-Arranz, A. Seuret, and C. Canudas-de Wit, “Cooperative control design for time-varying formations of multi-agent systems,” IEEE Trans. Autom. Control, vol. 59, no. 8, pp. 2283–2288, 2014.
  • [5] X. Dong, J. Xi, G. Lu, and Y. Zhong, “Formation control for high-order linear time-invariant multiagent systems with time delays,” IEEE Trans. Control Netw. Syst., vol. 1, no. 3, pp. 232–240, 2014.
  • [6] X. Dong, Y. Li, C. Lu, G. Hu, Q. Li, and Z. Ren, “Time-varying formation tracking for UAV swarm systems with switching directed topologies,” IEEE Trans. Neural Netw. Learn. Syst., vol. 30, no. 12, pp. 3674–3685, 2019.
  • [7] X. Dong and G. Hu, “Time-varying formation tracking for linear multiagent systems with multiple leaders,” IEEE Trans. Autom. Control, vol. 62, no. 7, pp. 3658–3664, 2017.
  • [8] J. Yu, X. Dong, Q. Li, and Z. Ren, “Practical time-varying formation tracking for second-order nonlinear multiagent systems with multiple leaders using adaptive neural networks,” IEEE Trans. Neural Netw. Learn. Syst., vol. 29, no. 12, pp. 6015–6025, 2018.
  • [9] W. Ren, “Consensus based formation control strategies for multi-vehicle systems,” in Proc. Amer. Control Conf. IEEE, 2006, pp. 4237–4242.
  • [10] F. Xiao, L. Wang, J. Chen, and Y. Gao, “Finite-time formation control for multi-agent systems,” Automatica, vol. 45, no. 11, pp. 2605–2611, 2009.
  • [11] W. Yu, W. X. Zheng, G. Chen, W. Ren, and J. Cao, “Second-order consensus in multi-agent dynamical systems with sampled position data,” Automatica, vol. 47, no. 7, pp. 1496–1503, 2011.
  • [12] S. Baldi, S. Yuan, and P. Frasca, “Output synchronization of unknown heterogeneous agents via distributed model reference adaptation,” IEEE Trans. Control Netw. Syst., vol. 6, no. 2, pp. 515–525, 2018.
  • [13] W. Yu, P. DeLellis, G. Chen, M. Di Bernardo, and J. Kurths, “Distributed adaptive control of synchronization in complex networks,” IEEE Trans. Autom. Control, vol. 57, no. 8, pp. 2153–2158, 2012.
  • [14] Z. Li, W. Ren, X. Liu, and L. Xie, “Distributed consensus of linear multi-agent systems with adaptive dynamic protocols,” Automatica, vol. 49, no. 7, pp. 1986–1995, 2013.
  • [15] B. Cheng and Z. Li, “Fully distributed event-triggered protocols for linear multi-agent networks,” IEEE Trans. Autom. Control, vol. 64, no. 4, pp. 1655–1662, 2019.
  • [16] G. Wen, G. Hu, Z. Zuo, Y. Zhao, and J. Cao, “Robust containment of uncertain linear multi-agent systems under adaptive protocols,” Int. J. Robust Nonlinear Control, vol. 27, no. 12, pp. 2053–2069, 2017.
  • [17] R. Wang, X. Dong, Q. Li, and Z. Ren, “Distributed adaptive control for time-varying formation of general linear multi-agent systems,” Int. J. Syst. Sci., vol. 48, no. 16, pp. 3491–3503, 2017.
  • [18] ——, “Distributed time-varying output formation control for general linear multiagent systems with directed topology,” IEEE Trans. Control Netw. Syst., vol. 6, no. 2, pp. 609–620, 2018.
  • [19] D. Yue, J. Cao, Q. Li, and M. Abdel-Aty, “Distributed neuro-adaptive formation control for uncertain multi-agent systems: node- and edge-based designs,” IEEE Trans. Netw. Sci. Eng., 2020.
  • [20] W. Yu, J. Lu, X. Yu, and G. Chen, “Distributed adaptive control for synchronization in directed complex networks,” SIAM J. Control Optim., vol. 53, no. 5, pp. 2980–3005, 2015.
  • [21] Z. Yu, D. Huang, H. Jiang, C. Hu, and W. Yu, “Distributed consensus for multiagent systems via directed spanning tree based adaptive control,” SIAM J. Control Optim., vol. 56, no. 3, pp. 2189–2217, 2018.
  • [22] Z. Yu, H. Jiang, D. Huang, and C. Hu, “Directed spanning tree–based adaptive protocols for second-order consensus of multiagent systems,” Int. J. Robust Nonlinear Control, vol. 28, no. 6, pp. 2172–2190, 2018.
  • [23] S. Boyd, L. El Ghaoui, E. Feron, and V. Balakrishnan, Linear Matrix Inequalities in System and Control Theory. SIAM, 1994, vol. 15.
  • [24] J. Hu, P. Bhowmick, and A. Lanzon, “Distributed adaptive time-varying group formation tracking for multiagent systems with multiple leaders on directed graphs,” IEEE Trans. Control Netw. Syst., vol. 7, no. 1, pp. 140–150, 2020.
  • [25] Y. Lv, Z. Li, Z. Duan, and G. Feng, “Novel distributed robust adaptive consensus protocols for linear multi-agent systems with directed graphs and external disturbances,” Int. J. Control, vol. 90, no. 2, pp. 137–147, 2017.