Design and development of an on-board autonomous visual tracking system for unmanned aerial vehicles

Narsimlu Kemsaram, T.V. Rajini Kanth, Devendra Rao Guntupalli, Anil Kuvvarapu

Onderzoeksoutput: Bijdrage aan tijdschriftTijdschriftartikelAcademicpeer review

1 Citaat (Scopus)

Uittreksel

This paper proposes the design and development of an on-board autonomous visual tracking system (AVTS) for unmanned aerial vehicles (UAV). A prototype of the proposed system has been implemented in MATLAB/ Simulink for simulation purposes. The proposed system contains GPS/INS sensors, a gimbaled camera, a multi-level autonomous visual tracking algorithm, a ground stationary target (GST) or ground moving target (GMT) state estimator, a camera control algorithm, a UAV guidance algorithm, and an autopilot. The on-board multi-level autonomous visual tracking algorithm acquires the video frames from the on-board camera and calculates the GMT pixel position in the video frame. The on-board GMT state estimator receives the GMT pixel position from the multi-level autonomous visual tracking algorithm and estimates the current position and velocity of the GMT with respect to the UAV. The on-board non-linear UAV guidance law computes the UAV heading velocity rates and sends them to the autopilot to steer the UAV in the desired path. The on-board camera control law computes the control command and sends it to the camera's gimbal controller to keep the GMT in the camera's field of view. The UAV guidance law and camera control law have been integrated for continuous tracking of the GMT. The on-board autopilot is used for controlling the UAV trajectory. The simulation of the proposed system was tested with a flight simulator and the UAV's reaction to the GMT was observed. The simulated results prove that the proposed system tracks a GST or GMT effectively.

Originele taal-2Engels
Pagina's (van-tot)83-91
Aantal pagina's9
TijdschriftAviation
Volume21
Nummer van het tijdschrift3
DOI's
StatusGepubliceerd - 8 sep 2017
Extern gepubliceerdJa

Vingerafdruk

Unmanned aerial vehicles (UAV)
Cameras
Pixels
Flight simulators
MATLAB
Global positioning system
Trajectories
Controllers
Sensors

Citeer dit

Kemsaram, Narsimlu ; Rajini Kanth, T.V. ; Guntupalli, Devendra Rao ; Kuvvarapu, Anil. / Design and development of an on-board autonomous visual tracking system for unmanned aerial vehicles. In: Aviation. 2017 ; Vol. 21, Nr. 3. blz. 83-91.
@article{1497fb642f1e431ca449ac74fa66d582,
title = "Design and development of an on-board autonomous visual tracking system for unmanned aerial vehicles",
abstract = "This paper proposes the design and development of an on-board autonomous visual tracking system (AVTS) for unmanned aerial vehicles (UAV). A prototype of the proposed system has been implemented in MATLAB/ Simulink for simulation purposes. The proposed system contains GPS/INS sensors, a gimbaled camera, a multi-level autonomous visual tracking algorithm, a ground stationary target (GST) or ground moving target (GMT) state estimator, a camera control algorithm, a UAV guidance algorithm, and an autopilot. The on-board multi-level autonomous visual tracking algorithm acquires the video frames from the on-board camera and calculates the GMT pixel position in the video frame. The on-board GMT state estimator receives the GMT pixel position from the multi-level autonomous visual tracking algorithm and estimates the current position and velocity of the GMT with respect to the UAV. The on-board non-linear UAV guidance law computes the UAV heading velocity rates and sends them to the autopilot to steer the UAV in the desired path. The on-board camera control law computes the control command and sends it to the camera's gimbal controller to keep the GMT in the camera's field of view. The UAV guidance law and camera control law have been integrated for continuous tracking of the GMT. The on-board autopilot is used for controlling the UAV trajectory. The simulation of the proposed system was tested with a flight simulator and the UAV's reaction to the GMT was observed. The simulated results prove that the proposed system tracks a GST or GMT effectively.",
keywords = "autonomous visual tracking system, aviator visual design simulator, cam-shift algorithm, extended Kalman filter estimator, ground moving target, ground stationary target, mean-shift algorithm, micro aerial vehicles, unmanned aerial vehicles, unmanned aircraft systems",
author = "Narsimlu Kemsaram and {Rajini Kanth}, T.V. and Guntupalli, {Devendra Rao} and Anil Kuvvarapu",
year = "2017",
month = "9",
day = "8",
doi = "10.3846/16487788.2017.1378265",
language = "English",
volume = "21",
pages = "83--91",
journal = "Aviation",
issn = "1648-7788",
publisher = "Taylor and Francis Ltd.",
number = "3",

}

Design and development of an on-board autonomous visual tracking system for unmanned aerial vehicles. / Kemsaram, Narsimlu; Rajini Kanth, T.V.; Guntupalli, Devendra Rao; Kuvvarapu, Anil.

In: Aviation, Vol. 21, Nr. 3, 08.09.2017, blz. 83-91.

Onderzoeksoutput: Bijdrage aan tijdschriftTijdschriftartikelAcademicpeer review

TY - JOUR

T1 - Design and development of an on-board autonomous visual tracking system for unmanned aerial vehicles

AU - Kemsaram, Narsimlu

AU - Rajini Kanth, T.V.

AU - Guntupalli, Devendra Rao

AU - Kuvvarapu, Anil

PY - 2017/9/8

Y1 - 2017/9/8

N2 - This paper proposes the design and development of an on-board autonomous visual tracking system (AVTS) for unmanned aerial vehicles (UAV). A prototype of the proposed system has been implemented in MATLAB/ Simulink for simulation purposes. The proposed system contains GPS/INS sensors, a gimbaled camera, a multi-level autonomous visual tracking algorithm, a ground stationary target (GST) or ground moving target (GMT) state estimator, a camera control algorithm, a UAV guidance algorithm, and an autopilot. The on-board multi-level autonomous visual tracking algorithm acquires the video frames from the on-board camera and calculates the GMT pixel position in the video frame. The on-board GMT state estimator receives the GMT pixel position from the multi-level autonomous visual tracking algorithm and estimates the current position and velocity of the GMT with respect to the UAV. The on-board non-linear UAV guidance law computes the UAV heading velocity rates and sends them to the autopilot to steer the UAV in the desired path. The on-board camera control law computes the control command and sends it to the camera's gimbal controller to keep the GMT in the camera's field of view. The UAV guidance law and camera control law have been integrated for continuous tracking of the GMT. The on-board autopilot is used for controlling the UAV trajectory. The simulation of the proposed system was tested with a flight simulator and the UAV's reaction to the GMT was observed. The simulated results prove that the proposed system tracks a GST or GMT effectively.

AB - This paper proposes the design and development of an on-board autonomous visual tracking system (AVTS) for unmanned aerial vehicles (UAV). A prototype of the proposed system has been implemented in MATLAB/ Simulink for simulation purposes. The proposed system contains GPS/INS sensors, a gimbaled camera, a multi-level autonomous visual tracking algorithm, a ground stationary target (GST) or ground moving target (GMT) state estimator, a camera control algorithm, a UAV guidance algorithm, and an autopilot. The on-board multi-level autonomous visual tracking algorithm acquires the video frames from the on-board camera and calculates the GMT pixel position in the video frame. The on-board GMT state estimator receives the GMT pixel position from the multi-level autonomous visual tracking algorithm and estimates the current position and velocity of the GMT with respect to the UAV. The on-board non-linear UAV guidance law computes the UAV heading velocity rates and sends them to the autopilot to steer the UAV in the desired path. The on-board camera control law computes the control command and sends it to the camera's gimbal controller to keep the GMT in the camera's field of view. The UAV guidance law and camera control law have been integrated for continuous tracking of the GMT. The on-board autopilot is used for controlling the UAV trajectory. The simulation of the proposed system was tested with a flight simulator and the UAV's reaction to the GMT was observed. The simulated results prove that the proposed system tracks a GST or GMT effectively.

KW - autonomous visual tracking system

KW - aviator visual design simulator

KW - cam-shift algorithm

KW - extended Kalman filter estimator

KW - ground moving target

KW - ground stationary target

KW - mean-shift algorithm

KW - micro aerial vehicles

KW - unmanned aerial vehicles

KW - unmanned aircraft systems

UR - http://www.scopus.com/inward/record.url?scp=85030789041&partnerID=8YFLogxK

U2 - 10.3846/16487788.2017.1378265

DO - 10.3846/16487788.2017.1378265

M3 - Article

AN - SCOPUS:85030789041

VL - 21

SP - 83

EP - 91

JO - Aviation

JF - Aviation

SN - 1648-7788

IS - 3

ER -