A Real-Time Video Tracking System
1980, IEEE Transactions on Pattern Analysis and Machine Intelligence
https://doi.org/10.1109/TPAMI.1980.4766969Abstract
Object identification and tracking applications of pattern recognition at video rates is a problem of wide interest, with previous attempts limited to very simple threshold or correlation (restricted window) methods. New high-speed algorithms together with fast digital hardware have produced a system for missile and aircraft identification and tracking that possesses a degree of "intelligence" not previously implemented in a real-time tracking system. Adaptive statistical clustering and projection-based classification algorithms are applied in real time to identify and track objects that change in appearance through complex and nonstationary background/foreground situations. Fast estimation and prediction algorithms combine linear and quadratic estimators to provide speed and sensitivity. Weights are determined to provide a measure of confi'dence in the data and resulting decisions. Strategies based on maximizing the probability of maintaining track are developed. This paper emphasizes the theoretical aspects of the system and discusses the techniques used to achieve realtime implementation. Index Terms-Image processing, intensity histograms, object identification, optical tracking, projections, tracking system, video data compression, video processing, video tracking. velopment of the real-time videotheodolite (RTV). U.S. Army White Sands Missile Range began the development of the RTV in 1974, and the system is being deployed at this time. Design philosophy called for a system capable of discriminatory judgment in identifying the object to be tracked with 60 independent observations/s, capable of locating the center of mass of the object projection on the image plane within about 2 per-Manuscript
References (21)
- P. I. Perez, "A multiprocessor architecture with a master shared control store," Ph.D. dissertation, New Mexico State Univ., 1978 (available from University Microfilms, Ann Arbor, MI).
- G. M. Flachs and A. L. Gilbert, "Automatic boresight correction in optical tracking," in Proc. 1975 Nat. Aerospace and Elec- tronics Conf., June 1975.
- G. M. Flachs, W. E. Thompson, Y. H. U, and A. L. Gilbert, "A real-time structural tracking algorithm," in Proc. IEEE 1976 Nat. Aerospace and Electronics Conf., May 1976.
- G. M. Flachs and J. A. Vilela, "A structural model for polygon patterns," in Proc. IEEE 1976 Nat. Aerospace and Electronics Conf., May 1976.
- G. M. Flachs, W. E. Thompson, J. M. Taylor, W. Cannon, R. B. Rogers, and Y. H. U, "An automatic video tracking system," in Proc. 1977Nat. Aerospace and Electronics Conf., May 1977.
- R. B. Rogers and G. M. Flachs, "Mathematical modeling and simulation in a programmed design methodology," in Proc. 1st Int. Conf. on Mathematical Modeling, Aug. 1977.
- A. L. Gilbert and M. K. Giles, "Novel concepts in real-time optical tracking," in Proc. Army Sci. Conf., June 1978.
- N. J. Nilsson, Learning Machines. New York: McGraw-Hill, 1965, ch. 4.
- H. L. Andrews, Introduction to Mathematical Techniques in Pattern Recognition. New York: Wiley-Interscience, 1972, pp.148-150.
- B. P. Lathi, Random Signals and Communication Theory. Scran- ton, PA: International Textbook, 1968, pp. 275-279.
- I. Selin, Detection Theory. Princeton, NJ: Princeton Univ. Press, 1965, pp. 1 1-13.
- S. K. Chang, "The reconstruction of binary patterns from their projections," Commun. ACM, vol. 14, Jan. 1971.
- Y. H. U, "Projection theory for real-time vision tracking," Ph.D. dissertation, New Mexico State Univ., Aug. 1978 (avail- able from University Microfilms, Ann Arbor, MI).
- E. G. Johnston and A. Rosenfeld, "Geometrical operations on digitized pictures," Picture Processing and Psychopictorics, B. S. Lipkin and R. Rosenfeld, Eds. New York: Academic, 1970.
- R. Romovic and R. B. McGhee, "A finite static approach to the synthesis of bioengineering control systems," IEEE Trans. Hum. Factors Electron., vol. HFE-7, pp.65-69, June 1966.
- E. S. Angel and G. A. Bekey, "Adaptive finite state models of manual control systems," IEEE Trans. Man-Mach. Syst., pp. 15-20, Mar. 1968.
- T. L. Booth, Sequential Machines and Automata Theory. New York: Wiley, 1968.
- A. Papoulis, Probability Random Variables and Stochastic Pro- cesses. New York: McGraw-Hill, 1965, pp. 385-426.
- W. E. Thompson, G. M. Flachs, and T. R. Kiang, "Evaluation of filtering and prediction techniques for real-time video tracking of high performance targets," Trans. 1978 Nat. Aerospace and Electronics Conf., June 1978.
- C. B. Chang, R. H. Whitney, and M. Atham, "Application of adaptive filtering methods to maneuvering trajectory estima- tion," Lincoln Lab. Tech. Note 1975-59, Nov. 1975.
- K. E. Iverson, A Programming Language. New York: Wiley, 1962. Alton L. Gilbert (S'68-M'73) was born in Elmira, NY, on April 13, 1942. He received the B.S.E.E., M.S.E.E., and Sc.D. degrees, all from the New Mexico State University, Las Cruces, in 1970, 1971, and 1973, respectively.