Pixel Selection and Intensity Directed Symmetry for High Frame Rate and Ultra-Low Delay Matching System

Tingting HU; Takeshi IKENAGA

doi:10.1587/transinf.2017MVP0012

Pixel Selection and Intensity Directed Symmetry for High Frame Rate and Ultra-Low Delay Matching System

Tingting HU, Takeshi IKENAGA

Full Text Views

0

Cite this

Summary :

High frame rate and ultra-low delay matching system plays an increasingly important role in human-machine interactive applications which call for higher frame rate and lower delay for a better experience. The large amount of processing data and the complex computation in a local feature based matching system, make it difficult to achieve a high process speed and ultra-low delay matching with limited resource. Aiming at a matching system with the process speed of more than 1000 fps and with the delay of less than 1 ms/frame, this paper puts forward a local binary feature based matching system with field-programmable gate array (FPGA). Pixel selection based 4-1-4 parallel matching and intensity directed symmetry are proposed for the implementation of this system. To design a basic framework with the high process speed and ultra-low delay using limited resource, pixel selection based 4-1-4 parallel matching is proposed, which makes it possible to use only one-thread resource consumption to achieve a four-thread processing. Assumes that the orientation of the keypoint will bisect the patch best and will point to the region with high intensity, intensity directed symmetry is proposed to calculate the keypoint orientation in a hardware friendly way, which is an important part for a rotation-robust matching system. Software experiment result shows that the proposed keypoint orientation calculation method achieves almost the same performance with the state-of-art intensity centroid orientation calculation method in a matching system. Hardware experiment result shows that the designed image process core supports to process VGA (640×480) videos at a process speed of 1306 fps and with a delay of 0.8083 ms/frame.

Publication: IEICE TRANSACTIONS on Information Vol.E101-D No.5 pp.1260-1269

Publication Date: 2018/05/01

Publicized: 2018/02/16

Online ISSN: 1745-1361

DOI: 10.1587/transinf.2017MVP0012

Type of Manuscript: Special Section PAPER (Special Section on Machine Vision and its Applications)

Category: Machine Vision and its Applications

Authors

Tingting HU
Waseda University
Takeshi IKENAGA
Waseda University

Keyword

high frame rate and ultra-low delay image processing, local binary feature based matching, keypoint orientation calculation, FPGA

Cite this

Copy

Tingting HU, Takeshi IKENAGA, "Pixel Selection and Intensity Directed Symmetry for High Frame Rate and Ultra-Low Delay Matching System" in IEICE TRANSACTIONS on Information, vol. E101-D, no. 5, pp. 1260-1269, May 2018, doi: 10.1587/transinf.2017MVP0012.
Abstract: High frame rate and ultra-low delay matching system plays an increasingly important role in human-machine interactive applications which call for higher frame rate and lower delay for a better experience. The large amount of processing data and the complex computation in a local feature based matching system, make it difficult to achieve a high process speed and ultra-low delay matching with limited resource. Aiming at a matching system with the process speed of more than 1000 fps and with the delay of less than 1 ms/frame, this paper puts forward a local binary feature based matching system with field-programmable gate array (FPGA). Pixel selection based 4-1-4 parallel matching and intensity directed symmetry are proposed for the implementation of this system. To design a basic framework with the high process speed and ultra-low delay using limited resource, pixel selection based 4-1-4 parallel matching is proposed, which makes it possible to use only one-thread resource consumption to achieve a four-thread processing. Assumes that the orientation of the keypoint will bisect the patch best and will point to the region with high intensity, intensity directed symmetry is proposed to calculate the keypoint orientation in a hardware friendly way, which is an important part for a rotation-robust matching system. Software experiment result shows that the proposed keypoint orientation calculation method achieves almost the same performance with the state-of-art intensity centroid orientation calculation method in a matching system. Hardware experiment result shows that the designed image process core supports to process VGA (640×480) videos at a process speed of 1306 fps and with a delay of 0.8083 ms/frame.
URL: https://global.ieice.org/en_transactions/information/10.1587/transinf.2017MVP0012/_p

Copy

@ARTICLE{e101-d_5_1260,
author={Tingting HU, Takeshi IKENAGA, },
journal={IEICE TRANSACTIONS on Information},
title={Pixel Selection and Intensity Directed Symmetry for High Frame Rate and Ultra-Low Delay Matching System},
year={2018},
volume={E101-D},
number={5},
pages={1260-1269},
abstract={High frame rate and ultra-low delay matching system plays an increasingly important role in human-machine interactive applications which call for higher frame rate and lower delay for a better experience. The large amount of processing data and the complex computation in a local feature based matching system, make it difficult to achieve a high process speed and ultra-low delay matching with limited resource. Aiming at a matching system with the process speed of more than 1000 fps and with the delay of less than 1 ms/frame, this paper puts forward a local binary feature based matching system with field-programmable gate array (FPGA). Pixel selection based 4-1-4 parallel matching and intensity directed symmetry are proposed for the implementation of this system. To design a basic framework with the high process speed and ultra-low delay using limited resource, pixel selection based 4-1-4 parallel matching is proposed, which makes it possible to use only one-thread resource consumption to achieve a four-thread processing. Assumes that the orientation of the keypoint will bisect the patch best and will point to the region with high intensity, intensity directed symmetry is proposed to calculate the keypoint orientation in a hardware friendly way, which is an important part for a rotation-robust matching system. Software experiment result shows that the proposed keypoint orientation calculation method achieves almost the same performance with the state-of-art intensity centroid orientation calculation method in a matching system. Hardware experiment result shows that the designed image process core supports to process VGA (640×480) videos at a process speed of 1306 fps and with a delay of 0.8083 ms/frame.},
keywords={},
doi={10.1587/transinf.2017MVP0012},
ISSN={1745-1361},
month={May},}

Copy

TY - JOUR
TI - Pixel Selection and Intensity Directed Symmetry for High Frame Rate and Ultra-Low Delay Matching System
T2 - IEICE TRANSACTIONS on Information
SP - 1260
EP - 1269
AU - Tingting HU
AU - Takeshi IKENAGA
PY - 2018
DO - 10.1587/transinf.2017MVP0012
JO - IEICE TRANSACTIONS on Information
SN - 1745-1361
VL - E101-D
IS - 5
JA - IEICE TRANSACTIONS on Information
Y1 - May 2018
AB - High frame rate and ultra-low delay matching system plays an increasingly important role in human-machine interactive applications which call for higher frame rate and lower delay for a better experience. The large amount of processing data and the complex computation in a local feature based matching system, make it difficult to achieve a high process speed and ultra-low delay matching with limited resource. Aiming at a matching system with the process speed of more than 1000 fps and with the delay of less than 1 ms/frame, this paper puts forward a local binary feature based matching system with field-programmable gate array (FPGA). Pixel selection based 4-1-4 parallel matching and intensity directed symmetry are proposed for the implementation of this system. To design a basic framework with the high process speed and ultra-low delay using limited resource, pixel selection based 4-1-4 parallel matching is proposed, which makes it possible to use only one-thread resource consumption to achieve a four-thread processing. Assumes that the orientation of the keypoint will bisect the patch best and will point to the region with high intensity, intensity directed symmetry is proposed to calculate the keypoint orientation in a hardware friendly way, which is an important part for a rotation-robust matching system. Software experiment result shows that the proposed keypoint orientation calculation method achieves almost the same performance with the state-of-art intensity centroid orientation calculation method in a matching system. Hardware experiment result shows that the designed image process core supports to process VGA (640×480) videos at a process speed of 1306 fps and with a delay of 0.8083 ms/frame.
ER -