| |
Records |
Links |
|
Author  |
Angel D. Sappa; Juan A. Carvajal; Cristhian A. Aguilera; Miguel Oliveira; Dennis G. Romero; Boris X. Vintimilla |
|
| |
Title |
Wavelet-Based Visible and Infrared Image Fusion: A Comparative Study |
Type |
Journal Article |
| |
Year |
2016 |
Publication |
Sensors Journal |
Abbreviated Journal |
|
|
| |
Volume |
Vol. 16 |
Issue |
|
Pages |
pp. 1-15 |
|
| |
Keywords |
image fusion; fusion evaluation metrics; visible and infrared imaging; discrete wavelet transform |
|
| |
Abstract |
This paper evaluates different wavelet-based cross-spectral image fusion strategies adopted to merge visible and infrared images. The objective is to find the best setup independently of the evaluation metric used to measure the performance. Quantitative performance results are obtained with state of the art approaches together with adaptations proposed in the current work. The options evaluated in the current work result from the combination of different setups in the wavelet image decomposition stage together with different fusion strategies for the final merging stage that generates the resulting representation. Most of the approaches evaluate results according to the application for which they are intended for. Sometimes a human observer is selected to judge the quality of the obtained results. In the current work, quantitative values are considered in order to find correlations between setups and performance of obtained results; these correlations can be used to define a criteria for selecting the best fusion strategy for a given pair of cross-spectral images. The whole procedure is evaluated with a large set of correctly registered visible and infrared image pairs, including both Near InfraRed (NIR) and LongWave InfraRed (LWIR). |
|
| |
Address |
|
|
| |
Corporate Author |
|
Thesis |
|
|
| |
Publisher |
|
Place of Publication |
|
Editor |
|
|
| |
Language |
English |
Summary Language |
English |
Original Title |
|
|
| |
Series Editor |
|
Series Title |
|
Abbreviated Series Title |
|
|
| |
Series Volume |
|
Series Issue |
|
Edition |
|
|
| |
ISSN |
|
ISBN |
|
Medium |
|
|
| |
Area |
|
Expedition |
|
Conference |
|
|
| |
Notes |
|
Approved |
no |
|
| |
Call Number |
cidis @ cidis @ |
Serial |
47 |
|
| Permanent link to this record |
| |
|
| |
|
Author |
Angel D. Sappa; Cristhian A. Aguilera; Juan A. Carvajal Ayala; Miguel Oliveira; Dennis Romero; Boris X. Vintimilla; Ricardo Toledo |
|
| |
Title |
Monocular visual odometry: a cross-spectral image fusion based approach |
Type |
Journal Article |
| |
Year |
2016 |
Publication |
Robotics and Autonomous Systems Journal |
Abbreviated Journal |
|
|
| |
Volume |
Vol. 86 |
Issue |
|
Pages |
pp. 26-36 |
|
| |
Keywords |
Monocular visual odometry LWIR-RGB cross-spectral imaging Image fusion |
|
| |
Abstract |
This manuscript evaluates the usage of fused cross-spectral images in a monocular visual odometry approach. Fused images are obtained through a Discrete Wavelet Transform (DWT) scheme, where the best setup is em- pirically obtained by means of a mutual information based evaluation met- ric. The objective is to have a exible scheme where fusion parameters are adapted according to the characteristics of the given images. Visual odom- etry is computed from the fused monocular images using an off the shelf approach. Experimental results using data sets obtained with two different platforms are presented. Additionally, comparison with a previous approach as well as with monocular-visible/infrared spectra are also provided showing the advantages of the proposed scheme. |
|
| |
Address |
|
|
| |
Corporate Author |
|
Thesis |
|
|
| |
Publisher |
|
Place of Publication |
|
Editor |
|
|
| |
Language |
Enlgish |
Summary Language |
English |
Original Title |
|
|
| |
Series Editor |
|
Series Title |
|
Abbreviated Series Title |
|
|
| |
Series Volume |
|
Series Issue |
|
Edition |
|
|
| |
ISSN |
|
ISBN |
|
Medium |
|
|
| |
Area |
|
Expedition |
|
Conference |
|
|
| |
Notes |
|
Approved |
no |
|
| |
Call Number |
cidis @ cidis @ |
Serial |
54 |
|
| Permanent link to this record |
| |
|
| |
|
Author |
Cristhian A. Aguilera, Cristhian Aguilera, Cristóbal A. Navarro, & Angel D. Sappa |
|
| |
Title |
Fast CNN Stereo Depth Estimation through Embedded GPU Devices |
Type |
Journal Article |
| |
Year |
2020 |
Publication |
Sensors 2020 |
Abbreviated Journal |
|
|
| |
Volume |
Vol. 2020-June |
Issue |
11 |
Pages |
pp. 1-13 |
|
| |
Keywords |
stereo matching; deep learning; embedded GPU |
|
| |
Abstract |
Current CNN-based stereo depth estimation models can barely run under real-time
constraints on embedded graphic processing unit (GPU) devices. Moreover, state-of-the-art
evaluations usually do not consider model optimization techniques, being that it is unknown what is
the current potential on embedded GPU devices. In this work, we evaluate two state-of-the-art models
on three different embedded GPU devices, with and without optimization methods, presenting
performance results that illustrate the actual capabilities of embedded GPU devices for stereo depth
estimation. More importantly, based on our evaluation, we propose the use of a U-Net like architecture
for postprocessing the cost-volume, instead of a typical sequence of 3D convolutions, drastically
augmenting the runtime speed of current models. In our experiments, we achieve real-time inference
speed, in the range of 5–32 ms, for 1216 368 input stereo images on the Jetson TX2, Jetson Xavier,
and Jetson Nano embedded devices. |
|
| |
Address |
|
|
| |
Corporate Author |
|
Thesis |
|
|
| |
Publisher |
|
Place of Publication |
|
Editor |
|
|
| |
Language |
English |
Summary Language |
English |
Original Title |
|
|
| |
Series Editor |
|
Series Title |
|
Abbreviated Series Title |
|
|
| |
Series Volume |
|
Series Issue |
|
Edition |
|
|
| |
ISSN |
14248220 |
ISBN |
|
Medium |
|
|
| |
Area |
|
Expedition |
|
Conference |
|
|
| |
Notes |
|
Approved |
no |
|
| |
Call Number |
cidis @ cidis @ |
Serial |
132 |
|
| Permanent link to this record |
| |
|
| |
|
Author |
Cristhian A. Aguilera; Angel D. Sappa; R. Toledo |
|
| |
Title |
LGHD: A feature descriptor for matching across non-linear intensity variations |
Type |
Conference Article |
| |
Year |
2015 |
Publication |
IEEE International Conference on, Quebec City, QC, 2015 |
Abbreviated Journal |
|
|
| |
Volume |
|
Issue |
|
Pages |
178 - 181 |
|
| |
Keywords |
Feature descriptor, multi-modal, multispectral, NIR, LWIR |
|
| |
Abstract |
This paper presents a new feature descriptor suitable to the task of matching features points between images with nonlinear intensity variations. This includes image pairs with significant illuminations changes, multi-modal image pairs and multi-spectral image pairs. The proposed method describes the neighbourhood of feature points combining frequency and spatial information using multi-scale and multi-oriented Log- Gabor filters. Experimental results show the validity of the proposed approach and also the improvements with respect to the state of the art. |
|
| |
Address |
|
|
| |
Corporate Author |
|
Thesis |
|
|
| |
Publisher |
IEEE |
Place of Publication |
Quebec City, QC, Canada |
Editor |
|
|
| |
Language |
English |
Summary Language |
English |
Original Title |
|
|
| |
Series Editor |
|
Series Title |
|
Abbreviated Series Title |
|
|
| |
Series Volume |
|
Series Issue |
|
Edition |
|
|
| |
ISSN |
|
ISBN |
|
Medium |
|
|
| |
Area |
|
Expedition |
|
Conference |
2015 IEEE International Conference on Image Processing (ICIP) |
|
| |
Notes |
|
Approved |
no |
|
| |
Call Number |
cidis @ cidis @ |
Serial |
40 |
|
| Permanent link to this record |
| |
|
| |
|
Author |
Cristhian A. Aguilera; Angel D. Sappa; Ricardo Toledo |
|
| |
Title |
Cross-Spectral Local Descriptors via Quadruplet Network |
Type |
Journal Article |
| |
Year |
2017 |
Publication |
In Sensors Journal |
Abbreviated Journal |
|
|
| |
Volume |
Vol. 17 |
Issue |
|
Pages |
pp. 873 |
|
| |
Keywords |
|
|
| |
Abstract |
|
|
| |
Address |
|
|
| |
Corporate Author |
|
Thesis |
|
|
| |
Publisher |
|
Place of Publication |
|
Editor |
|
|
| |
Language |
|
Summary Language |
|
Original Title |
|
|
| |
Series Editor |
|
Series Title |
|
Abbreviated Series Title |
|
|
| |
Series Volume |
|
Series Issue |
|
Edition |
|
|
| |
ISSN |
|
ISBN |
|
Medium |
|
|
| |
Area |
|
Expedition |
|
Conference |
|
|
| |
Notes |
|
Approved |
no |
|
| |
Call Number |
gtsi @ user @ |
Serial |
64 |
|
| Permanent link to this record |
| |
|
| |
|
Author |
Cristhian A. Aguilera; Cristhian Aguilera; Angel D. Sappa |
|
| |
Title |
Melamine faced panels defect classification beyond the visible spectrum. |
Type |
Journal Article |
| |
Year |
2018 |
Publication |
In Sensors 2018 |
Abbreviated Journal |
|
|
| |
Volume |
Vol. 11 |
Issue |
Issue 11 |
Pages |
|
|
| |
Keywords |
|
|
| |
Abstract |
In this work, we explore the use of images from different spectral bands to classify defects in melamine faced panels, which could appear through the production process. Through experimental evaluation, we evaluate the use of images from the visible (VS), near-infrared (NIR), and long wavelength infrared (LWIR), to classify the defects using a feature descriptor learning approach together with a support vector machine classifier. Two descriptors were evaluated, Extended Local Binary Patterns (E-LBP) and SURF using a Bag of Words (BoW) representation. The evaluation was carried on with an image set obtained during this work, which contained five different defect categories that currently occurs in the industry. Results show that using images from beyond
the visual spectrum helps to improve classification performance in contrast with a single visible spectrum solution. |
|
| |
Address |
|
|
| |
Corporate Author |
|
Thesis |
|
|
| |
Publisher |
|
Place of Publication |
|
Editor |
|
|
| |
Language |
|
Summary Language |
|
Original Title |
|
|
| |
Series Editor |
|
Series Title |
|
Abbreviated Series Title |
|
|
| |
Series Volume |
|
Series Issue |
|
Edition |
|
|
| |
ISSN |
|
ISBN |
|
Medium |
|
|
| |
Area |
|
Expedition |
|
Conference |
|
|
| |
Notes |
|
Approved |
no |
|
| |
Call Number |
gtsi @ user @ |
Serial |
89 |
|
| Permanent link to this record |
| |
|
| |
|
Author |
Cristhian A. Aguilera; Francisco J. Aguilera; Angel D. Sappa; Ricardo Toledo |
|
| |
Title |
Learning crossspectral similarity measures with deep convolutional neural networks |
Type |
Conference Article |
| |
Year |
2016 |
Publication |
IEEE International Conference on Computer Vision and Pattern Recognition (CVPR) Workshops |
Abbreviated Journal |
|
|
| |
Volume |
|
Issue |
|
Pages |
267-275 |
|
| |
Keywords |
|
|
| |
Abstract |
The simultaneous use of images from different spectra can be helpful to improve the performance of many com- puter vision tasks. The core idea behind the usage of cross- spectral approaches is to take advantage of the strengths of each spectral band providing a richer representation of a scene, which cannot be obtained with just images from one spectral band. In this work we tackle the cross-spectral image similarity problem by using Convolutional Neural Networks (CNNs). We explore three different CNN archi- tectures to compare the similarity of cross-spectral image patches. Specifically, we train each network with images from the visible and the near-infrared spectrum, and then test the result with two public cross-spectral datasets. Ex- perimental results show that CNN approaches outperform the current state-of-art on both cross-spectral datasets. Ad- ditionally, our experiments show that some CNN architec- tures are capable of generalizing between different cross- spectral domains. |
|
| |
Address |
|
|
| |
Corporate Author |
|
Thesis |
|
|
| |
Publisher |
|
Place of Publication |
|
Editor |
|
|
| |
Language |
English |
Summary Language |
English |
Original Title |
|
|
| |
Series Editor |
|
Series Title |
|
Abbreviated Series Title |
|
|
| |
Series Volume |
|
Series Issue |
|
Edition |
|
|
| |
ISSN |
|
ISBN |
|
Medium |
|
|
| |
Area |
|
Expedition |
|
Conference |
|
|
| |
Notes |
|
Approved |
no |
|
| |
Call Number |
cidis @ cidis @ |
Serial |
48 |
|
| Permanent link to this record |
| |
|
| |
|
Author |
Cristhian A. Aguilera; Xaver Soria; Angel D. Sappa; Ricardo Toledo |
|
| |
Title |
RGBN Multispectral Images: a Novel Color Restoration Approach |
Type |
Conference Article |
| |
Year |
2017 |
Publication |
15th International Conference on Practical Applications of Agents and Multi-Agent Systems |
Abbreviated Journal |
|
|
| |
Volume |
619 |
Issue |
|
Pages |
155-163 |
|
| |
Keywords |
|
|
| |
Abstract |
|
|
| |
Address |
|
|
| |
Corporate Author |
|
Thesis |
|
|
| |
Publisher |
|
Place of Publication |
|
Editor |
|
|
| |
Language |
|
Summary Language |
|
Original Title |
|
|
| |
Series Editor |
|
Series Title |
|
Abbreviated Series Title |
|
|
| |
Series Volume |
|
Series Issue |
|
Edition |
|
|
| |
ISSN |
|
ISBN |
|
Medium |
|
|
| |
Area |
|
Expedition |
|
Conference |
|
|
| |
Notes |
|
Approved |
no |
|
| |
Call Number |
cidis @ cidis @ |
Serial |
59 |
|
| Permanent link to this record |
| |
|
| |
|
Author |
Julien Poujol; Cristhian A. Aguilera; Etienne Danos; Boris X. Vintimilla; Ricardo Toledo; Angel D. Sappa |
|
| |
Title |
A visible-Thermal Fusion based Monocular Visual Odometry |
Type |
Conference Article |
| |
Year |
2015 |
Publication |
Iberian Robotics Conference (ROBOT 2015), International Conference on, Lisbon, Portugal, 2015 |
Abbreviated Journal |
|
|
| |
Volume |
417 |
Issue |
|
Pages |
517-528 |
|
| |
Keywords |
Monocular Visual Odometry; LWIR-RGB cross-spectral Imaging; Image Fusion |
|
| |
Abstract |
The manuscript evaluates the performance of a monocular visual odometry approach when images from different spectra are considered, both independently and fused. The objective behind this evaluation is to analyze if classical approaches can be improved when the given images, which are from different spectra, are fused and represented in new domains. The images in these new domains should have some of the following properties: i) more robust to noisy data; ii) less sensitive to changes (e.g., lighting); iii) more rich in descriptive information, among other. In particular in the current work two different image fusion strategies are considered. Firstly, images from the visible and thermal spectrum are fused using a Discrete Wavelet Transform (DWT) approach. Secondly, a monochrome threshold strategy is considered. The obtained representations are evaluated under a visual odometry framework, highlighting their advantages and disadvantages, using different urban and semi-urban scenarios. Comparisons with both monocular-visible spectrum and monocular-infrared spectrum, are also provided showing the validity of the proposed approach. |
|
| |
Address |
|
|
| |
Corporate Author |
|
Thesis |
|
|
| |
Publisher |
|
Place of Publication |
|
Editor |
|
|
| |
Language |
English |
Summary Language |
English |
Original Title |
|
|
| |
Series Editor |
|
Series Title |
|
Abbreviated Series Title |
|
|
| |
Series Volume |
|
Series Issue |
|
Edition |
|
|
| |
ISSN |
|
ISBN |
|
Medium |
|
|
| |
Area |
|
Expedition |
|
Conference |
|
|
| |
Notes |
|
Approved |
no |
|
| |
Call Number |
cidis @ cidis @ |
Serial |
44 |
|
| Permanent link to this record |
| |
|
| |
|
Author |
Mildred Cruz; Cristhian A. Aguilera; Boris X. Vintimilla; Ricardo Toledo; Ángel D. Sappa |
|
| |
Title |
Cross-spectral image registration and fusion: an evaluation study |
Type |
Conference Article |
| |
Year |
2015 |
Publication |
2nd International Conference on Machine Vision and Machine Learning |
Abbreviated Journal |
|
|
| |
Volume |
331 |
Issue |
|
Pages |
|
|
| |
Keywords |
multispectral imaging; image registration; data fusion; infrared and visible spectra |
|
| |
Abstract |
This paper presents a preliminary study on the registration and fusion of cross-spectral imaging. The objective is to evaluate the validity of widely used computer vision approaches when they are applied at different spectral bands. In particular, we are interested in merging images from the infrared (both long wave infrared: LWIR and near infrared: NIR) and visible spectrum (VS). Experimental results with different data sets are presented. |
|
| |
Address |
|
|
| |
Corporate Author |
|
Thesis |
|
|
| |
Publisher |
Computer Vision Center |
Place of Publication |
Barcelona, Spain |
Editor |
|
|
| |
Language |
English |
Summary Language |
English |
Original Title |
|
|
| |
Series Editor |
|
Series Title |
|
Abbreviated Series Title |
|
|
| |
Series Volume |
|
Series Issue |
|
Edition |
|
|
| |
ISSN |
|
ISBN |
|
Medium |
|
|
| |
Area |
|
Expedition |
|
Conference |
|
|
| |
Notes |
|
Approved |
no |
|
| |
Call Number |
cidis @ cidis @ |
Serial |
35 |
|
| Permanent link to this record |
