| |
Records |
Links |
|
Author |
Cristina L. Abad; Yi Lu; Roy H. Campbell |
|
| |
Title |
DARE: Adaptive Data Replication for Efficient Cluster Scheduling |
Type |
Conference Article |
| |
Year |
2011 |
Publication |
IEEE International Conference on Cluster Computing, 2011 |
Abbreviated Journal |
|
|
| |
Volume |
|
Issue |
|
Pages |
159 - 168 |
|
| |
Keywords |
MapReduce, replication, scheduling, locality |
|
| |
Abstract |
Placing data as close as possible to computation is a common practice of data intensive systems, commonly referred to as the data locality problem. By analyzing existing production systems, we confirm the benefit of data locality and find that data have different popularity and varying correlation of accesses. We propose DARE, a distributed adaptive data replication algorithm that aids the scheduler to achieve better data locality. DARE solves two problems, how many replicas to allocate for each file and where to place them, using probabilistic sampling and a competitive aging algorithm independently at each node. It takes advantage of existing remote data accesses in the system and incurs no extra network usage. Using two mixed workload traces from Facebook, we show that DARE improves data locality by more than 7 times with the FIFO scheduler in Hadoop and achieves more than 85% data locality for the FAIR scheduler with delay scheduling. Turnaround time and job slowdown are reduced by 19% and 25%, respectively. |
|
| |
Address |
|
|
| |
Corporate Author |
|
Thesis |
|
|
| |
Publisher |
|
Place of Publication |
|
Editor |
|
|
| |
Language |
English |
Summary Language |
English |
Original Title |
|
|
| |
Series Editor |
|
Series Title |
|
Abbreviated Series Title |
|
|
| |
Series Volume |
|
Series Issue  |
|
Edition |
|
|
| |
ISSN |
|
ISBN |
|
Medium |
|
|
| |
Area |
|
Expedition |
|
Conference |
|
|
| |
Notes |
|
Approved |
yes |
|
| |
Call Number |
cidis @ cidis @ |
Serial |
21 |
|
| Permanent link to this record |
| |
|
| |
|
Author |
Xavier Soria; Angel D. Sappa |
|
| |
Title |
Improving Edge Detection in RGB Images by Adding NIR Channel. |
Type |
Conference Article |
| |
Year |
2018 |
Publication |
14th IEEE International Conference on Signal Image Technology & Internet based Systems (SITIS 2018) |
Abbreviated Journal |
|
|
| |
Volume |
|
Issue |
|
Pages |
266-273 |
|
| |
Keywords |
|
|
| |
Abstract |
|
|
| |
Address |
|
|
| |
Corporate Author |
|
Thesis |
|
|
| |
Publisher |
|
Place of Publication |
|
Editor |
|
|
| |
Language |
|
Summary Language |
|
Original Title |
|
|
| |
Series Editor |
|
Series Title |
|
Abbreviated Series Title |
|
|
| |
Series Volume |
|
Series Issue |
|
Edition |
|
|
| |
ISSN |
|
ISBN |
|
Medium |
|
|
| |
Area |
|
Expedition |
|
Conference |
|
|
| |
Notes |
|
Approved |
no |
|
| |
Call Number |
gtsi @ user @ |
Serial |
95 |
|
| Permanent link to this record |
| |
|
| |
|
Author |
Xavier Soria; Angel D. Sappa; Riad Hammoud |
|
| |
Title |
Wide-Band Color Imagery Restoration for RGB-NIR Single Sensor Image. Sensors 2018 ,2059. |
Type |
Journal Article |
| |
Year |
2018 |
Publication |
|
Abbreviated Journal |
|
|
| |
Volume |
Vol. 18 |
Issue |
Issue 7 |
Pages |
|
|
| |
Keywords |
|
|
| |
Abstract |
Multi-spectral RGB-NIR sensors have become ubiquitous in recent years. These sensors allow the visible and near-infrared spectral bands of a given scene to be captured at the same time. With such cameras, the acquired imagery has a compromised RGB color representation due to near-infrared bands (700–1100 nm) cross-talking with the visible bands (400–700 nm). This paper proposes two deep learning-based architectures to recover the full RGB color images, thus removing the NIR information from the visible bands. The proposed approaches directly restore the high-resolution RGB image by means of convolutional neural networks. They are evaluated with several outdoor images; both architectures reach a similar performance when evaluated in different scenarios and using different similarity metrics. Both of them improve the state of the art approaches. |
|
| |
Address |
|
|
| |
Corporate Author |
|
Thesis |
|
|
| |
Publisher |
|
Place of Publication |
|
Editor |
|
|
| |
Language |
|
Summary Language |
|
Original Title |
|
|
| |
Series Editor |
|
Series Title |
|
Abbreviated Series Title |
|
|
| |
Series Volume |
|
Series Issue |
|
Edition |
|
|
| |
ISSN |
|
ISBN |
|
Medium |
|
|
| |
Area |
|
Expedition |
|
Conference |
|
|
| |
Notes |
|
Approved |
no |
|
| |
Call Number |
gtsi @ user @ |
Serial |
96 |
|
| Permanent link to this record |
| |
|
| |
|
Author |
Patricia L. Suarez; Angel D. Sappa; Boris X. Vintimilla |
|
| |
Title |
Cross-spectral image dehaze through a dense stacked conditional GAN based approach. |
Type |
Conference Article |
| |
Year |
2018 |
Publication |
14th IEEE International Conference on Signal Image Technology & Internet based Systems (SITIS 2018) |
Abbreviated Journal |
|
|
| |
Volume |
|
Issue |
|
Pages |
358-364 |
|
| |
Keywords |
|
|
| |
Abstract |
This paper proposes a novel approach to remove haze from RGB images using a near infrared images based on a dense stacked conditional Generative Adversarial Network (CGAN). The architecture of the deep network implemented receives, besides the images with haze, its corresponding image in the near infrared spectrum, which serve to accelerate the learning process of the details of the characteristics of the images. The model uses a triplet layer that allows the independence learning of each channel of the visible spectrum image to remove the haze on each color channel separately. A multiple loss function scheme is proposed, which ensures balanced learning between the colors and the structure of the images. Experimental results have shown that the proposed method effectively removes the haze from the images. Additionally, the proposed approach is compared with a state of the art approach showing better results. |
|
| |
Address |
|
|
| |
Corporate Author |
|
Thesis |
|
|
| |
Publisher |
|
Place of Publication |
|
Editor |
|
|
| |
Language |
|
Summary Language |
|
Original Title |
|
|
| |
Series Editor |
|
Series Title |
|
Abbreviated Series Title |
|
|
| |
Series Volume |
|
Series Issue |
|
Edition |
|
|
| |
ISSN |
|
ISBN |
|
Medium |
|
|
| |
Area |
|
Expedition |
|
Conference |
|
|
| |
Notes |
|
Approved |
no |
|
| |
Call Number |
gtsi @ user @ |
Serial |
92 |
|
| Permanent link to this record |
