Wi-FLIP: A wireless smart camera based on a focal-plane low-power image processor

Jorge Fernández-Berni, Ricardo Carmona-Galán, Gustavo Liñán-Cembrano, A. Zarándy, Ángel Rodríguez-Vázquez

Research output: Chapter in Book/Report/Conference proceedingConference contribution

8 Citations (Scopus)

Abstract

This paper presents Wi-FLIP, a vision-enabled WSN node resulting from the integration of FLIP-Q, a prototype vision chip, and Imotel, a commercial WSN platform. In Wi-FLIP, image processing is not only constrained to the digital domain like in conventional architectures. Instead, its image sensor - the FLIP-Q prototype - incorporates pixel-level processing elements (PEs) implemented by analog circuitry. These PEs are interconnected, rendering a massively parallel SIMD-based focal-plane array. Low-level image processing tasks fit very well into this processing scheme. They feature a heavy computational load composed of pixel-wise repetitive operations which can be realized in parallel with moderate accuracy. In such circumstances, analog circuitry, not very precise but faster and more area- and power-efficient than its digital counterpart, has been extensively reported to achieve better performance. The Wi-FLIP's image sensor does not therefore output raw but pre-processed images that make the subsequent digital processing much lighter. The energy cost of such pre-processing is really low - 5.6mW for the worst-case scenario. As a result, for the configuration where the Imote2's processor works at minimum clock frequency, the maximum power consumed by our prototype represents only the 5.2% of the whole system power consumption. This percentage gets even lower as the clock frequency increases. We report experimental results for different algorithms, image resolutions and clock frequencies. The main drawback of this first version of Wi-FLIP is the low frame rate reachable due to the non-standard GPIO-based FLIPQ-to-Imote2 interface.

Original languageEnglish
Title of host publication2011 5th ACM/IEEE International Conference on Distributed Smart Cameras, ICDSC 2011
DOIs
Publication statusPublished - 2011
Event2011 5th ACM/IEEE International Conference on Distributed Smart Cameras, ICDSC 2011 - Ghent, Belgium
Duration: Aug 22 2011Aug 25 2011

Other

Other2011 5th ACM/IEEE International Conference on Distributed Smart Cameras, ICDSC 2011
CountryBelgium
CityGhent
Period8/22/118/25/11

Fingerprint

Cameras
Clocks
Processing
Image sensors
Image processing
Pixels
Focal plane arrays
Image resolution
Digital signal processing
Electric power utilization
Costs

ASJC Scopus subject areas

  • Electrical and Electronic Engineering

Cite this

Fernández-Berni, J., Carmona-Galán, R., Liñán-Cembrano, G., Zarándy, A., & Rodríguez-Vázquez, Á. (2011). Wi-FLIP: A wireless smart camera based on a focal-plane low-power image processor. In 2011 5th ACM/IEEE International Conference on Distributed Smart Cameras, ICDSC 2011 [6042916] https://doi.org/10.1109/ICDSC.2011.6042916

Wi-FLIP : A wireless smart camera based on a focal-plane low-power image processor. / Fernández-Berni, Jorge; Carmona-Galán, Ricardo; Liñán-Cembrano, Gustavo; Zarándy, A.; Rodríguez-Vázquez, Ángel.

2011 5th ACM/IEEE International Conference on Distributed Smart Cameras, ICDSC 2011. 2011. 6042916.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Fernández-Berni, J, Carmona-Galán, R, Liñán-Cembrano, G, Zarándy, A & Rodríguez-Vázquez, Á 2011, Wi-FLIP: A wireless smart camera based on a focal-plane low-power image processor. in 2011 5th ACM/IEEE International Conference on Distributed Smart Cameras, ICDSC 2011., 6042916, 2011 5th ACM/IEEE International Conference on Distributed Smart Cameras, ICDSC 2011, Ghent, Belgium, 8/22/11. https://doi.org/10.1109/ICDSC.2011.6042916
Fernández-Berni J, Carmona-Galán R, Liñán-Cembrano G, Zarándy A, Rodríguez-Vázquez Á. Wi-FLIP: A wireless smart camera based on a focal-plane low-power image processor. In 2011 5th ACM/IEEE International Conference on Distributed Smart Cameras, ICDSC 2011. 2011. 6042916 https://doi.org/10.1109/ICDSC.2011.6042916
Fernández-Berni, Jorge ; Carmona-Galán, Ricardo ; Liñán-Cembrano, Gustavo ; Zarándy, A. ; Rodríguez-Vázquez, Ángel. / Wi-FLIP : A wireless smart camera based on a focal-plane low-power image processor. 2011 5th ACM/IEEE International Conference on Distributed Smart Cameras, ICDSC 2011. 2011.
@inproceedings{5faf15296ca04898aa746a3d59efdda5,
title = "Wi-FLIP: A wireless smart camera based on a focal-plane low-power image processor",
abstract = "This paper presents Wi-FLIP, a vision-enabled WSN node resulting from the integration of FLIP-Q, a prototype vision chip, and Imotel, a commercial WSN platform. In Wi-FLIP, image processing is not only constrained to the digital domain like in conventional architectures. Instead, its image sensor - the FLIP-Q prototype - incorporates pixel-level processing elements (PEs) implemented by analog circuitry. These PEs are interconnected, rendering a massively parallel SIMD-based focal-plane array. Low-level image processing tasks fit very well into this processing scheme. They feature a heavy computational load composed of pixel-wise repetitive operations which can be realized in parallel with moderate accuracy. In such circumstances, analog circuitry, not very precise but faster and more area- and power-efficient than its digital counterpart, has been extensively reported to achieve better performance. The Wi-FLIP's image sensor does not therefore output raw but pre-processed images that make the subsequent digital processing much lighter. The energy cost of such pre-processing is really low - 5.6mW for the worst-case scenario. As a result, for the configuration where the Imote2's processor works at minimum clock frequency, the maximum power consumed by our prototype represents only the 5.2{\%} of the whole system power consumption. This percentage gets even lower as the clock frequency increases. We report experimental results for different algorithms, image resolutions and clock frequencies. The main drawback of this first version of Wi-FLIP is the low frame rate reachable due to the non-standard GPIO-based FLIPQ-to-Imote2 interface.",
author = "Jorge Fern{\'a}ndez-Berni and Ricardo Carmona-Gal{\'a}n and Gustavo Li{\~n}{\'a}n-Cembrano and A. Zar{\'a}ndy and {\'A}ngel Rodr{\'i}guez-V{\'a}zquez",
year = "2011",
doi = "10.1109/ICDSC.2011.6042916",
language = "English",
isbn = "9781457717086",
booktitle = "2011 5th ACM/IEEE International Conference on Distributed Smart Cameras, ICDSC 2011",

}

TY - GEN

T1 - Wi-FLIP

T2 - A wireless smart camera based on a focal-plane low-power image processor

AU - Fernández-Berni, Jorge

AU - Carmona-Galán, Ricardo

AU - Liñán-Cembrano, Gustavo

AU - Zarándy, A.

AU - Rodríguez-Vázquez, Ángel

PY - 2011

Y1 - 2011

N2 - This paper presents Wi-FLIP, a vision-enabled WSN node resulting from the integration of FLIP-Q, a prototype vision chip, and Imotel, a commercial WSN platform. In Wi-FLIP, image processing is not only constrained to the digital domain like in conventional architectures. Instead, its image sensor - the FLIP-Q prototype - incorporates pixel-level processing elements (PEs) implemented by analog circuitry. These PEs are interconnected, rendering a massively parallel SIMD-based focal-plane array. Low-level image processing tasks fit very well into this processing scheme. They feature a heavy computational load composed of pixel-wise repetitive operations which can be realized in parallel with moderate accuracy. In such circumstances, analog circuitry, not very precise but faster and more area- and power-efficient than its digital counterpart, has been extensively reported to achieve better performance. The Wi-FLIP's image sensor does not therefore output raw but pre-processed images that make the subsequent digital processing much lighter. The energy cost of such pre-processing is really low - 5.6mW for the worst-case scenario. As a result, for the configuration where the Imote2's processor works at minimum clock frequency, the maximum power consumed by our prototype represents only the 5.2% of the whole system power consumption. This percentage gets even lower as the clock frequency increases. We report experimental results for different algorithms, image resolutions and clock frequencies. The main drawback of this first version of Wi-FLIP is the low frame rate reachable due to the non-standard GPIO-based FLIPQ-to-Imote2 interface.

AB - This paper presents Wi-FLIP, a vision-enabled WSN node resulting from the integration of FLIP-Q, a prototype vision chip, and Imotel, a commercial WSN platform. In Wi-FLIP, image processing is not only constrained to the digital domain like in conventional architectures. Instead, its image sensor - the FLIP-Q prototype - incorporates pixel-level processing elements (PEs) implemented by analog circuitry. These PEs are interconnected, rendering a massively parallel SIMD-based focal-plane array. Low-level image processing tasks fit very well into this processing scheme. They feature a heavy computational load composed of pixel-wise repetitive operations which can be realized in parallel with moderate accuracy. In such circumstances, analog circuitry, not very precise but faster and more area- and power-efficient than its digital counterpart, has been extensively reported to achieve better performance. The Wi-FLIP's image sensor does not therefore output raw but pre-processed images that make the subsequent digital processing much lighter. The energy cost of such pre-processing is really low - 5.6mW for the worst-case scenario. As a result, for the configuration where the Imote2's processor works at minimum clock frequency, the maximum power consumed by our prototype represents only the 5.2% of the whole system power consumption. This percentage gets even lower as the clock frequency increases. We report experimental results for different algorithms, image resolutions and clock frequencies. The main drawback of this first version of Wi-FLIP is the low frame rate reachable due to the non-standard GPIO-based FLIPQ-to-Imote2 interface.

UR - http://www.scopus.com/inward/record.url?scp=80055116921&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=80055116921&partnerID=8YFLogxK

U2 - 10.1109/ICDSC.2011.6042916

DO - 10.1109/ICDSC.2011.6042916

M3 - Conference contribution

AN - SCOPUS:80055116921

SN - 9781457717086

BT - 2011 5th ACM/IEEE International Conference on Distributed Smart Cameras, ICDSC 2011

ER -