31
Introduction Sim-LIT Conclusion and Future Works Sim-LIT: A simulation framework for image quality assessment in wireless visual sensor networks under packet loss conditions Eric Orellana-Romero * , Javier SanMartin-Hernandez * , Cristian Duran-Faundez * , Vincent Lecuire and Cristhian Aguilera * * Departamento de Ingenier´ ıa El´ ectrica y Electr´onica - Facultad de Ingenier´ ıa Universidad del B´ ıo-B´ ıo, Concepci´ on, Chile Centre de Recherche en Automatique de Nancy (CRAN) Universit´ e de Lorraine, CNRS, Vandœuvre-l` es-Nancy, France XXX International Conference of the Chilean Computer Science Society (SCCC’2011), Curic´o, Chile Eric Orellana-Romero et al (Contact E-mail: [email protected]) Sim-LIT: simulation framework for quality assessment in WVSNs 1 / 14

Sim-LIT: A simulation framework for image quality ...crduran.ubb.cl/old-html-based-site/publications/... · Wireless sensor networks and wireless camera sensor networks Packet loss

  • Upload
    others

  • View
    1

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Sim-LIT: A simulation framework for image quality ...crduran.ubb.cl/old-html-based-site/publications/... · Wireless sensor networks and wireless camera sensor networks Packet loss

IntroductionSim-LIT

Conclusion and Future Works

Sim-LIT: A simulation framework for image quality assessment inwireless visual sensor networks under packet loss conditions

Eric Orellana-Romero*, Javier SanMartin-Hernandez*,Cristian Duran-Faundez*, Vincent Lecuire† and Cristhian Aguilera*

*Departamento de Ingenierıa Electrica y Electronica - Facultad de IngenierıaUniversidad del Bıo-Bıo, Concepcion, Chile

†Centre de Recherche en Automatique de Nancy (CRAN)Universite de Lorraine, CNRS, Vandœuvre-les-Nancy, France

XXX International Conference of the Chilean Computer Science Society(SCCC’2011), Curico, Chile

Eric Orellana-Romero et al (Contact E-mail: [email protected]) Sim-LIT: simulation framework for quality assessment in WVSNs 1 / 14

Page 2: Sim-LIT: A simulation framework for image quality ...crduran.ubb.cl/old-html-based-site/publications/... · Wireless sensor networks and wireless camera sensor networks Packet loss

IntroductionSim-LIT

Conclusion and Future Works

Outline

1 Introduction

2 Sim-LIT

3 Conclusion and Future Works

Eric Orellana-Romero et al (Contact E-mail: [email protected]) Sim-LIT: simulation framework for quality assessment in WVSNs 2 / 14

Page 3: Sim-LIT: A simulation framework for image quality ...crduran.ubb.cl/old-html-based-site/publications/... · Wireless sensor networks and wireless camera sensor networks Packet loss

IntroductionSim-LIT

Conclusion and Future Works

Wireless sensor networks and wireless camera sensor networksPacket loss effects on visual sensor networksSimulation for WVSNs

Wireless Sensor Networks

Definition (Wireless Sensor Network (WSN))

A large-scale distributed system normally composed of a large number of very smalldevices called sensor nodes. These sensor nodes are able to measure certain physicalphenomena in the environment where they are deployed and to report its findings toone (or various) central gateway(s) (sink).

SinkSatellite,

Internet, ...

User

Sensor nodes

Event

Sensor field

A

B

C

D

E

F

Figure: A typical wireless sensor network

Typical measurements:

Temperature, light, magnetism, pressure, vibrations,

. . .

Applications

Military applications,

Environmental applications,

Industry, Robotics, Security, . . .

Concerns

At the node level: Limited energy, lowprocessing/storage capacities, low bitrates, . . .

At the network level: Large-scale, high-density, dynamic topology, high lossrates, . . .

Eric Orellana-Romero et al (Contact E-mail: [email protected]) Sim-LIT: simulation framework for quality assessment in WVSNs 3 / 14

Page 4: Sim-LIT: A simulation framework for image quality ...crduran.ubb.cl/old-html-based-site/publications/... · Wireless sensor networks and wireless camera sensor networks Packet loss

IntroductionSim-LIT

Conclusion and Future Works

Wireless sensor networks and wireless camera sensor networksPacket loss effects on visual sensor networksSimulation for WVSNs

Wireless Visual Sensor Networks

Definition (Wireless Visual Sensor Network (WVSN))

A WSN where one or several nodes have image sensors (cameras).

SinkSatellite,Internet, ...

User

F

E

D

C

A

B

Event

Sensor nodes

Sensor field

G

Figure: A wireless visual sensor network

Applications

Object recognition . . .

numbering . . .

localization, tracking, . . .

. . . of objects by vision.

Concerns

(All of the traditional WSNs)+

A more complex (expensive) sensor+

Large amount of data to process/transmit

Example of resource consumption a

a(using a Mica2 mote, data payload: 27 bytes, pout: -20dBm)

Capture/Transmission of 1 scalar measure:

Number of packets: 1 (actually, 1 byte of the packet)Energy consumption: <3 mJTime: <0.04 sec.

Capture/Transmission of 1 (128 × 128) 8bppimage (+ Cyclops camera)

Number of packets: 607

Energy consumption: ∼2358 mJ

Time: ∼29.9 s

Eric Orellana-Romero et al (Contact E-mail: [email protected]) Sim-LIT: simulation framework for quality assessment in WVSNs 4 / 14

Page 5: Sim-LIT: A simulation framework for image quality ...crduran.ubb.cl/old-html-based-site/publications/... · Wireless sensor networks and wireless camera sensor networks Packet loss

IntroductionSim-LIT

Conclusion and Future Works

Wireless sensor networks and wireless camera sensor networksPacket loss effects on visual sensor networksSimulation for WVSNs

The effects of packet loss

As one of the main issues in WSNs is energy consumption, image compressionseems an obvious solution. . .

Eric Orellana-Romero et al (Contact E-mail: [email protected]) Sim-LIT: simulation framework for quality assessment in WVSNs 5 / 14

Page 6: Sim-LIT: A simulation framework for image quality ...crduran.ubb.cl/old-html-based-site/publications/... · Wireless sensor networks and wireless camera sensor networks Packet loss

IntroductionSim-LIT

Conclusion and Future Works

Wireless sensor networks and wireless camera sensor networksPacket loss effects on visual sensor networksSimulation for WVSNs

The effects of packet loss

As one of the main issues in WSNs is energy consumption, image compressionseems an obvious solution. . . but wait!! Don’t forget about packet loss!!

Example (Considering JPEG image compression (3.4bpp) at the source node)

Original (128 × 128) image 1% packet loss 5% packet loss

Eric Orellana-Romero et al (Contact E-mail: [email protected]) Sim-LIT: simulation framework for quality assessment in WVSNs 5 / 14

Page 7: Sim-LIT: A simulation framework for image quality ...crduran.ubb.cl/old-html-based-site/publications/... · Wireless sensor networks and wireless camera sensor networks Packet loss

IntroductionSim-LIT

Conclusion and Future Works

Wireless sensor networks and wireless camera sensor networksPacket loss effects on visual sensor networksSimulation for WVSNs

The effects of packet loss

As one of the main issues in WSNs is energy consumption, image compressionseems an obvious solution. . . but wait!! Don’t forget about packet loss!!

In WSNs, packet loss can be important

Eric Orellana-Romero et al (Contact E-mail: [email protected]) Sim-LIT: simulation framework for quality assessment in WVSNs 5 / 14

Page 8: Sim-LIT: A simulation framework for image quality ...crduran.ubb.cl/old-html-based-site/publications/... · Wireless sensor networks and wireless camera sensor networks Packet loss

IntroductionSim-LIT

Conclusion and Future Works

Wireless sensor networks and wireless camera sensor networksPacket loss effects on visual sensor networksSimulation for WVSNs

The effects of packet loss

As one of the main issues in WSNs is energy consumption, image compressionseems an obvious solution. . . but wait!! Don’t forget about packet loss!!

In WSNs, packet loss can be important

(it can reach 40% and more)

Eric Orellana-Romero et al (Contact E-mail: [email protected]) Sim-LIT: simulation framework for quality assessment in WVSNs 5 / 14

Page 9: Sim-LIT: A simulation framework for image quality ...crduran.ubb.cl/old-html-based-site/publications/... · Wireless sensor networks and wireless camera sensor networks Packet loss

IntroductionSim-LIT

Conclusion and Future Works

Wireless sensor networks and wireless camera sensor networksPacket loss effects on visual sensor networksSimulation for WVSNs

The effects of packet loss

As one of the main issues in WSNs is energy consumption, image compressionseems an obvious solution. . . but wait!! Don’t forget about packet loss!!

In WSNs, packet loss can be important

Non compressed images are more resistant to packet loss

Example (Considering non-compression applied and 25% packet loss)

Original (128 × 128) image Received pixels Reconstructed image(Use of an error concealment method)

Eric Orellana-Romero et al (Contact E-mail: [email protected]) Sim-LIT: simulation framework for quality assessment in WVSNs 5 / 14

Page 10: Sim-LIT: A simulation framework for image quality ...crduran.ubb.cl/old-html-based-site/publications/... · Wireless sensor networks and wireless camera sensor networks Packet loss

IntroductionSim-LIT

Conclusion and Future Works

Wireless sensor networks and wireless camera sensor networksPacket loss effects on visual sensor networksSimulation for WVSNs

The effects of packet loss

As one of the main issues in WSNs is energy consumption, image compressionseems an obvious solution. . . but wait!! Don’t forget about packet loss!!

In WSNs, packet loss can be important

Non compressed images are more resistant to packet loss

Burst packet loss can be a problem

Example (Considering non-compression applied and 29% packet loss)

Original (128 × 128) image Received pixels Reconstructed image(Use of an error concealment method)

Eric Orellana-Romero et al (Contact E-mail: [email protected]) Sim-LIT: simulation framework for quality assessment in WVSNs 5 / 14

Page 11: Sim-LIT: A simulation framework for image quality ...crduran.ubb.cl/old-html-based-site/publications/... · Wireless sensor networks and wireless camera sensor networks Packet loss

IntroductionSim-LIT

Conclusion and Future Works

Wireless sensor networks and wireless camera sensor networksPacket loss effects on visual sensor networksSimulation for WVSNs

The effects of packet loss

As one of the main issues in WSNs is energy consumption, image compressionseems an obvious solution. . . but wait!! Don’t forget about packet loss!!

In WSNs, packet loss can be important

Non compressed images are more resistant to packet loss

Burst packet loss can be a problem

When we work with images over lossy environments, there is an evaluation factorto consider: loss data leads to quality losses

Possible solutions include:ACK, FEC based protocolsBlock interleaving. . .

Eric Orellana-Romero et al (Contact E-mail: [email protected]) Sim-LIT: simulation framework for quality assessment in WVSNs 5 / 14

Page 12: Sim-LIT: A simulation framework for image quality ...crduran.ubb.cl/old-html-based-site/publications/... · Wireless sensor networks and wireless camera sensor networks Packet loss

IntroductionSim-LIT

Conclusion and Future Works

Wireless sensor networks and wireless camera sensor networksPacket loss effects on visual sensor networksSimulation for WVSNs

Simulation of WVSNs

Simulation is, many times, required for validation

Few developments on simulation environments consider particular problemas ofWVSNs

Many adapt standard network or WSNs simulators (eg., OMNet++, Castalia, . . . )

Most of the times, adaptations over Matlab are used

Particular example oriented to WVSNs: WISE-MNet [Nastasi and Cavallaro, 2011](not focused on image quality issues)

C. Nastasi, A. Cavallaro (2011). “WiSE-MNet: an experimental environment for Wireless Multimedia SensorNetworks”. In : SSDP’2011.

Eric Orellana-Romero et al (Contact E-mail: [email protected]) Sim-LIT: simulation framework for quality assessment in WVSNs 6 / 14

Page 13: Sim-LIT: A simulation framework for image quality ...crduran.ubb.cl/old-html-based-site/publications/... · Wireless sensor networks and wireless camera sensor networks Packet loss

IntroductionSim-LIT

Conclusion and Future Works

Proposed simulation frameworkExecution, options and complementary toolsEvaluation

Proposed framework

Sim-LIT (Simulator for Lossy Image Transmission)

It is a simulation framework oriented to the analysis of images transmission schemesover lossy environments (such as WSNs)

It allows image quality assessments considering:image processing schemes at the source node (e.g. block interleaving), packet loss(during transmission), post-processing schemes at the decoder (e.g. error concealment)

OriginalImage

Source node

1 Forward ImageProcessing

2 Packetizer

3 Loss

Simulation

Decoder

5 Inverse ImageProcessing

4 DepacketizerReconstructedImage

Packet

6 ErrorConcealment

Figure: Simplified Sim-LIT’s simulation scheme.

Eric Orellana-Romero et al (Contact E-mail: [email protected]) Sim-LIT: simulation framework for quality assessment in WVSNs 7 / 14

Page 14: Sim-LIT: A simulation framework for image quality ...crduran.ubb.cl/old-html-based-site/publications/... · Wireless sensor networks and wireless camera sensor networks Packet loss

IntroductionSim-LIT

Conclusion and Future Works

Proposed simulation frameworkExecution, options and complementary toolsEvaluation

Sim-LIT features

Implementation details

Object-oriented programming

C++ language, g++ compiler

GNU/Linux

Image

Pixel

Mixer

Transfer

Psnr1

1..*1

1

1

1

Implemented Models

Generic simulation:An image is a H ×W matrix, I = {Ir,c}, each Ir,c containing b bpp

Packetization of I in q = ⌈ H×W×bm ⌉ packets, m = number of bits of image data per

packet

Communication scheme←→Γ , of P packets, where each packet has a probability pl of

being lostError concealment by averaging correctly received neighboring pixels

Block interleavingBijective function ϑ : I → I ′, where I ′ is a new bitmap with each block Bi,j → B′

i′,j′

Adapted interleaving considering B′i,j ← Bi′,j′

Eric Orellana-Romero et al (Contact E-mail: [email protected]) Sim-LIT: simulation framework for quality assessment in WVSNs 8 / 14

Page 15: Sim-LIT: A simulation framework for image quality ...crduran.ubb.cl/old-html-based-site/publications/... · Wireless sensor networks and wireless camera sensor networks Packet loss

IntroductionSim-LIT

Conclusion and Future Works

Proposed simulation frameworkExecution, options and complementary toolsEvaluation

Quality assessment

Subjective assessment (direct visualization)

Objective assessment (PSNR: Peak Signal-to-Noise Ratio)

PSNR = 10. log10

(

2552

MSE

)

where MSE is the Mean Squared Error: MSE = 1H.W

∑H−1r=0

∑W−1c=0 ||Ir,c − I ′′r,c ||

2

Example (with a 128× 128 8bpp grayscale image)

Original image PSNR = 29.01 dB PSNR = 27.56 dB PSNR = 26.17 dB

Eric Orellana-Romero et al (Contact E-mail: [email protected]) Sim-LIT: simulation framework for quality assessment in WVSNs 9 / 14

Page 16: Sim-LIT: A simulation framework for image quality ...crduran.ubb.cl/old-html-based-site/publications/... · Wireless sensor networks and wireless camera sensor networks Packet loss

IntroductionSim-LIT

Conclusion and Future Works

Proposed simulation frameworkExecution, options and complementary toolsEvaluation

Sample execution

Example of an execution line

$./simlit -ipath /sample/ -csf results -s27 -hb 2 -wb 2 -b 3 -loss-file/sample/loss-file 40 1.in -torus-mixer 1

8 -adapted-interleaving-simulation-rep-file-data-graphic

Figure: Original image

Camera node

Decoder

_____.bmp(OriginalImage)

_____.mix-res.bmp(Reconstructed

Image afterInterleaving)

_____.trad-res.bmp(ReconstructedImage with no

Interleaving

HB , WB , b, Method, . . .

Applied)

_____.mix.bmp(interleaved bitmap)_____.mix-re .bmp

(interleaved bitmap with losses)

_____.mix-re -org.bmp(bitmap with losses afterinverse interleaved)

_____.trad-re .bmp(received bitmap with losses)

Method,keys

Payload

Loss rate

Loss-pattern file

Coding Packetizer

ForwardInterleaving

LossPacket

Simulation

Depacketizer

InverseInterleaving

DecodingError

Concealment

Eric Orellana-Romero et al (Contact E-mail: [email protected]) Sim-LIT: simulation framework for quality assessment in WVSNs 10 / 14

Page 17: Sim-LIT: A simulation framework for image quality ...crduran.ubb.cl/old-html-based-site/publications/... · Wireless sensor networks and wireless camera sensor networks Packet loss

IntroductionSim-LIT

Conclusion and Future Works

Proposed simulation frameworkExecution, options and complementary toolsEvaluation

Sample execution

Example of an execution line

$./simlit -ipath /sample/ -csf results -s27 -hb 2 -wb 2 -b 3 -loss-file/sample/loss-file 40 1.in -torus-mixer 1

8 -adapted-interleaving-simulation-rep-file-data-graphic

Figure: Received image - S.T.

Camera node

Decoder

_____.bmp(OriginalImage)

_____.mix-res.bmp(Reconstructed

Image afterInterleaving)

_____.trad-res.bmp(ReconstructedImage with no

Interleaving

HB , WB , b, Method, . . .

Applied)

_____.mix.bmp(interleaved bitmap)_____.mix-re .bmp

(interleaved bitmap with losses)

_____.mix-re -org.bmp(bitmap with losses afterinverse interleaved)

_____.trad-re .bmp(received bitmap with losses)

Method,keys

Payload

Loss rate

Loss-pattern file

Coding Packetizer

ForwardInterleaving

LossPacket

Simulation

Depacketizer

InverseInterleaving

DecodingError

Concealment

Eric Orellana-Romero et al (Contact E-mail: [email protected]) Sim-LIT: simulation framework for quality assessment in WVSNs 10 / 14

Page 18: Sim-LIT: A simulation framework for image quality ...crduran.ubb.cl/old-html-based-site/publications/... · Wireless sensor networks and wireless camera sensor networks Packet loss

IntroductionSim-LIT

Conclusion and Future Works

Proposed simulation frameworkExecution, options and complementary toolsEvaluation

Sample execution

Example of an execution line

$./simlit -ipath /sample/ -csf results -s27 -hb 2 -wb 2 -b 3 -loss-file/sample/loss-file 40 1.in -torus-mixer 1

8 -adapted-interleaving-simulation-rep-file-data-graphic

Figure: Reconstructed image - S.T.

Camera node

Decoder

_____.bmp(OriginalImage)

_____.mix-res.bmp(Reconstructed

Image afterInterleaving)

_____.trad-res.bmp(ReconstructedImage with no

Interleaving

HB , WB , b, Method, . . .

Applied)

_____.mix.bmp(interleaved bitmap)_____.mix-re .bmp

(interleaved bitmap with losses)

_____.mix-re -org.bmp(bitmap with losses afterinverse interleaved)

_____.trad-re .bmp(received bitmap with losses)

Method,keys

Payload

Loss rate

Loss-pattern file

Coding Packetizer

ForwardInterleaving

LossPacket

Simulation

Depacketizer

InverseInterleaving

DecodingError

Concealment

Eric Orellana-Romero et al (Contact E-mail: [email protected]) Sim-LIT: simulation framework for quality assessment in WVSNs 10 / 14

Page 19: Sim-LIT: A simulation framework for image quality ...crduran.ubb.cl/old-html-based-site/publications/... · Wireless sensor networks and wireless camera sensor networks Packet loss

IntroductionSim-LIT

Conclusion and Future Works

Proposed simulation frameworkExecution, options and complementary toolsEvaluation

Sample execution

Example of an execution line

$./simlit -ipath /sample/ -csf results -s27 -hb 2 -wb 2 -b 3 -loss-file/sample/loss-file 40 1.in -torus-mixer 1

8 -adapted-interleaving-simulation-rep-file-data-graphic

Figure: Original image

Camera node

Decoder

_____.bmp(OriginalImage)

_____.mix-res.bmp(Reconstructed

Image afterInterleaving)

_____.trad-res.bmp(ReconstructedImage with no

Interleaving

HB , WB , b, Method, . . .

Applied)

_____.mix.bmp(interleaved bitmap)_____.mix-re .bmp

(interleaved bitmap with losses)

_____.mix-re -org.bmp(bitmap with losses afterinverse interleaved)

_____.trad-re .bmp(received bitmap with losses)

Method,keys

Payload

Loss rate

Loss-pattern file

Coding Packetizer

ForwardInterleaving

LossPacket

Simulation

Depacketizer

InverseInterleaving

DecodingError

Concealment

Eric Orellana-Romero et al (Contact E-mail: [email protected]) Sim-LIT: simulation framework for quality assessment in WVSNs 10 / 14

Page 20: Sim-LIT: A simulation framework for image quality ...crduran.ubb.cl/old-html-based-site/publications/... · Wireless sensor networks and wireless camera sensor networks Packet loss

IntroductionSim-LIT

Conclusion and Future Works

Proposed simulation frameworkExecution, options and complementary toolsEvaluation

Sample execution

Example of an execution line

$./simlit -ipath /sample/ -csf results -s27 -hb 2 -wb 2 -b 3 -loss-file/sample/loss-file 40 1.in -torus-mixer 1

8 -adapted-interleaving-simulation-rep-file-data-graphic

Figure: Interleaving image - I.T.

Camera node

Decoder

_____.bmp(OriginalImage)

_____.mix-res.bmp(Reconstructed

Image afterInterleaving)

_____.trad-res.bmp(ReconstructedImage with no

Interleaving

HB , WB , b, Method, . . .

Applied)

_____.mix.bmp(interleaved bitmap)_____.mix-re .bmp

(interleaved bitmap with losses)

_____.mix-re -org.bmp(bitmap with losses afterinverse interleaved)

_____.trad-re .bmp(received bitmap with losses)

Method,keys

Payload

Loss rate

Loss-pattern file

Coding Packetizer

ForwardInterleaving

LossPacket

Simulation

Depacketizer

InverseInterleaving

DecodingError

Concealment

Eric Orellana-Romero et al (Contact E-mail: [email protected]) Sim-LIT: simulation framework for quality assessment in WVSNs 10 / 14

Page 21: Sim-LIT: A simulation framework for image quality ...crduran.ubb.cl/old-html-based-site/publications/... · Wireless sensor networks and wireless camera sensor networks Packet loss

IntroductionSim-LIT

Conclusion and Future Works

Proposed simulation frameworkExecution, options and complementary toolsEvaluation

Sample execution

Example of an execution line

$./simlit -ipath /sample/ -csf results -s27 -hb 2 -wb 2 -b 3 -loss-file/sample/loss-file 40 1.in -torus-mixer 1

8 -adapted-interleaving-simulation-rep-file-data-graphic

Figure: Received image - I.T.

Camera node

Decoder

_____.bmp(OriginalImage)

_____.mix-res.bmp(Reconstructed

Image afterInterleaving)

_____.trad-res.bmp(ReconstructedImage with no

Interleaving

HB , WB , b, Method, . . .

Applied)

_____.mix.bmp(interleaved bitmap)_____.mix-re .bmp

(interleaved bitmap with losses)

_____.mix-re -org.bmp(bitmap with losses afterinverse interleaved)

_____.trad-re .bmp(received bitmap with losses)

Method,keys

Payload

Loss rate

Loss-pattern file

Coding Packetizer

ForwardInterleaving

LossPacket

Simulation

Depacketizer

InverseInterleaving

DecodingError

Concealment

Eric Orellana-Romero et al (Contact E-mail: [email protected]) Sim-LIT: simulation framework for quality assessment in WVSNs 10 / 14

Page 22: Sim-LIT: A simulation framework for image quality ...crduran.ubb.cl/old-html-based-site/publications/... · Wireless sensor networks and wireless camera sensor networks Packet loss

IntroductionSim-LIT

Conclusion and Future Works

Proposed simulation frameworkExecution, options and complementary toolsEvaluation

Sample execution

Example of an execution line

$./simlit -ipath /sample/ -csf results -s27 -hb 2 -wb 2 -b 3 -loss-file/sample/loss-file 40 1.in -torus-mixer 1

8 -adapted-interleaving-simulation-rep-file-data-graphic

Figure: De-Interleaving image - I.T.

Camera node

Decoder

_____.bmp(OriginalImage)

_____.mix-res.bmp(Reconstructed

Image afterInterleaving)

_____.trad-res.bmp(ReconstructedImage with no

Interleaving

HB , WB , b, Method, . . .

Applied)

_____.mix.bmp(interleaved bitmap)_____.mix-re .bmp

(interleaved bitmap with losses)

_____.mix-re -org.bmp(bitmap with losses afterinverse interleaved)

_____.trad-re .bmp(received bitmap with losses)

Method,keys

Payload

Loss rate

Loss-pattern file

Coding Packetizer

ForwardInterleaving

LossPacket

Simulation

Depacketizer

InverseInterleaving

DecodingError

Concealment

Eric Orellana-Romero et al (Contact E-mail: [email protected]) Sim-LIT: simulation framework for quality assessment in WVSNs 10 / 14

Page 23: Sim-LIT: A simulation framework for image quality ...crduran.ubb.cl/old-html-based-site/publications/... · Wireless sensor networks and wireless camera sensor networks Packet loss

IntroductionSim-LIT

Conclusion and Future Works

Proposed simulation frameworkExecution, options and complementary toolsEvaluation

Sample execution

Example of an execution line

$./simlit -ipath /sample/ -csf results -s27 -hb 2 -wb 2 -b 3 -loss-file/sample/loss-file 40 1.in -torus-mixer 1

8 -adapted-interleaving-simulation-rep-file-data-graphic

Figure: Recontructed image - I.T.

Camera node

Decoder

_____.bmp(OriginalImage)

_____.mix-res.bmp(Reconstructed

Image afterInterleaving)

_____.trad-res.bmp(ReconstructedImage with no

Interleaving

HB , WB , b, Method, . . .

Applied)

_____.mix.bmp(interleaved bitmap)_____.mix-re .bmp

(interleaved bitmap with losses)

_____.mix-re -org.bmp(bitmap with losses afterinverse interleaved)

_____.trad-re .bmp(received bitmap with losses)

Method,keys

Payload

Loss rate

Loss-pattern file

Coding Packetizer

ForwardInterleaving

LossPacket

Simulation

Depacketizer

InverseInterleaving

DecodingError

Concealment

Eric Orellana-Romero et al (Contact E-mail: [email protected]) Sim-LIT: simulation framework for quality assessment in WVSNs 10 / 14

Page 24: Sim-LIT: A simulation framework for image quality ...crduran.ubb.cl/old-html-based-site/publications/... · Wireless sensor networks and wireless camera sensor networks Packet loss

IntroductionSim-LIT

Conclusion and Future Works

Proposed simulation frameworkExecution, options and complementary toolsEvaluation

Sample execution

Example of an execution line

$./simlit -ipath /sample/ -csf results -s27 -hb 2 -wb 2 -b 3 -loss-file/sample/loss-file 40 1.in -torus-mixer 1

8 -adapted-interleaving-simulation-rep-file-data-graphic

Figure: S.T.(PSNR=27.43dB)

Figure: I.T.(PSNR=30.67dB)

Data output files:.txt Simulation report

-data.dat Simulation report data-nmixdata.dat Detail. PSNR vs. loss rates / non-mixed images-mixdata.dat Detail. PSNR vs. loss rates / mixed images

Camera node

Decoder

_____.bmp(OriginalImage)

_____.mix-res.bmp(Reconstructed

Image afterInterleaving)

_____.trad-res.bmp(ReconstructedImage with no

Interleaving

HB , WB , b, Method, . . .

Applied)

_____.mix.bmp(interleaved bitmap)_____.mix-re .bmp

(interleaved bitmap with losses)

_____.mix-re -org.bmp(bitmap with losses afterinverse interleaved)

_____.trad-re .bmp(received bitmap with losses)

Method,keys

Payload

Loss rate

Loss-pattern file

Coding Packetizer

ForwardInterleaving

LossPacket

Simulation

Depacketizer

InverseInterleaving

DecodingError

Concealment

Eric Orellana-Romero et al (Contact E-mail: [email protected]) Sim-LIT: simulation framework for quality assessment in WVSNs 10 / 14

Page 25: Sim-LIT: A simulation framework for image quality ...crduran.ubb.cl/old-html-based-site/publications/... · Wireless sensor networks and wireless camera sensor networks Packet loss

IntroductionSim-LIT

Conclusion and Future Works

Proposed simulation frameworkExecution, options and complementary toolsEvaluation

Options and complementary tools

Principal options

-adapted-interleaving Interleaving technique during packetization-b Bits per each pixel during transmission

-csf Change the results folder-data-graphic Creates files to build graphics of ’Loss-Rate’ v/s ’Psnr’ for each

image, under different loss-rate-hb/-wb Height/Width block size input

-help Help information-ipath Work directory

-loss-file Defines loss-file input-loss-path Defines the path of loss files (For multiple simulation)-loss-rate Defines loss rate for randomly packet loss

-no-console-messages Do not display console messages-no-res-img-store Do not create resulting images

-s Payload packet-simulation-rep-file Output summary data files

-mohsen-mixer Interleaving scheme presented in ”An Efficient Chaotic Interleaverfor Image Transmission over IEEE 802.15.4 Zigbee Network”

-torus-mixer Interleaving scheme presented in ”Error Resilient Image Com-munication with Chaotic Pixel Interleaving for Wireless CameraSensors”

Eric Orellana-Romero et al (Contact E-mail: [email protected]) Sim-LIT: simulation framework for quality assessment in WVSNs 11 / 14

Page 26: Sim-LIT: A simulation framework for image quality ...crduran.ubb.cl/old-html-based-site/publications/... · Wireless sensor networks and wireless camera sensor networks Packet loss

IntroductionSim-LIT

Conclusion and Future Works

Proposed simulation frameworkExecution, options and complementary toolsEvaluation

Options and complementary tools

Complementary tools

genPackLoss (loss generator) allows to create loss-pattern files both user defined or randomly.

1 12 13 0

.

.

.

.

.

.

graphic Plotter of data graphics, allow graphically display of generated data by Sim-LITthrough -data-graphic option

10

15

20

25

30

35

40

45

50

55

60

65

0 10 20 30 40 50 60 70 80 90 100

PS

NR

(dB

)

Packet Loss Rate (%)

Quality Image Test

Whitout InterleavingTA Interleaving

Eric Orellana-Romero et al (Contact E-mail: [email protected]) Sim-LIT: simulation framework for quality assessment in WVSNs 11 / 14

Page 27: Sim-LIT: A simulation framework for image quality ...crduran.ubb.cl/old-html-based-site/publications/... · Wireless sensor networks and wireless camera sensor networks Packet loss

IntroductionSim-LIT

Conclusion and Future Works

Proposed simulation frameworkExecution, options and complementary toolsEvaluation

Evaluation

Evaluation parameters

Used machineProcessor: AMD Phenom II x4 955RAM: 6 GBO.S.: GNU/Linux Debian (Squeeze) kernel release 2.6.32-5-amd64

Measurements collected with the Linux command time

Simulations considered T.A. interleaving scheme applied in[Duran-Faundez and Lecuire, 2008]

C. Duran-Faundez, V. Lecuire (2008). “Error resilient image communication with chaotic pixel interleaving forwireless camera sensors”. In : REALWSN’2008.

Eric Orellana-Romero et al (Contact E-mail: [email protected]) Sim-LIT: simulation framework for quality assessment in WVSNs 12 / 14

Page 28: Sim-LIT: A simulation framework for image quality ...crduran.ubb.cl/old-html-based-site/publications/... · Wireless sensor networks and wireless camera sensor networks Packet loss

IntroductionSim-LIT

Conclusion and Future Works

Proposed simulation frameworkExecution, options and complementary toolsEvaluation

Evaluation

Example (Performance of simulations)

0

50

100

150

200

250

300

32x3264x64

128x128

256x256

512x512

Ave

rage

Tim

e (s

econ

ds)

Resolution (pixels)

5 input images25 input images50 input images

0

50000

100000

150000

200000

250000

32x3264x64

128x128

256x256

512x512M

axim

um M

emor

y (K

Byt

es)

Resolution (pixels)

5 input images25 input images50 input images

Execution Time Memory Use

Eric Orellana-Romero et al (Contact E-mail: [email protected]) Sim-LIT: simulation framework for quality assessment in WVSNs 12 / 14

Page 29: Sim-LIT: A simulation framework for image quality ...crduran.ubb.cl/old-html-based-site/publications/... · Wireless sensor networks and wireless camera sensor networks Packet loss

IntroductionSim-LIT

Conclusion and Future Works

Proposed simulation frameworkExecution, options and complementary toolsEvaluation

Evaluation

Example (Performance of simulations)

0 5

10 15

20 25

30 0 5 10 15 20 25 30 35 40 45 50

0 50

100 150 200 250 300 350

Average Time (seconds)

Numbers of Loss Files Number of Input Images

Average Time (seconds)

Eric Orellana-Romero et al (Contact E-mail: [email protected]) Sim-LIT: simulation framework for quality assessment in WVSNs 12 / 14

Page 30: Sim-LIT: A simulation framework for image quality ...crduran.ubb.cl/old-html-based-site/publications/... · Wireless sensor networks and wireless camera sensor networks Packet loss

IntroductionSim-LIT

Conclusion and Future Works

Conclusion and Future Works

Conclusions

Simulation framework oriented to image quality assessmentsOriented-object C++ ProgrammingFor now, only .bmp supportBlock interleaving included in the first versionLoss models depend on the constructed loss files (it is possible to connect with WSNssimulators)

Currently, we use Sim-LIT to evaluate existing and new interleaving schemes(possible to find optimal?)

Available as open-source:http://pegasus.dci.ubiobio.cl/~crduran/software/simlit

Future works

Parallel programming

Incorporation of other error robust methods

Incorporation of other quality metric measurements

Other improvements

Eric Orellana-Romero et al (Contact E-mail: [email protected]) Sim-LIT: simulation framework for quality assessment in WVSNs 13 / 14

Page 31: Sim-LIT: A simulation framework for image quality ...crduran.ubb.cl/old-html-based-site/publications/... · Wireless sensor networks and wireless camera sensor networks Packet loss

IntroductionSim-LIT

Conclusion and Future Works

Sim-LIT: A simulation framework for image quality assessment inwireless visual sensor networks under packet loss conditions

Eric Orellana-Romero*, Javier SanMartin-Hernandez*,Cristian Duran-Faundez*, Vincent Lecuire† and Cristhian Aguilera*

*Departamento de Ingenierıa Electrica y Electronica - Facultad de IngenierıaUniversidad del Bıo-Bıo, Concepcion, Chile

†Centre de Recherche en Automatique de Nancy (CRAN)Universite de Lorraine, CNRS, Vandœuvre-les-Nancy, France

XXX International Conference of the Chilean Computer Science Society(SCCC’2011), Curico, Chile

Eric Orellana-Romero et al (Contact E-mail: [email protected]) Sim-LIT: simulation framework for quality assessment in WVSNs 14 / 14