21
Monitoring of Audio-Visual Quality by Key Indicators (MOAVI) Mikołaj Leszczuk Faculty of Computer Science, Electronics and Telecommunications Department of Telecommunications Santa Clara (CA), 2015-02-24 www.agh.edu.pl

Monitoring of Audio-Visual Quality by Key Indicators (MOAVI)

Embed Size (px)

Citation preview

Page 1: Monitoring of Audio-Visual Quality by Key Indicators (MOAVI)

Monitoring of Audio-Visual Quality by Key Indicators (MOAVI)Mikołaj Leszczuk

Faculty of Computer Science, Electronics and TelecommunicationsDepartment of Telecommunications

Santa Clara (CA), 2015-02-24

www.agh.edu.pl

Page 2: Monitoring of Audio-Visual Quality by Key Indicators (MOAVI)

2

Presentation Plan

• Reminder on Monitoring of Audio Visual Quality by Key Indicators (MOAVI)

• Previous status• Report for 2014H2 (progress since

last VQEG meeting)• Plans for 2015H1 (future work)

www.agh.edu.pl

3.05.2023

Page 3: Monitoring of Audio-Visual Quality by Key Indicators (MOAVI)

3

REMINDER ON MOAVI

Monitoring of Audio Visual Quality by Key Indicators

3.05.2023

Page 4: Monitoring of Audio-Visual Quality by Key Indicators (MOAVI)

4

Reminder on MOAVI

• Mission:“To collaboratively develop No-Reference models for monitoring individual audio-visual service quality artefacts”

• Goals:• To develop set of key indicators describing service

quality in general and by removing implementation constraint

• To select subsets for each potential application• To concentrate on models based on key indicators

contrary to models predicting overall visual quality

www.agh.edu.pl

3.05.2023

Page 5: Monitoring of Audio-Visual Quality by Key Indicators (MOAVI)

5

MOAVI Co-Chairs

• Silvio Borer• SwissQual, Zuchwil, Switzerland• [email protected]

• Mikołaj Leszczuk• AGH University of Science and Technology, Krakow,

Poland• [email protected]

www.agh.edu.pl

3.05.2023

Page 6: Monitoring of Audio-Visual Quality by Key Indicators (MOAVI)

6

Signal-Based, No-Reference Indicators for Artefacts of Various Origin

• Capturing Artefacts: blurriness, exposure, interlace, etc.

• Processing Artefacts: blockiness, blurriness, flickering, reduced spatial and temporal resolution, etc.

• Transmission Artefacts: blackout, block loss, freezing, slicing, etc.

• Displaying Artefacts: blackout, slicing, etc.

www.agh.edu.pl

3.05.2023

Page 7: Monitoring of Audio-Visual Quality by Key Indicators (MOAVI)

7

Free MATLAB Audio-Video Quality Indicators Rolling Out Online athttp://vq.kt.agh.edu.pl/

www.agh.edu.pl

3.05.2023

Page 8: Monitoring of Audio-Visual Quality by Key Indicators (MOAVI)

8

PREVIOUS STATUS3.05.2023

Page 9: Monitoring of Audio-Visual Quality by Key Indicators (MOAVI)

9

Available Video Indicators (1/2)

www.agh.edu.pl

Blockiness Bluriness Exposure Interlace Noisiness

Framing & Pillar-/Letter

-BoxingFlickering Blackout Spatial

ActivityTemporal Activity

3.05.2023

Page 10: Monitoring of Audio-Visual Quality by Key Indicators (MOAVI)

10

Available Video Indicators (2/2)

www.agh.edu.pl

Brightness Contrast Freezing Block Loss Slicing

3.05.2023

Page 11: Monitoring of Audio-Visual Quality by Key Indicators (MOAVI)

11

Available Audio Indicators

www.agh.edu.pl

Mute Clipping

3.05.2023

Page 12: Monitoring of Audio-Visual Quality by Key Indicators (MOAVI)

12

Contribution to JEG-Hybrid

All indicators have been already contributed to JEG-Hybrid as all-in-one,

„easy-to-run” binary executable

www.agh.edu.pl

3.05.2023

Page 13: Monitoring of Audio-Visual Quality by Key Indicators (MOAVI)

13

REPORT FOR 2014H2

Progress since Last VQEG Meeting

3.05.2023

Page 14: Monitoring of Audio-Visual Quality by Key Indicators (MOAVI)

14

New Video Indicators

www.agh.edu.pl

Pillar-boxing Letter-boxing Vignetting Rainbow Effect

Aspect Ratio Error Ghosting Ringing Grey-Scale

3.05.2023

Page 15: Monitoring of Audio-Visual Quality by Key Indicators (MOAVI)

15

Contributions to Other VQEG Projects• JEG-Hybrid:

– New JEG Wiki article prepared

– Info on MOAVI video quality research

– Links to quality metrics and results

– Also extensive video library

• VIME – initial contribution

3.05.2023

Page 16: Monitoring of Audio-Visual Quality by Key Indicators (MOAVI)

16

New Application Area – Quality Checks for DEEP• DEEP – “second-screen”

content discovery solution• Auto e-zines for movies,

celebrities & other topics• Using sources beyond

traditional structured ones• Internet as source of

unstructured visual info• Selection of e-zine images

to look as manually edited• Need to analyze images

received from providers

3.05.2023

Page 17: Monitoring of Audio-Visual Quality by Key Indicators (MOAVI)

17

PLANS FOR 2015H1

Future Work

3.05.2023

Page 18: Monitoring of Audio-Visual Quality by Key Indicators (MOAVI)

18

New Video Indicator

www.agh.edu.pl

Intrinsic Resolution

3.05.2023

Page 19: Monitoring of Audio-Visual Quality by Key Indicators (MOAVI)

19

More Experimental Setups for Verification of Indicators

www.agh.edu.pl

Experimental Setup Indicators

Threshold Blockiness, Bluriness

MOS (ACR≈DCR) Exposure, Noisiness, Block Loss, Freezing, Slicing

None but planned Contrast, Brightness, Flickering

None and not planned Interlace, Framing, Blackout, Mute, Clipping

3.05.2023

Page 20: Monitoring of Audio-Visual Quality by Key Indicators (MOAVI)

20

Other Future Work

• Integration of MOAVI indicators within JEG virtual machines

• Further contributions to VIME• Further quality checks for DEEP

application

www.agh.edu.pl

3.05.2023

Page 21: Monitoring of Audio-Visual Quality by Key Indicators (MOAVI)

21

THANK YOU FOR YOUR ATTENTION!

[email protected]

3.05.2023