- 1. 4K Research in PSNCCinegrid International Workshop, 7 Dec
2011Maciej Gowiak [email protected], M.Strozyk,
B.Idzikowski, P.Ostapowicz
2. 4K Node in PoznaPSNC - Poznan Supercomputing and Networking
Center Timeline 4K node started in 2008 3D installation in 2010
Research Software Streaming Codecs Visualization Hardware Live 4K
Cooperation Universities and Research Institutes Film schools
Artists 3. Stereoscopic4K 3D Node - PSNC Stereoscopic HD TV LG
47LD950projection system 2x SONY SRX-T105 4K projectorsContent
storage (48TB) HDMI and distribution center Video converter3x SUN
Fire x4540 BlackMagic HDLink3DTwo synchronized4K Content
Stereoscopic HD-SDI(R3D) CinematograficCamera HD/4K HD/4K RED One
4K Content Streaming Two synchronizedPost-production station(TIFF,
J2K,(JPEG2000 Stereoscopic 4KMac Pro with Final Cut Pro MXF, DCP or
JPEG)8xHD-SDI and Adobe ProductionAnalogetc.) supported by Neo3D or
digital8ch Sound Graphics AES 10GbE PIONIERworkstation EBU 4K Live
extension systemFor software real-time Optical networkFor RED One
cameraJPEG decoding (Frame grabber) RED Rocket acceleratedSound
mixing systemTascam DM-3200HD/4K +AES/EBU activeContent JBL
loudspeakers Professional 3D rigFor 2x RED One 4K camerasJPEG2000
4K DecoderintoPIX SYX-JP4K with 2x Pristine4 HD/4K
StreamingD-Cinema To or from PackagesOther Nodes(MXF/DCP)JPEG2000
4K Encoder 8xHD-SDIHD live camerasHPDMNet Streaming ServerWith
HDSDI 1080 outputintoPIX SYX-JP4K CineGrid SONY PMW EX3 and
Panasonic AG-3DA1 GLIF4K PlayerGEANTHD stereo Player 4K LCD 56
monitor Content storage and retrieving (TIFF, J2K, MXF, DCP,
etc.)Doremi DSV-J2Astro DM-3400+ digital soundHD/4K live 2D or 3D
streaming 4. New deployments 2011 132MPix wall (15K x 8.6K) 64 Full
HD LCDs 2 PC with ATI cards For presentation scientific
visualization Molecular structures (bio- and nanotechnology)
Geografical data SAGE, Vitrall, etc.GPU accelerated cluster (in
progress) 160TFlops in total, about 220 nodes 2x AMD 12-core per
node nVidia Tesla M2070 acceleration Infiniband QDR FatTree
Applications: radioastronomy, physics, visualizations 5. 4K &
4K3D post-production HD, 4K and 4K 3D 1 man dedicated to 4K &
3D PLATON HDTV Team cooperation Adobe Premiere Native RED (R3D)
file support Cineform Neo3D(plugin for Adobe Premiere Pro): Useful
tools for 3D picture corrections Stereo encoded files Simple
switching between presentation formats (side-by-side, upper- lower,
separate eyes and many more) Working in real time Support for
hardware preview 6. Playback and streamingStarted from DOREMI
DSV-J2 + MB4K 4K and HD3D No support for 4K 3D (RGB 444) DCP
creation quite complex Not sufficient Flow
FreeCommercialHardwaresoftware software OpenJPEGKakadu (SDK)
>500$ intoPIX PRISTINE4 KakaduCineAsset (Pro) - $4.000 Barco
DCPB2000TIFFJ2KImageMagic/GraphicsMagick Easy DCP - 3.000OpenCube
DCP (20.000) CUJ2K OpenCube - 1.000Doremi DMS-2000 (90.000) NTT J2K
4K codecJ2KASDCPLib MXF Free MXFWAV Easy DCP (trial) Mastering
station: CineAsset - $4.000 OpenCube DCP (20.000) Easy DCP -
3.000Doremi DMS-2000 (90.000) Open Cinema Tools OpenCube -
1.000Clipster DVSMXF DCPEasy DCP (trial) or more 7. 4K 3D streaming
client-serverand player development One modular application for
three purposes: Inexpensive solution (e.g for research and
experiments) Open source JPEG software decompression Cheap
equipment (PC + software/GPU codec) Professional solution (e.g. for
digital cinemas) DCI compliant JPEG2000 hardware acceleration
(Pristine4) Cooperation with hardware vendor (intoPIX) 4K (3D) live
streaming Use of Future Internet networks(IPv6, dedicated
multimedia data stream switching) JPEGStreaming StreamingServer
RTPClientHD/4KJPEG2D/3D2000 8. Streaming Server Streaming Server
Streaming stereo 4K + audio Various video codecs (intra-frame) JPEG
JPEG2000 Use of other containers (such as MXF/DCP) Testing
behaviour of codecs depending on compression rate andnetwork
parameters Transport: single stream RTP/RTSP up to 1 Gbit/s IPv6
enabled Experimental Data Stream Switching network Open source,
Linux Testing various streaming libraries (gstreamer, live555,
ownimplementation, etc.) 9. Low cost playback and streamingfps JPEG
software decompression (4K 3D) c ImplementationThrds Multithread
C++ application (DirectX 10), no GPU acceleration. Integration of
libturbo-jpeg for software JPEG decompression JPEG decompression
for ~50 fps in 4K (Intel Core i7 960) 4K 3D (2x 24fps in 4096x2160)
Up to 1Gbit/s for 70-90 compression ratio 2 x ATI FirePro v8800
each for displaying 2 x 4K (passive 3D)Streaming client and JPEG
player for 4K 3D Multithreaded JPEG decoderPre-encodedlibturbo-jpeg
(4K video) 4x DVIDecompressed JPEG filesCompressed Data queueFireGL
v8800 Data queue render Frame libturbo-jpegRTP networkFireGL
v8800Streaming of (4K video) JPEG fileslibturbo-jpeg 4x DVI Network
10. Streaming client and player:JPEG2000 hardware decoderintoPIX
Pristine4 solution SkyMicro MerlinIP board with FPGA Virtex5 J2K
encoding, decoding, streaming 4K 3D using two sync. cardsNew
applications basing on Pristine4 SDK 4K 3D streaming module IPv6
Multicast IPv4, IPv6 Testing Future Internet networks (IPv6
implemented in PSNC) Network QoS measurement, QoE evaluation 8x
HD-SDI(4x dual link) 4x SDI-3G Storage andStreamingServer
Network(RTP)4x SDI-3G8x HD-SDI (4x dual link)StreamingStreaming
client4K 3D liveserver (4x SDI-3G)2x HD / 4K Cameras In 3D Rig 11.
intoPIX to SONY SRX intoPIX Pristine4 connectionsInfinibandHDSDI
Panel Pristine4 3G3G3G 3GHD-SDI Dual HD-SDI w/Sound 12. intoPIX to
2x SONY SRX (3D) intoPIX Pristine4 connections (3D)Infiniband
Infiniband Pristine4Pristine4 HDSDI Panel HDSDI Panel 3G3G 3G3G
syncHD-SDI Dual HD-SDIHD-SDI w/SoundDual 13. Hardware development
Hardware development team Group of 3 engineers Development of FPGA
and electronic devices Ready to make necessary devices, e.g.: 4K3D
HDSDI switch (single/dual/3G) DOREMIintoPIX Player Player 14. 4K
live interface for RED One(prototype) Lack of 4K live
output!Transfer 4K signal to PChi-speed interface (USB,
Ethernet)RED One built-in live output in720p only Decoding and
debayerization RED Rocket Low level hardware development for
grabbing 4K live content Various output options: Catching R3D
stream from ATAPI HD SDI RED Rocket Breakoutbox interfaceShowing 4K
using graphics cardEncoding using intoPIX Pristine4 Real-time
processing on FPGA chip(JPEG2000) and network streaming A real CF
storageFor simultanous storagePurposes (optional) 4x HD-SDI
Hi-SpeedUSB 2.0 Graphics card(480 Mbps) ATI v8800 JPEG2000EncoderCF
Header ATAPI Frame GrabberPC with (Intopix)RED One 4K camera (True
IDE CF Card simulation)RED RocketNetwork streaming 15. 4K live
interface for RED One Schedule Proof of concept mid 2011 Presented
on TNC2011 in Prague and Cinegrid@Amsterdam Prototype Virtex6
evaluation kit Change from CF/ATAPI to SATA Change from USB to
1Gbit Ethernet Several problems to be resolved (SATA) Should be
done 1Q2012 Final device Dedicated board with Virtex6 Planned
3Q2012 Open question RED Epic support? We believe yes, however its
not tested yet and will need sometesting 16. Demonstrations
2010/2011Streaming 4K and 4K3D JPEG2000 4K (intoPIX RTP) JPEG 4K3D
(software decoding) JPEG2000 4K3D (intoPIX SDK)From Pozna,PL to:
Colchester,GB (regular) Vilnius,LT (TNC2010) Geneve,CH
(GLIF2010,HPDMNet) Prague, CZ (TNC2011) Amsterdam,NL (Cinegrid) 17.
Cinegrid @ Amsterdam 2011Case study Aim: to demonstrate JPEG2000 4K
3D streaming (Poznan-Amsterdam) using intoPIX Pristine4 system to
provide 4K projectors for other demonstrations Things to do (1): 1.
To do the working version of software: No 4K 3D functionality in
Pristine4 Unexpected bugs live555 library failed on 64-bit systems!
No sound buffer implementation in intoPIX SDK (fixed quickly) Fully
functional software ready day before conference! Tests with Univ.
of Essex 18. Cinegrid @ Amsterdam 2011 Case study things to do
Things to do (2) 2. To move 2 SONY Projectors 900 km Rent a van and
drive Pack all equipment and not to forget about anything important
Set up and run on place 19. Cinegrid@Amsterdam 2011 Case study
Things to do (3) 3. Establish network connection Network to the
venue? No problem For compressed 4K 3D we need just 1GbE 4. Convert
video content Wrong colors in Holland Festival 4K 3D piece
(Mullova) Another conversion took a lot of time graphics magick in
several processes intoPIX had correct content on IBC fairs Brought
1h before screening 20. Conclusions: Learning by doing To do the
demonstration Good planning Cant foresee all problems Need of some
luck A lot of preparation and work Relax Cinegrid@Amsterdam 21.
Thank you
