Slides He Csdl Dpt 05 4in1

8/12/2019 Slides He Csdl Dpt 05 4in1

1/8

Chng 5

CSDL video

Nguy n Thanh BnhKhoa CNTT&TT - i h c C n Th

8/2010

Nguy n Thanh Bnh Ch.5 : CSDL video 1 / 32

N i dung

1 Bi u di n n i dung videoCc kha c nh c a n i dung videoCc thu c tnh c a n i dung video

2 Ch m c n i dung videoFrame-Segment TreeR-Segment Tree


Gi i thi u

Cc yu c u truy tm d li u video c th m t trong 2 d ngsau:

Truy tm m t video c th : tm video The Sound of M usic .Xc nh v truy tm m t o n video: tm t t c video c John Wayne xu t hi n v i m t cy n ghita .

Cu truy v n trn yu c u:xc nh video trong John Wayne xu t hi n v i m t cyn ghita, vxc nh phn o n trong nh ng video trn m JohnWayne xu t hi n v i m t cy n ghita.

M t khi chng ta c th s p x p n i dung c a m t video, chngta cng c th s p x p n i dung c a nhi u video.


S p x p n i dung c a m t video

Chng ta c n tr l i nh ng cu h i sau:M t ng i s d ng khi truy c p vo m t CSDL video squan tm n nh ng kha c nh no?Lm th no lu tr m t cch hiu qu nh ng khac nh trn c a video, sao cho t i u ha th i gian tr l i

truy v n c a ng i dng?Ngn ng truy v n cho video s nh th no? V m hnhd li u quan h c th c m r ng nh th no qu nl d li u video?Qu trnh trch xu t n i dung c th c th c hi n m tcch t ng khng? N u c, ta s tnh tin c y c a kthu t trch xu t n i dung trong vi c x l cu truy v n nhth no?



2/8

Nh ng kha c nh no c a video m ta c n lu tr

Xem xt video Sound of Music Nh ng m c quan tm g m:

Ng i (people): Maria, Count Von Trapp, . . .V t th (inanimate objects): n piano, ... ng v t (animate objects): chim, v t, ...Ho t ng (Activities): ht, khiu v, .. . v danh sch ccthu c tnh lin quan.

V d : ho t ng ht c th c 2 thu c tnh l: ng i htv bi ht.M t vi c i m chung c th xu t hi n. Cho m t frame f c a m t video, frame f c g n k t v i m t t p cc it ng v ho t ng.Cc tnh ch t c a i t ng/ho t ng c th thay i khcnhau t frame ny sang frame khc.T o ch m c cho CSDL video ng ngha v i vi c t o chm c cho t t c cc m c trn.


Cc thu c tnh

Thu c tnh: bao g m m t c p (pname, Values) , trong:

pname l tn c a thu c tnhValues l t p cc gi tr c a thu c tnh

Th hi n c a thu c tnh: l m t bi u th c c d ng pname= v v i v Values

V d :(height , R + )(primarycolors, { red, green, blue } )


L c i t ngL c i t ng l m t c p (fd, fi) trong :

fd l t p cc thu c tnh ph thu c v i frame(frame-dependent).fi l t p cc thu c tnh c l p v i frame(frame-independent).fd v fi l khng giao nhau.

Th hi n c a i t ng l m t b ba (oid, os, ip) , trong:oid l m c a i t ng (object id)os = (fd, fi) l c u trc c a i t ngip l t p cc m nh sao cho:

m i thu c tnh (pname, Values) trong fd, ip ch ch anhi u nh t m t th hi n c a thu c tnh (pname, Values)v i m i thu c tnh (pname, Values) v m i frame f c avideo, ip ch a nhi u nh t m t th hi n c a (pname,Values) . Th hi n ny c k hi u b i bi u th c:

pname = v IN f Nguy n Thanh Bnh Ch.5 : CSDL video 7 / 32

V d



3/8

V d

Xem xt m t o n video theo di nh c a Denis Dopeman.Frame 1: Jane Shady ang trn ng d n vo nh DenisDopeman. C ta ang xch theo m t vali.Frame 2: Jane Shady ang n a ng vo nh Denis

Dopeman. C a m v Denis Dopeman xu t hi n c a.Frame 3: Jane v Denis ng c nh nhau c a. Jane v nc m vali.Frame 4: Jane quay v . Denis c m vali.Frame 5: Jane t i u ng. C a ng.


Cc thu c tnh ph thu c frame


Cc thu c tnh c l p frame


L c cc ho t ng

M t l c cc ho t ng ACT SCH l m t t p h u h n ccthu c tnh sao cho n u (pname, Value1) v (pname,Value2) u thu c ACT SCH th Value1 = Value2 .

V d : xt ho t ng Trao i vali trong v d trn gi a JaneShady v Denis Dopeman. Ho t ng ny c 3 c p l c :

(Giver, Person) : v d Giver = Jane Shady(Receiver, Person) : v d Receiver = DennisDopeman(Item, Thing) : v d Item = vali



4/8

Ho t ng

M t ho t ng l m t c p:ActID : tn c a l c ho t ngv i m i c p (pname, Values) ACT SCH , m t ngth c d ng pname = v v i v Values

M i ho t ng k t h p v i m t l c ho t ng, v m i thu ctnh c a ho t ng c m t gi tr k t h p.

V d :{ (Lecturer, Person), (Topic, String) }{ (Questioner, Person), (Questionee, Person), (Question,String), (Answer, String) }


N i dung video

Gi s v l m t videoframenum (v ) l s frame c a video.N i dung c a v l m t b ba (OBJ, AC, )

OBJ = { oid 1, ..., oid n } l t p h u h n cc thhi n i t ng.A C = { AcID 1, ..., AcID m } l t p h u h n cc ho t ng l m t nh x t { 1, ..., framenum (v ) } n 2OBJ AC . cho chng ta bi t i t ng no v ho t ng no c link t n frame f no c a video.


Th vi n video

M t th vi n video VidLib l m t b 5 (VidId,VidContent, framenum, plm, R) v i:

VidId l tn c a videoVidContent l n i dung c a videoframenum l t ng s frame c a videoplm (placement mapping) l a ch c a nh ng ph n khcnhau trong videoR l t p cc quan h v video


Th vi n video



5/8

Ngn ng truy v n cho d li u video

Ngn ng truy v n cho video lin quan n cc d ng truy v nsau:

Truy tm o n video: tm t t c cc o n t m t ho cnhi u video trong th vi n video th a m t vi i u ki n no.

Truy tm i t ng trong video: tm t t c cc i t ngc trong t t c frame t frame b t u s n frame k t thce ho c ch xu t hi n trong m t vi frame trn.Truy tm ho t ng: tm t t c cc ho t ng c trong t tc frame t frame b t u s n frame k t thc e ho c chxu t hi n trong m t vi frame trn.Truy tm d a trn thu c tnh


Cc hm video

FindVideoWithObject(o)FindVideoWithActivity(a)FindVideoWithActivityandProp(a, p, z)FindVideoWithObjectandProp(o, p, z)FindObjectsInVideo(v, s, e)FindActivitiesInVideo(v, s, e)FindActivitiesAndPropsinVideo(v, s, e)FindObjectsAndPropsinVideo(v, s, e)


Cc hm videoFindVideoWithObject(o) : tm cc video c ch a it ng o . Tr v cc b ba (v , s , e ), l cc o n trong videov c frame b t u l s v frame k t thc l e v trong t tc frame ny u c ch a o .FindVideoWithActivity(a) : tm cc video c ch a ho t ng a (tng t trn).FindVideoWithObjectandProp(o, p, z) : tm cc o nvideo c ch a i t ng o v i thu c tnh p v gi tr c athu c tnh l z .FindVideoWithActivityandProp(a, p, z) : tng t trn.FindObjectsInVideo(v, s, e) : tr v t t c cc i t ngc trong o n video v t frame b t u s n frame k tthc e .FindActivitiesInVideo(v, s, e) : tng t trn.FindObjectsAndPropsinVideo(v, s, e) : tr v t t c cc i t ng v thu c tnh i km c trong o n video c n tm.FindActivitiesAndPropsinVideo(v, s, e) : tng t trn.


Ngn ng h i cho d li u video

c m r ng t ngn ng SQL chu n.M nh SELECT c th ch a nh ng m c d ng Vid:[s,e]M nh FROM c th ch a nh ng m c d ngvideoM nh WHERE c th ch a nh ng m c d ng term IN func call v i func call l cc hm video xem trn.



6/8






B n hy vi t cc cu truy v n SQL cho video sau:1 Tm t t c video (v cc o n lin quan) t CSDL

VidLib1 trong c hnh nh vali (briefcase) mu en .2 Tm t t c video (v cc o n lin quan) t CSDL VidLib1

trong c hnh nh Denis Dopeman nh n vali .3 Tm t t c video (v cc o n lin quan) t CSDL

VidLib1 trong c hnh nh Maria ht bi Giaii u h nh phc .


Ch m c n i dung video

Chng ta nh ngha n i dung c a video, by gi chngta c n ch m c chng.Chng ta c 8 hm truy tm video. Vi c ch m c ph i h trvi c th c hi n m t cch hi u qu 8 hm ny.R rng chng ta khng th lu tr n i dung video trnm t frame theo t ng frame b i v l ng d li u s r tkh ng l (m t o n video 90 pht c trn 120 ngn frame).Chng ta c n m t bi u di n thu g n Compact Representation lu tr n i dung video.C 2 c u trc d li u l Frame Segment Tree vR-Segment Tree



7/8

Frame Segment TreeFrame-sequence: l m t c p [i , j ) bi u di n t t c ccframe n m gi a i (bao g m) v j (khng bao g m)

[6, 12) k hi u cc frame {6, 7, 8, 9, 10, 11}Frame-sequence ordering: [i 1, j 1) [i 2, j 2) ch th t c achu i frame [i 1, j 1) ng tr c [i 2, j 2)

[8, 10) [10, 12)Well-ordered set of frame-sequence: m t t p X ccchu i frame c g i l c th t t t n u v ch n u:

X l h u h n.[i 1, j 1) [i 2, j 2) . . . [i r , j r )X = {[1, 4), [9, 13), [33, 90)} l c s p x p th t t t.

Solid set of frame-sequence: m t t p X cc chu i frame c g i l solid n u v ch n u:

X c s p x p th t t t.Khng c cc chu i frame d ng [i 1, i 2), [i 2, i 3)X = {[1, 7), [9, 13)} l solid .

Segment association map: nh x objects vo segmentsThay v bi u di n object 1 : frame 1 ta bi u di nobject 1 : 250 750Nguy n Thanh Bnh Ch.5 : CSDL video 25 / 32

V d


V d


Frame segment tree

S d ng cc thnh ph n sau:OBJECTARRAY : bi u di n cho m i i t ng m t danh schlin k t c th t cc con tr n cc nt trong cy frame segment ch i t ng xu t hi n trong cc o n no.ACTIVITYARRAY : tng t OBJECTARRAYCy FS c xy d ng t b ng segment.

M i nt ch aLB, UB: frame nh nh t v l n nh t c a segment.OBJ: danh sch lin k t cc con tr n OBJECTARRAYRCHILD, LCHILD



8/8

Frame segment tree

B c 1: s p th t theo frame cu i c a m i segment

B c 2:M i nt l u cng c p. Nt tri nh t bi u di n chu iframe [z 1, z 2), k ti p [z 2, z 3), . . .N u nt N c hai con bi u di n [z 1, z 1) v [z 2, z 3) th N bi u di n [z 1, z 3)Con s bn trong m i nt c th xem nh a ch nt.


Frame segment tree


R-Segment TreeTng t nh Frame segment tree.V n gi cc khi ni m OBJECTARRAY v ACTIVITYARRAY .S d ng R-tree bi u di n m t segment (xem nh hnhch nh t c chi u di e s , chi u r ng 0).


Ti li u tham kh o

V.S.Subrahmanian.Chapter 7 - Principles of Multimedia Database SystemsMorgan Kaufman Press , 1998.Nabil R. Adam.Bi gi ng Multimedia Information SystemsRutgers University , 2003.


Documents

Slides He Csdl Dpt 05 4in1