View
89
Download
3
Category
Tags:
Preview:
Citation preview
Designing an Information Model of Writing for Monitoring and Analytics
Taku Yamaguchi, Michiko Oba, Osamu Takahashi Future University Hakodate
v0.7 2014-09-15 (partial translation of the original Japanese version) http://www.slideshare.net/yamahige
1 2014-09-09, JSSST2014 Taku Yamaguchi, Future University Hakodate
Agenda • Background large-scale, long-term data acquisition and analysis – EDUPUB, IMS/GLC Caliper – Meta-analysis
• Concept – Measurement of text editing operations – Designing an information model for writing – Interoperability by standardization – Matrix type text editing model
• Approach – Seeds oriented – proof of concept
• Results, discussion 2014-09-09, JSSST2014 Taku Yamaguchi, Future University Hakodate 2
BACKGROUND
2014-09-09, JSSST2014 Taku Yamaguchi, Future University Hakodate 3
Large-scale and long-term data accumulation and analysis
is realized by interoperability and standardization • From lock-in to interoperability (*) • EDUPUB, IMS/GLC Caliper:
– EDUPUB Tokyo 2014, 16-18 Sept. 2014, @Tokyo • Benchmarking
– Many researches, practices; methods for teaching, learning and reviewing
– Measurement – Synthesize data and results
(*) Tsuneo Yamada, The MOOC phenomenon ‒ The issues of the forthcoming online course platforms in post-MOOC, JOHO KANRI Vol. 57 (2014) No. 6 pp.367-375
2014-09-09, JSSST2014 Taku Yamaguchi, Future University Hakodate 4
CONCEPTS
2014-09-09, JSSST2014 Taku Yamaguchi, Future University Hakodate 5
Measurement of writing activities
2014-09-09, JSSST2014 Taku Yamaguchi, Future University Hakodate 6
text edi'ng app/system
writing xxx
xxxx xxx xxx xx xx xxxx
researchers
other writers
teacher
the writer
produced text
monitoring, analysis
Point of view: editing operations
2014-09-09, JSSST2014 Taku Yamaguchi, Future University Hakodate 7
text edi'ng system editing operations
xxx xxxx xxx xxx xx xx xxxx
log
researcher
other writer
instructor
writer
produced text
edi'ng opera'on sensor
▲▲ ▲ ▲ ▲▲▲ ▲ ▲▲▲▲▲▲
monitoring, analysis
Other focus, e.g. produced text
2014-09-09, JSSST2014 Taku Yamaguchi, Future University Hakodate 8
text edi'ng system writing xxx
xxxx xxx xxx xx xx xxxx
corpus
researcher
other writer
instructor
writer
Natural Language
Proccessing
produced text
monitoring, analysis
▲▲ ▲ ▲ ▲▲▲ ▲ ▲▲▲▲▲▲
Digital Humanities
2014-09-09, JSSST2014 Taku Yamaguchi, Future University Hakodate 9
text edi'ng system
writing xxx
xxxx xxx xxx xx xx xxxx
log
researcher
writer
produced text
monitoring and analyzing
edi'ng opera'on sensor
▲▲ ▲ ▲ ▲▲▲ ▲ ▲▲▲▲▲▲
Humani'es cogni've psychological research on wri'ng
process
Digital designing and
implemen'ng wri'ng informa'on model
writing research methods
2014-09-09, JSSST2014 Taku Yamaguchi, Future University Hakodate 10
text edi'ng system
writing xxx
xxxx xxx xxx xx xx xxxx
matrix type opera'on sensor
researcher
other writer
instructor
writer
monitoring, analysis
produced text
matrix
operations and their targets
▲▲ ▲ ▲ ▲▲▲ ▲ ▲▲▲▲▲▲
keystroke logging
recording whole
opera'ons
time
測定機能 測定機能 more senors
• thinking aloud protocols • produced text analysis • video recording • eye tracking • Neurologicals ...
this research
Designing writing information model
information model • activity • conceptual information structure on which those activities are based
2014-09-09, JSSST2014 Taku Yamaguchi, Future University Hakodate 11
(2) which provide with fruitful analysis
• humani'es • instruc'on • learning • document review/ management
(1) What are information models of writing
x x x x x
(3) and can be supported by new and existing applications
apps/systems and the model
2014-09-09, JSSST2014 Taku Yamaguchi, Future University Hakodate 12
• humani'es • instruc'on • learning • document review/ management
(1) What are information models of writing
x x x x x
Various implementation • New/existing • Full/partial support • Native/activity-translation
(3) and can be supported by new and existing applications
focus here
(2) which provide with fruitful analysis
スマホ、タブレット、PC
文書Y xxxxxxxxxxxxxxxx xxx
Interoperability without Interoperability...
2014-09-09, JSSST2014 Taku Yamaguchi, Future University Hakodate 13
スマホ、タブレット、PC
サーバA
編集操作ログ
書き手A
サーバ 処理
クラウド・ストレージ サーバB
編集操作ログ サーバ 処理
文書Y xxxxxxxxxxxxxxxx xxx
文書X xxxxxxxxxxxxxxxx xxx
モニター
サーバ処理
文書Xのログ
文書Yのログ
書き手Aのグラフ
書き手Bのグラフ
None
書き手Aのグラフ None
書き手Bのグラフ
モニター
サーバ処理
書き手B
文書X xxxxxxxxxxxxxxxx xxx
スマホ、タブレット、PC
文書Y xxxxxxxxxxxxxxxx xxx
Interoperability Interoperable
2014-09-09, JSSST2014 Taku Yamaguchi, Future University Hakodate 14
スマホ、タブレット、PC
サーバA
編集操作ログ
書き手A
サーバ 処理
クラウド・ストレージ サーバB
編集操作ログ サーバ 処理
文書Y xxxxxxxxxxxxxxxx xxx
文書X xxxxxxxxxxxxxxxx xxx
サーバ処理
文書Xのログ
文書Yのログ
書き手Aのグラフ
書き手Bのグラフ
モニター
サーバ処理
書き手B
文書X xxxxxxxxxxxxxxxx xxx
Matrix type information model for "writing"
• Worksheet model of Explicit/implicit guidelines/instructions for "planning". – "Write y, as section a1, a2, ... or aN; considering b1, b2, ... and/or bN; audience are c1, c2, ... and/or cN; it will be reviewed criteria d1, d2, ... dN; ..."
– axis a = { a1, a2, ... }, axis b = { b1, b2, ...}, ... – cell y = f(a, b, c, d, ...)
• Activity – matrix: editing axes, items of an axis, text in a cell – editing text which is not associated with a cell
2014-09-09, JSSST2014 Taku Yamaguchi, Future University Hakodate 15
Conceptual two dimensional matrix
2014-09-09, JSSST2014 Taku Yamaguchi, Future University Hakodate 16
自分 エントリー
科目 性格 卒研
志望動機 力を注いだ科目は、xxxです。そこで、志望動機yyyです。
希望職種 aaaな性格なので、bbb職を希望します.
1) 記入
2) 列追加 = 「自分」軸に「卒研」視点を追加
APPROACH
2014-09-09, JSSST2014 Taku Yamaguchi, Future University Hakodate 17
Proof of concept The model #1 can be implemented – on Open Web Platform – and give reasonable performance
#2 can be used to write – by writers who know the model well – real text: papers, proceedings, etc.
#3 can provide some hypothesis – from some graphics, etc.
2014-09-09, JSSST2014 Taku Yamaguchi, Future University Hakodate 18
RESULTS, DISCUSSION
2014-09-09, JSSST2014 Taku Yamaguchi, Future University Hakodate 19
#1: Reference implementation provide researchers and engineers with a graphical UI to understand the abstract model
2014-09-09, JSSST2014 Taku Yamaguchi, Future University Hakodate 20
planning produced text
This writer (1) wrote this part of text (2) as a part of "Results" considering "BYOD", (3) And the writer considers that "BYOD" is an item of "Call for Paper" axis and "Results" is an item of "IMRAD" axis.
2014-09-09, JSSST2014 Taku Yamaguchi, Future University Hakodate 21
planning in matrix view produced text
(1) (2)
(2)
(3) (3)
Submitting activity log
Request Method:POST … Request Payload … Content-Disposition: form-data; name="edit_log" {"vr":"0.7","level":"detail","console":false,"saveClear":"true","log":[{"op":"cc_cellText","cnt":{"element":{"id":"cc_764","tagName":"P"},"matrix":{"id":"cc_705","tagName":"TABLE"},"td":{"id":"cc_725","tagName":"TD"},"axes":[{"axis":"cc_743","item":"cc_720"},{"axis":"cc_744","item":"cc_749"}]},"dt":"2014-09-09T04:42:16.736Z"}]}
"op": "cc_cellText", "cnt": { "td": { "id": "cc_725", "tagName": "TD" }, "axes": [ { "axis": "cc_743", "item": "cc_720" }, { "axis": "cc_744", "item": "cc_749" } ] },
2014-09-09, JSSST2014 Taku Yamaguchi, Future University Hakodate 22
2014-09-09, JSSST2014 Taku Yamaguchi, Future University Hakodate 23
(1) (2)
(2)
(3) (3)
"op": "cc_cellText", "cnt": { "td": { "id": "cc_725", ← (1) "tagName": "TD" }, "axes": [ { "axis": "cc_743", ← (3) "item": "cc_720" ← (2) }, { "axis": "cc_744", ← (3) "item": "cc_749" ← (2) } ] },
#2, #3: Editing pattern 1
2014-09-09, JSSST2014 Taku Yamaguchi, Future University Hakodate 24
matrix operations done, posted
types of editing operations
time line
paragraphs headings operations
matrix operations
other operations
Editing patter 2
• less matrix operations,
• ceased at the early stage
2014-09-09, JSSST2014 Taku Yamaguchi, Future University Hakodate 25
matrix operations
In case of a proceeding
2014-09-09, JSSST2014 Taku Yamaguchi, Future University Hakodate 26
9 Jun. paper submission
4 Jul. acceptance no'fica'on
16 Jul. camera ready submission
matrix operations
Till paper submission
2014-09-09, JSSST2014 Taku Yamaguchi, Future University Hakodate 27
9 Jun. paper submission
matrix operations; planning composition
from notification to camera ready
2014-09-09, JSSST2014 Taku Yamaguchi, Future University Hakodate 28
16 Jul. camera ready matrix
operations
No matrix operations, so the writer may not change the construction of the text
Scalability and Confidentiality
2014-09-09, JSSST2014 Taku Yamaguchi, Future University Hakodate 29
• Scalability • Confiden'ality
-‐> Life'me learning
No matrix operations, so the writer may not change the construction of the text
oh!: • Does the writer
understand the comment of peers?
• Does the app support sufficiently to change the construc'on of the large text?
the analysis provides these hypotheses without reading or
analyzing wriQen text
Recommended