11
YICHIA WANG 2011/02/22 Weekly Meeting

YICHIA WANG 2011/02/22 Weekly Meeting. Mturk 10 Acor messages Correlation with expert annotation = 0.87 50 Acor messages + 50 Bambina messages

Embed Size (px)

Citation preview

Page 1: YICHIA WANG 2011/02/22 Weekly Meeting. Mturk  10 Acor messages  Correlation with expert annotation = 0.87  50 Acor messages + 50 Bambina messages

YICHIA WANG2011/02/22

Weekly Meeting

Page 2: YICHIA WANG 2011/02/22 Weekly Meeting. Mturk  10 Acor messages  Correlation with expert annotation = 0.87  50 Acor messages + 50 Bambina messages

Mturk

10 Acor messages Correlation with expert annotation = 0.87

50 Acor messages + 50 Bambina messages Correlation with expert annotation

Emotional correlation = 0.70• Acor = 0.93• Bambina = 0.43

Informational correlation = 0.76• Acor = 0.78• Bambina = 0.76

Intra-class correlation (average measurement) Emotional correlation = 0.94

• Acor = 0.96• Bambina = 0.91

Informational correlation = 0.93 • Acor = 0.91• Bambina = 0.95

Page 3: YICHIA WANG 2011/02/22 Weekly Meeting. Mturk  10 Acor messages  Correlation with expert annotation = 0.87  50 Acor messages + 50 Bambina messages

Breast Cancer Data - Descriptive Statistics

Thread 68,158 threads 1,562,459 posts 22.92 posts / per thread

User 90,242 users 54,580 users never logged in after registration 0.77 threads / per user 24.29 posts / per user

Page 4: YICHIA WANG 2011/02/22 Weekly Meeting. Mturk  10 Acor messages  Correlation with expert annotation = 0.87  50 Acor messages + 50 Bambina messages

Number of Threads by Posted Year

Page 5: YICHIA WANG 2011/02/22 Weekly Meeting. Mturk  10 Acor messages  Correlation with expert annotation = 0.87  50 Acor messages + 50 Bambina messages

Number of Threads by Number of Posts

Min: 1 Max: 20,008 Mean: 22.92 Median: 6 99% of threads have less than 150 posts

Page 6: YICHIA WANG 2011/02/22 Weekly Meeting. Mturk  10 Acor messages  Correlation with expert annotation = 0.87  50 Acor messages + 50 Bambina messages

Number of Threads by Response Time

11% of threads (7,785 threads) never got response Min: <1 (day) Max: 916 (day) Mean: 2.10 (day) Median: 1 (day) 99% of threads got response in 21 days

Page 7: YICHIA WANG 2011/02/22 Weekly Meeting. Mturk  10 Acor messages  Correlation with expert annotation = 0.87  50 Acor messages + 50 Bambina messages

Number of Threads by Lifespan

Min: <1 (day) Max: 2769 (day) Mean: 32.97 (day) Median: 3 (day)

Page 8: YICHIA WANG 2011/02/22 Weekly Meeting. Mturk  10 Acor messages  Correlation with expert annotation = 0.87  50 Acor messages + 50 Bambina messages

Number of Threads versus Number of Reply Posts by Thread Starter

55% of thread starters would post again in the same threadMin: 1Max: 1,969Mean: 4.23Median: 2

Page 9: YICHIA WANG 2011/02/22 Weekly Meeting. Mturk  10 Acor messages  Correlation with expert annotation = 0.87  50 Acor messages + 50 Bambina messages

Number of Users by Registered Year

Page 10: YICHIA WANG 2011/02/22 Weekly Meeting. Mturk  10 Acor messages  Correlation with expert annotation = 0.87  50 Acor messages + 50 Bambina messages

Number of Users by Number of Posts

51% of users (46,269 users) never posted Min: 1 Max: 21,703 Mean: 53.49 Median: 3

Page 11: YICHIA WANG 2011/02/22 Weekly Meeting. Mturk  10 Acor messages  Correlation with expert annotation = 0.87  50 Acor messages + 50 Bambina messages

Number of Users by Number of Thread Starters

80% of users (72,587 users) never started a thread Min: 1 Max: 1,551 Mean: 3.94 Median: 1