38
Hierarchy Identification in Social Networks: Literature Review Denys Katerenchuk [email protected]

Hierarchy Identification in Social Networks: Literature ... · V. Zayats and M. Ostendorf, “Conversation modeling on reddit using a graph-structured lstm,” arXiv preprint arXiv:1704.02080,

  • Upload
    others

  • View
    0

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Hierarchy Identification in Social Networks: Literature ... · V. Zayats and M. Ostendorf, “Conversation modeling on reddit using a graph-structured lstm,” arXiv preprint arXiv:1704.02080,

Hierarchy Identification in Social Networks:

Literature Review

Denys [email protected]

Page 2: Hierarchy Identification in Social Networks: Literature ... · V. Zayats and M. Ostendorf, “Conversation modeling on reddit using a graph-structured lstm,” arXiv preprint arXiv:1704.02080,

2Title: Hierarchy Identification in Social Networks - Literature ReviewAuthor: Denys Katerenchuk Email: [email protected]

MotivationHello

Hello

Hello

Page 3: Hierarchy Identification in Social Networks: Literature ... · V. Zayats and M. Ostendorf, “Conversation modeling on reddit using a graph-structured lstm,” arXiv preprint arXiv:1704.02080,

3Title: Hierarchy Identification in Social Networks - Literature ReviewAuthor: Denys Katerenchuk Email: [email protected]

MotivationHello

Hello

Hello

Page 4: Hierarchy Identification in Social Networks: Literature ... · V. Zayats and M. Ostendorf, “Conversation modeling on reddit using a graph-structured lstm,” arXiv preprint arXiv:1704.02080,

4Title: Hierarchy Identification in Social Networks - Literature ReviewAuthor: Denys Katerenchuk Email: [email protected]

Motivation

Page 5: Hierarchy Identification in Social Networks: Literature ... · V. Zayats and M. Ostendorf, “Conversation modeling on reddit using a graph-structured lstm,” arXiv preprint arXiv:1704.02080,

5Title: Hierarchy Identification in Social Networks - Literature ReviewAuthor: Denys Katerenchuk Email: [email protected]

Applications● National Security

● Advertisement

● E-commerce

● News, Politics

Page 6: Hierarchy Identification in Social Networks: Literature ... · V. Zayats and M. Ostendorf, “Conversation modeling on reddit using a graph-structured lstm,” arXiv preprint arXiv:1704.02080,

6Title: Hierarchy Identification in Social Networks - Literature ReviewAuthor: Denys Katerenchuk Email: [email protected]

Overview1. Background

a. Motivationb. Historyc. Datad. Evaluation

2. Methodsa. Structure Analysisb. Language Analysis

i. N-gramii. Hedgingiii. Entrainmentiv. Politeness

c. Neural Network

3. Conclusion

Page 7: Hierarchy Identification in Social Networks: Literature ... · V. Zayats and M. Ostendorf, “Conversation modeling on reddit using a graph-structured lstm,” arXiv preprint arXiv:1704.02080,

7Title: Hierarchy Identification in Social Networks - Literature ReviewAuthor: Denys Katerenchuk Email: [email protected]

History

380 BC

Page 8: Hierarchy Identification in Social Networks: Literature ... · V. Zayats and M. Ostendorf, “Conversation modeling on reddit using a graph-structured lstm,” arXiv preprint arXiv:1704.02080,

8Title: Hierarchy Identification in Social Networks - Literature ReviewAuthor: Denys Katerenchuk Email: [email protected]

History

(Jacob Moreno 1932)

Page 9: Hierarchy Identification in Social Networks: Literature ... · V. Zayats and M. Ostendorf, “Conversation modeling on reddit using a graph-structured lstm,” arXiv preprint arXiv:1704.02080,

9Title: Hierarchy Identification in Social Networks - Literature ReviewAuthor: Denys Katerenchuk Email: [email protected]

History

Stirman, Shannon Wiltsey, and James W. Pennebaker. "Word use in the poetry of suicidal and nonsuicidal poets." Psychosomatic medicine 63.4 (2001): 517-522.

Page 10: Hierarchy Identification in Social Networks: Literature ... · V. Zayats and M. Ostendorf, “Conversation modeling on reddit using a graph-structured lstm,” arXiv preprint arXiv:1704.02080,

10Title: Hierarchy Identification in Social Networks - Literature ReviewAuthor: Denys Katerenchuk Email: [email protected]

Data

Shetty, Jitesh, and Jafar Adibi. "The Enron email dataset database schema and brief statistical report." Information sciences institute technical report, University of Southern California 4.1 (2004): 120-128.

www.wikipedia.org www.reddit.com www.stackexchange.com

Page 11: Hierarchy Identification in Social Networks: Literature ... · V. Zayats and M. Ostendorf, “Conversation modeling on reddit using a graph-structured lstm,” arXiv preprint arXiv:1704.02080,

11Title: Hierarchy Identification in Social Networks - Literature ReviewAuthor: Denys Katerenchuk Email: [email protected]

Data

www.twitter.com1. Viswanath, Bimal, et al. "On the evolution of user interaction in facebook." Proceedings of the 2nd ACM workshop on Online social networks. ACM, 2009.

2. Wilson, Christo, et al. "Beyond social graphs: User interactions in online social networks and their implications." ACM Transactions on the Web (TWEB) 6.4 (2012): 17.

Page 12: Hierarchy Identification in Social Networks: Literature ... · V. Zayats and M. Ostendorf, “Conversation modeling on reddit using a graph-structured lstm,” arXiv preprint arXiv:1704.02080,

12Title: Hierarchy Identification in Social Networks - Literature ReviewAuthor: Denys Katerenchuk Email: [email protected]

EvaluationAccuracy F-measure

where p and r are precision and recall

Page 13: Hierarchy Identification in Social Networks: Literature ... · V. Zayats and M. Ostendorf, “Conversation modeling on reddit using a graph-structured lstm,” arXiv preprint arXiv:1704.02080,

13Title: Hierarchy Identification in Social Networks - Literature ReviewAuthor: Denys Katerenchuk Email: [email protected]

EvaluationAverage Precision Mean Average Precision

where P(k) = precision@k and ∆R(k) = |recall(k − 1) − recall(k)|.

where Q = a set of ordering problems and q = a single evaluation instance

Page 14: Hierarchy Identification in Social Networks: Literature ... · V. Zayats and M. Ostendorf, “Conversation modeling on reddit using a graph-structured lstm,” arXiv preprint arXiv:1704.02080,

14Title: Hierarchy Identification in Social Networks - Literature ReviewAuthor: Denys Katerenchuk Email: [email protected]

EvaluationKendall's tau Discounted Cumulative

Gain

where c - a number of concordant (i.e. a correct relative ranking) pairs and d - a number ofdiscordant (i.e. an incorrect relative ranking) pairs.

where n - a number of elements and rel() - some relevance function of the i-th element in a given list.

where IDCG - represents the ideal DCG

Page 15: Hierarchy Identification in Social Networks: Literature ... · V. Zayats and M. Ostendorf, “Conversation modeling on reddit using a graph-structured lstm,” arXiv preprint arXiv:1704.02080,

15Title: Hierarchy Identification in Social Networks - Literature ReviewAuthor: Denys Katerenchuk Email: [email protected]

Evaluation

Page 16: Hierarchy Identification in Social Networks: Literature ... · V. Zayats and M. Ostendorf, “Conversation modeling on reddit using a graph-structured lstm,” arXiv preprint arXiv:1704.02080,

16Title: Hierarchy Identification in Social Networks - Literature ReviewAuthor: Denys Katerenchuk Email: [email protected]

Overview1. Background

a. Motivationb. Historyc. Datad. Evaluation

2. Methodsa. Structure Analysisb. Language Analysis

i. N-gramii. Hedgingiii. Entrainmentiv. Politeness

c. Neural Network

3. Conclusion

Page 17: Hierarchy Identification in Social Networks: Literature ... · V. Zayats and M. Ostendorf, “Conversation modeling on reddit using a graph-structured lstm,” arXiv preprint arXiv:1704.02080,

17Title: Hierarchy Identification in Social Networks - Literature ReviewAuthor: Denys Katerenchuk Email: [email protected]

Structure Analysis

Page 18: Hierarchy Identification in Social Networks: Literature ... · V. Zayats and M. Ostendorf, “Conversation modeling on reddit using a graph-structured lstm,” arXiv preprint arXiv:1704.02080,

18Title: Hierarchy Identification in Social Networks - Literature ReviewAuthor: Denys Katerenchuk Email: [email protected]

Structure AnalysisDegree Centrality

Page 19: Hierarchy Identification in Social Networks: Literature ... · V. Zayats and M. Ostendorf, “Conversation modeling on reddit using a graph-structured lstm,” arXiv preprint arXiv:1704.02080,

19Title: Hierarchy Identification in Social Networks - Literature ReviewAuthor: Denys Katerenchuk Email: [email protected]

Structure AnalysisCloseness Centrality

Page 20: Hierarchy Identification in Social Networks: Literature ... · V. Zayats and M. Ostendorf, “Conversation modeling on reddit using a graph-structured lstm,” arXiv preprint arXiv:1704.02080,

20Title: Hierarchy Identification in Social Networks - Literature ReviewAuthor: Denys Katerenchuk Email: [email protected]

Structure AnalysisBetweenness Centrality

Page 21: Hierarchy Identification in Social Networks: Literature ... · V. Zayats and M. Ostendorf, “Conversation modeling on reddit using a graph-structured lstm,” arXiv preprint arXiv:1704.02080,

21Title: Hierarchy Identification in Social Networks - Literature ReviewAuthor: Denys Katerenchuk Email: [email protected]

Structure AnalysisEigenvector Centrality

Page 22: Hierarchy Identification in Social Networks: Literature ... · V. Zayats and M. Ostendorf, “Conversation modeling on reddit using a graph-structured lstm,” arXiv preprint arXiv:1704.02080,

22Title: Hierarchy Identification in Social Networks - Literature ReviewAuthor: Denys Katerenchuk Email: [email protected]

Structure Analysis

J. Diesner and K. Carley, “Exploration of communication networks from the enron email corpus,” SIAM International Conference on Data Mining

● Closeness Centrality● Eigenvector Centrality

Structure Analysis Structure Analysisv.s.

A. Agarwal, A. Omuya, A. Harnly, and O. Rambow, “A comprehensive gold standardfor the enron organizational hierarchy,” in Proceedings of the 50th Annual Meeting ofthe Association for Computational Linguistics

E. Gilbert, “Phrases that signal workplace hierarchy,” in Proceedings of the ACM 2012 Conference on Computer Supported Cooperative Work, CSCW ’12

Page 23: Hierarchy Identification in Social Networks: Literature ... · V. Zayats and M. Ostendorf, “Conversation modeling on reddit using a graph-structured lstm,” arXiv preprint arXiv:1704.02080,

23Title: Hierarchy Identification in Social Networks - Literature ReviewAuthor: Denys Katerenchuk Email: [email protected]

Structure Analysis

J. Diesner and K. Carley, “Exploration of communication networks from the enron email corpus,” SIAM International Conference on Data Mining

● Closeness Centrality● Eigenvector Centrality

Structure Analysis Structure Analysisv.s.

A. Agarwal, A. Omuya, A. Harnly, and O. Rambow, “A comprehensive gold standardfor the enron organizational hierarchy,” in Proceedings of the 50th Annual Meeting ofthe Association for Computational Linguistics

E. Gilbert, “Phrases that signal workplace hierarchy,” in Proceedings of the ACM 2012 Conference on Computer Supported Cooperative Work, CSCW ’12

J. W. Johnsen and K. Franke, “Feasibility study of social network analysis on loosely structured communication networks,” Procedia Computer Science, vol. 108, pp. 2388– 2392, 2017

Page 24: Hierarchy Identification in Social Networks: Literature ... · V. Zayats and M. Ostendorf, “Conversation modeling on reddit using a graph-structured lstm,” arXiv preprint arXiv:1704.02080,

24Title: Hierarchy Identification in Social Networks - Literature ReviewAuthor: Denys Katerenchuk Email: [email protected]

Language Analysis

N-gram model SVM

Page 25: Hierarchy Identification in Social Networks: Literature ... · V. Zayats and M. Ostendorf, “Conversation modeling on reddit using a graph-structured lstm,” arXiv preprint arXiv:1704.02080,

25Title: Hierarchy Identification in Social Networks - Literature ReviewAuthor: Denys Katerenchuk Email: [email protected]

Language AnalysisWordNet

C. Fellbaum, “A semantic network of english verbs,” WordNet: An electronic lexical database, vol. 3, pp. 153–178, 1998

LIWC

J. W. Pennebaker, R. L. Boyd, K. Jordan, and K. Blackburn, “The development andpsychometric properties of liwc2015,”

Page 26: Hierarchy Identification in Social Networks: Literature ... · V. Zayats and M. Ostendorf, “Conversation modeling on reddit using a graph-structured lstm,” arXiv preprint arXiv:1704.02080,

26Title: Hierarchy Identification in Social Networks - Literature ReviewAuthor: Denys Katerenchuk Email: [email protected]

Language Analysis

P. Bramsen, M. Escobar-Molano, A. Patel, and R. Alonso, “Extracting social power relationships from natural language,” in Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies-Volume 1, pp. 773–782, Association for Computational Linguistics, 2011.

E. Gilbert, “Phrases that signal workplace hierarchy,” in Proceedings of the ACM 2012 Conference on Computer Supported Cooperative Work, CSCW ’12

Page 27: Hierarchy Identification in Social Networks: Literature ... · V. Zayats and M. Ostendorf, “Conversation modeling on reddit using a graph-structured lstm,” arXiv preprint arXiv:1704.02080,

27Title: Hierarchy Identification in Social Networks - Literature ReviewAuthor: Denys Katerenchuk Email: [email protected]

Hedges"Whenever you have time,

let's give it a try!"

G. Lakoff, “Hedges: A study in meaning criteria and the logic of fuzzy concepts,” Journal of philosophical logic, vol. 2, no. 4, pp. 458–508, 1973.

E. Choi, C. Tan, L. Lee, C. Danescu-Niculescu-Mizil, and J. Spindel, “Hedge detection as a lens on framing in the gmo debates: A position paper,” in Proceedings of the Workshop on Extra-Propositional Aspects of Meaning in Computational Linguistics, pp. 70–79, Association for Computational Linguistics, 2012.

Page 28: Hierarchy Identification in Social Networks: Literature ... · V. Zayats and M. Ostendorf, “Conversation modeling on reddit using a graph-structured lstm,” arXiv preprint arXiv:1704.02080,

28Title: Hierarchy Identification in Social Networks - Literature ReviewAuthor: Denys Katerenchuk Email: [email protected]

Entrainment

M. E. Ireland, R. B. Slatcher, P. W. Eastwick, L. E. Scissors, E. J. Finkel, and J. W.Pennebaker, “Language style matching predicts relationship initiation and stability,”Psychological science, vol. 22, no. 1, pp. 39–44, 2011.

Page 29: Hierarchy Identification in Social Networks: Literature ... · V. Zayats and M. Ostendorf, “Conversation modeling on reddit using a graph-structured lstm,” arXiv preprint arXiv:1704.02080,

29Title: Hierarchy Identification in Social Networks - Literature ReviewAuthor: Denys Katerenchuk Email: [email protected]

Entrainment

C. Danescu-Niculescu-Mizil, M. Gamon, and S. Dumais, “Mark my words!: linguistic style accommodation in social media,” in Proceedings of the 20th international conference on World wide web, pp. 745–754, ACM, 2011.

C. Danescu-Niculescu-Mizil, L. Lee, B. Pang, and J. Kleinberg, “Echoes of power: Language effects and power differences in social interaction,” in Proceedings of the 21st international conference on World Wide Web, pp. 699–708, ACM, 2012.

Page 30: Hierarchy Identification in Social Networks: Literature ... · V. Zayats and M. Ostendorf, “Conversation modeling on reddit using a graph-structured lstm,” arXiv preprint arXiv:1704.02080,

30Title: Hierarchy Identification in Social Networks - Literature ReviewAuthor: Denys Katerenchuk Email: [email protected]

Politeness

C. Danescu-Niculescu-Mizil, M. Sudhof, D. Jurafsky, J. Leskovec, and C. Potts, “A computational approach to politeness with application to social factors,” arXiv preprint arXiv:1306.6078, 2013

Page 31: Hierarchy Identification in Social Networks: Literature ... · V. Zayats and M. Ostendorf, “Conversation modeling on reddit using a graph-structured lstm,” arXiv preprint arXiv:1704.02080,

31Title: Hierarchy Identification in Social Networks - Literature ReviewAuthor: Denys Katerenchuk Email: [email protected]

NN: Word Embeddings

G. E. Hinton, J. L. McClelland, and D. E. Rumelhart, “Parallel distributed processing: Explorations in the microstructure of cognition, vol. 1,” ch. Distributed Representations, pp. 77–109, Cambridge, MA, USA: MIT Press, 1986.

Y. Bengio, R. Ducharme, P. Vincent, and C. Jauvin, “A neural probabilistic language model,” Journal of machine learning research, vol. 3, no. Feb, pp. 1137–1155, 2003.

Page 32: Hierarchy Identification in Social Networks: Literature ... · V. Zayats and M. Ostendorf, “Conversation modeling on reddit using a graph-structured lstm,” arXiv preprint arXiv:1704.02080,

32Title: Hierarchy Identification in Social Networks - Literature ReviewAuthor: Denys Katerenchuk Email: [email protected]

NN: Word Embeddings

T. Mikolov, K. Chen, G. Corrado, and J. Dean, “Efficient estimation of word representations in vector space,” arXiv preprint arXiv:1301.3781, 2013.

T. Mikolov, I. Sutskever, K. Chen, G. S. Corrado, and J. Dean, “Distributed representations of words and phrases and their compositionality,” in Advances in neural information processing systems, pp. 3111–3119, 2013.

Page 33: Hierarchy Identification in Social Networks: Literature ... · V. Zayats and M. Ostendorf, “Conversation modeling on reddit using a graph-structured lstm,” arXiv preprint arXiv:1704.02080,

33Title: Hierarchy Identification in Social Networks - Literature ReviewAuthor: Denys Katerenchuk Email: [email protected]

NN: Hedge

Adel, Heike, and Hinrich Schütze. "Exploring different dimensions of attention for uncertainty detection." arXiv preprint arXiv:1612.06549 (2016).

Page 34: Hierarchy Identification in Social Networks: Literature ... · V. Zayats and M. Ostendorf, “Conversation modeling on reddit using a graph-structured lstm,” arXiv preprint arXiv:1704.02080,

34Title: Hierarchy Identification in Social Networks - Literature ReviewAuthor: Denys Katerenchuk Email: [email protected]

NN: Hedge

Krizhevsky, Alex, Ilya Sutskever, and Geoffrey E. Hinton. "Imagenet classification with deep convolutional neural networks." Advances in neural information processing systems. 2012.

Page 35: Hierarchy Identification in Social Networks: Literature ... · V. Zayats and M. Ostendorf, “Conversation modeling on reddit using a graph-structured lstm,” arXiv preprint arXiv:1704.02080,

35Title: Hierarchy Identification in Social Networks - Literature ReviewAuthor: Denys Katerenchuk Email: [email protected]

NN: Hedge

Adel, Heike, and Hinrich Schütze. "Exploring different dimensions of attention for uncertainty detection." arXiv preprint arXiv:1612.06549 (2016).

Page 36: Hierarchy Identification in Social Networks: Literature ... · V. Zayats and M. Ostendorf, “Conversation modeling on reddit using a graph-structured lstm,” arXiv preprint arXiv:1704.02080,

36Title: Hierarchy Identification in Social Networks - Literature ReviewAuthor: Denys Katerenchuk Email: [email protected]

NN: LSTM

Gers, Felix A., Jürgen Schmidhuber, and Fred Cummins. "Learning to forget: Continual prediction with LSTM." (1999): 850-855.

Page 37: Hierarchy Identification in Social Networks: Literature ... · V. Zayats and M. Ostendorf, “Conversation modeling on reddit using a graph-structured lstm,” arXiv preprint arXiv:1704.02080,

37Title: Hierarchy Identification in Social Networks - Literature ReviewAuthor: Denys Katerenchuk Email: [email protected]

NN: Graph-structured LSTM

V. Zayats and M. Ostendorf, “Conversation modeling on reddit using a graph-structured lstm,” arXiv preprint arXiv:1704.02080, 2017.

Page 38: Hierarchy Identification in Social Networks: Literature ... · V. Zayats and M. Ostendorf, “Conversation modeling on reddit using a graph-structured lstm,” arXiv preprint arXiv:1704.02080,

Hierarchy Identification in Social Networks: Literature Review

Denys [email protected]

Summary:

•Hierarchy detection is a hard problem•Structure and Language are indicative•Neural Networks will make to improveresults in this area