23

exploring enron – visualizing anlp results (an aanlp project)

  • Upload
    kiefer

  • View
    23

  • Download
    0

Embed Size (px)

DESCRIPTION

exploring enron – visualizing anlp results (an aanlp project) Jeffrey Heer – [email protected]. the problem. ANLP technologies are highly valuable but often less than usable and reliable… - PowerPoint PPT Presentation

Citation preview

Page 1: exploring enron – visualizing anlp results  (an aanlp project)
Page 2: exploring enron – visualizing anlp results  (an aanlp project)
Page 3: exploring enron – visualizing anlp results  (an aanlp project)
Page 4: exploring enron – visualizing anlp results  (an aanlp project)

exploring enron – visualizing anlp results (an aanlp project)Jeffrey Heer – [email protected]

Page 5: exploring enron – visualizing anlp results  (an aanlp project)

the problem ANLP technologies are highly valuable but

often less than usable and reliable… Can be hard to make sense of results… how

to go from reams of textual output to new knowledge and insight?

Completely automated processing can be dangerous! Can be wrong or obscure patterns, especially when trusted training data is not available.

Page 6: exploring enron – visualizing anlp results  (an aanlp project)

one possible solution Turn ANLP technologies into tools usable

within exploratory data environments Enable users to directly visualize and analyze the

results of processing, always providing access to the underlying source data.

Users can then use these tools to further analysis, while simultaneously making their own decisions of the quality of processing results and possibly even correcting algorithms as they go.

Page 7: exploring enron – visualizing anlp results  (an aanlp project)

visualize inferred social networkview message traffic and actual e-mail text

Page 8: exploring enron – visualizing anlp results  (an aanlp project)

visualize clustering results – color coded to enron business e-mailspie charts indicate categorizations of e-mail traffic

Page 9: exploring enron – visualizing anlp results  (an aanlp project)

zoom and pan to explore large networks

Page 10: exploring enron – visualizing anlp results  (an aanlp project)

filter network for ‘hubs’ of higher connectivity

Page 11: exploring enron – visualizing anlp results  (an aanlp project)

filter, zoom, details on demand! view all messages to or from a given person…

Page 12: exploring enron – visualizing anlp results  (an aanlp project)

…or view all message traffic between two people.

Page 13: exploring enron – visualizing anlp results  (an aanlp project)

networks form various communities … some obvious, some notcan we process the inferred network to automatically identify communties at various granularities?attempt social network analysis using a hierarchical agglomerative clustering approach, greedily combining groups into communities based on a criterion function that compares within-community edges against total connectivity.

Page 14: exploring enron – visualizing anlp results  (an aanlp project)
Page 15: exploring enron – visualizing anlp results  (an aanlp project)
Page 16: exploring enron – visualizing anlp results  (an aanlp project)

show results of community analysis at various stages of progress… allowing interactive exploration of the agglomerative cluster tree

Page 17: exploring enron – visualizing anlp results  (an aanlp project)

analysis scenario filtered graph to isolate “power players” looked for “california” color labels on edges found John Shelk reporting on congressional

meetings to Tim Belden – all one way e-mails looking at Time Belden revealed ALL one-

way e-mails sent to him, no responses, etc seemed a bit suspicious… where is that info

going?

Page 18: exploring enron – visualizing anlp results  (an aanlp project)

Analysis scenario

All one way e-mails to Tim Belden about various legal issues…

Page 19: exploring enron – visualizing anlp results  (an aanlp project)

guilty!

Page 20: exploring enron – visualizing anlp results  (an aanlp project)

future work a plenty improved colors, filtering, and brushing

category filtering, brushing from e-mails to graph histogram visualization over sliders

visualize network of messages themselves? temporal dimension of data

time-selection range slider animate evolution of the network

search search search tie to additional analyses

automated clustering finer social network analysis duplicate identification, acronym resolution, etc…

Page 21: exploring enron – visualizing anlp results  (an aanlp project)
Page 22: exploring enron – visualizing anlp results  (an aanlp project)

please send me any ideas you have to improve this!!! [email protected]

Page 23: exploring enron – visualizing anlp results  (an aanlp project)

I’m Kenneth Lay. And I

approve this message.