37
Automatic Summarization By Team [TL;DR] Contributors - Jeremy Brown, Bryan Winters, Austin Ray 1

Auto mat i c Su mmari zat i onpeople.uncw.edu/tagliarinig/Courses/380/F2016 papers and...TextRank 8 The Original Idea 8 Formal Statement of the Si mil arit y Eq uat i on 8 Implementation

  • Upload
    others

  • View
    0

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Auto mat i c Su mmari zat i onpeople.uncw.edu/tagliarinig/Courses/380/F2016 papers and...TextRank 8 The Original Idea 8 Formal Statement of the Si mil arit y Eq uat i on 8 Implementation

Automatic Summarization

By Team [TL;DR]

Contributors - Jeremy Brown, Bryan Winters, Austin Ray

1

Page 2: Auto mat i c Su mmari zat i onpeople.uncw.edu/tagliarinig/Courses/380/F2016 papers and...TextRank 8 The Original Idea 8 Formal Statement of the Si mil arit y Eq uat i on 8 Implementation

Table of Contents

Problem Statement & Solution 3

Automatic Summarization 3

The Plan 3

Responsibility 3

Preprocessors 4 For TextRank and SumBasic 4 For SMMRY 4

SMMRY 4 Pseudocode 4 Implementation 6

SumBasic 7 Pseudocode 7 Explanation of Pseudocode 7 Implementation 7

TextRank 8 The Original Idea 8 Formal Statement of the Similarity Equation 8 Implementation 8 Time Complexity for the Similarity Equation 9

Results 9 The Texts to Summarize 9 Speed & Efficiency 9 Readability 11 Conclusion 13

Future Work 13 TextRank 13 SMMRY 13 SumBasic 14

Questions and Answers 14

Summaries 14 SumBasic 14 TextRank 22 SMMRY 28

Works Cited 36

2

Page 3: Auto mat i c Su mmari zat i onpeople.uncw.edu/tagliarinig/Courses/380/F2016 papers and...TextRank 8 The Original Idea 8 Formal Statement of the Si mil arit y Eq uat i on 8 Implementation

Problem Statement & Solution Many users can become easily overloaded by the amount of content found online. It is also possible

that they may not have enough time throughout their day to take all the material in. Either, or both, cause

users’ to settle for less when they should be getting the best benefit they can. This is where our project comes

into play. The amount of media that a user comes into contact with every day is a lot. One way to make this

more manageable for users is to reduce. If users’ could be granted the ability to summarize text, they can get

the same information from web articles, posts, etc. without having to read the whole thing.

Automatic Summarization The definition of automatic summarization is an obvious one. The process takes in text, grades

sentences using an algorithm, and then produces an output that retains the original text’s main points while

maintaining fluid readability. The grading algorithm finds subset blocks of data that represent the information

of the original text. There are two approaches to automatic summarization, extraction and abstraction. The

path our team has focused on is extraction, which selects a subset of words, phrases, or sentences from the

original text and utilizes those data points to craft a summary.

The Plan Our team created three algorithms that summarize n-length bodies of text, where n is the number of

sentences in the original text. The algorithms have the ability to summarize text from any language, although

each one requires a preprocessor that splits the original text into a set of sentences. Preprocessors must deal

with language specific characters, such as hiragana script. To evaluate the algorithms, we ran each on five

separate texts while collecting data to track the speed and efficiency of the running program. We then graded

the summaries based on readability.

Responsibility Jeremy

TextRank implementation, Creating the preprocessor for TextRank and SumBasic, Grading Bryan’s summaries

Austin

SumBasic implementation, Running algorithms and collecting data, Grading Jeremy’s summaries

Bryan

SMMRY implementation, Creating the preprocessor for SMMRY, Grading Austin’s summaries

3

Page 4: Auto mat i c Su mmari zat i onpeople.uncw.edu/tagliarinig/Courses/380/F2016 papers and...TextRank 8 The Original Idea 8 Formal Statement of the Si mil arit y Eq uat i on 8 Implementation

Preprocessors

For TextRank and SumBasic The preprocessor for TextRank and SumBasic is implemented using the Java programming language. It

first takes in a text file, which is then broken up line by line using the BreakIterator class that Java provides.

One huge hurdle that we had to overcome was determining exactly what defines a line break. To accomplish

this, we first iterated through each line and dealt with any instance where something in the text would cause

the BreakIterator to fail. Once these instances are dealt with, the BreakIterator class is free to run through the

original text and split it into an array of sentences.

For SMMRY SMMRY’s preprocessor was implemented using the Python programming language and the ‘re’ library.

It takes a text file and separates it, by line, into individual sentences. It detects the end of sentences marked

with a period. The preprocessor makes exceptions for prefixes such as ‘Mr. , Mrs. , Ms. , Dr. , etc.’ and

continues to the next period to mark the end of a sentence. Allowing for these exceptions was a difficult part.

To accomplish this, we wrote a regular expression. It splits the text using re.split() followed by the regular

expression. After the preprocessor separates the original text into individual sentences, the output is ready for

summarization.

SMMRY The SMMRY algorithm was developed in 2009 to summarize articles and text. SMMRY works by taking

sentences from a given document and ranking them by importance. A sentence’s importance is determined by

the popularity of the words that it contains. Sentences are ranked by selecting keywords that focus on a topic

reorganizes the sentences. The algorithm also removes transition sentences, unnecessary clauses, and

excessive examples in order to keep the summary focused on the topic.

Pseudocode SMMRY’s core algorithm is broken down into 7 steps: First the algorithm associates words with their

grammatical counterparts. It then calculates the occurrence of each word; followed by assigning each word

points based on their occurrence rate. Each word starts with a popularity of 0 and each time the algorithm finds

an occurrence of the word, one point is added. The algorithm then detects periods that indicate the end of

sentences. It will omit periods for “Mr. , Mrs., etc.” The original text is split into individual sentences. These

sentences are ranked by the word points determined in the previous steps. Finally the algorithm will output a

specific number of sentences from highest rank to lowest. The specific number of output sentences is

determined by the user. The time complexity of SMMRY is dependent on the implementation; however, it will

follow the time of O(n^2). The space complexity of SMMRY follows O(log(n). The time complexity is determined

4

Page 5: Auto mat i c Su mmari zat i onpeople.uncw.edu/tagliarinig/Courses/380/F2016 papers and...TextRank 8 The Original Idea 8 Formal Statement of the Si mil arit y Eq uat i on 8 Implementation

by the fact that the algorithm implements a form of Quicksort for an array of unranked sentences. As each

sentence is ranked, if it has the highest word score at the time, it is sent to the top of the proverbial stack.

Users can go to SMMRY’s website and input any text into the text field. In theory, length is not a

constraint. Alternatively, users can upload files or even paste URLs. The site also allows for the user to have

specific constraints. These include omitting questions, exclamations, and quotes from the final summary as well

as including a heat map that color codes sentence importance and specifying the topic, which highlights the

keywords in the summary.

*In the last stage, X is an integer given by the user

5

Page 6: Auto mat i c Su mmari zat i onpeople.uncw.edu/tagliarinig/Courses/380/F2016 papers and...TextRank 8 The Original Idea 8 Formal Statement of the Si mil arit y Eq uat i on 8 Implementation

Implementation

For this implementation of SMMRY, the step where associated words are stored was ignored. This was

determined to be an unnecessary step and by eliminating it, the algorithm would run faster. The flow chart

above shows SMMRY’s original step by step process while the chart below shows our implementation. When a

document is put into the algorithm, it is run through the preprocessor mentioned above and is separated into

individual sentences. The NLTK library tokenizes words to determine the frequency of each word. Words are

assigned a token, or point, for each instance in the text. The algorithm then gets the sum of all tokens per

sentence and reorders them from highest token count to lowest. It then prints ‘X’ number of sentences into an

output file; where ‘X’ is determined by the user. As mentioned in the pseudocode section, because the

sentence ranking process is done through a quicksort, the time complexity of this implementation is O(n^2).

6

Page 7: Auto mat i c Su mmari zat i onpeople.uncw.edu/tagliarinig/Courses/380/F2016 papers and...TextRank 8 The Original Idea 8 Formal Statement of the Si mil arit y Eq uat i on 8 Implementation

SumBasic SumBasic is a generic multi-document automatic summarization algorithm developed in 2005 by

Nenkova and Vanderwende. It was designed with the observation that frequently occurring words have a

higher probability of occurring in a summary than words that appear less frequently. It generates n length

summaries, where n is user specified number of sentences. The algorithm itself is language agnostic, but

requires a preprocessor to provide a set of sentences based on a language’s grammatical syntax and structure.

The algorithm has a time complexity of SumBasic is dependent on the implementation; however, it will follow

the time of O(step 1 complexity + n*(step 2, 3, and 4 complexity)).

Pseudocode 1. Compute the probability distribution over the words wi appearing in the input, p(wi), for every i, where

i is the index of a word

a. p(wi)= where n is the number of times the word appeared in the input, and N is the totalnN

number of content word tokens in the input.

2. For each sentence Sj in the input, assign a weight equal to the average probability of the words in the

sentence.

a. Weight(Sj) = ∑

w∈Si j

p(w )iw |w∈S|

|{ i i j}||

3. Pick the highest weighted sentence that contains the highest probability words

4. For each word wi in the sentence chosen, update probability

a. Pnew(wi)=pold(wi) * pold(wi) 5. If desired length is not met, go back to step 2.

Explanation of Pseudocode Steps 2 and 3 exhibit the desired properties of the summarizer with step 3 ensuring the highest

probability word is included in the summary every time a sentence is picked.

Step 4 has three purposes:

1. It provides context to the summarizer by changing the notion of “what is most important to include in

the summary?” depending on what has already been included in the summary.

2. Updating probabilities allows initially low probability words to have an impact on choice of subsequent

sentences.

3. Update word probability to deal with redundancy if multiple documents were in the input. This allows

the summarizer to “learn” as it processes multiple documents.

Implementation For the implementation of the SumBasic algorithm, it was decided that a naïve approach would provide

a worst case scenario for the algorithm’s performance. As such, each of the pseudocode’s steps are

7

Page 8: Auto mat i c Su mmari zat i onpeople.uncw.edu/tagliarinig/Courses/380/F2016 papers and...TextRank 8 The Original Idea 8 Formal Statement of the Si mil arit y Eq uat i on 8 Implementation

programmed to be inherently bad. As a result, the time complexity of the implementation is O(2*n +

n*(n3+n*log(n)+n2). A breakdown for the time complexity is as follows: 2*n for step 1, n*( ) for step 5, n3 for

step 2, n * log(n) for step 3, and n2 for step 4. The sorting algorithm used in step 3 was Java’s built-in

Collections.sort() method, which has a complexity of n*log(n).

TextRank

The Original Idea Rada Mihalcea and Paul Tarau proposed the idea behind TextRank to the department of computer

science at the University of North Texas. The idea is a graph based ranking algorithm, which decides on the

importance of a vertex within a graph. It uses global information recursively computed from the entire graph,

rather than relying only on local vertex-specific information. When one vertex links to another in the graph it is

basically casting a vote for that other vertex. The higher the number of votes, the higher the importance. The

vertex that casts the vote is also taken into consideration. The score associated with a vertex is determined

based on the votes that are cast for it, and the score of the vertices casting these votes.

Formal Statement of the Similarity Equation

Given two sentences and , where each sentence is represented by the set of words that appearSi Sj N i

in the sentence. . The similarity equation is as follows:, , ..,Si = wi1 wi2 . win

imilarity(S , ) |{w | w εS&w εS }| / log(|S |) og|S |S i Sj = k k i k j i + l j

Implementation This original concept can be applied to automatic summarization first by constructing a graph that

represents the text. This is done through our preprocessor. Co-occurrence is not important here because it is

highly unlikely that a sentence will be repeated more than once. The relationship that is considered for

sentence extraction is the similarity between two sentences. Similarity can be determined by using a number

of words as common tokens. The length of the sentences is also taken into consideration by using a

normalization factor. To normalize, the content overlap of two sentences is divided by the length of each

sentence. After the ranking algorithm is ran on the graph, sentences are selected based on their score and

sorted in the order they appeared in the original text.

Here is a short example of the process. If we have three sentences, sentence one and two are

compared. The similarity is saved for sentence one. Sentence two and three are compared. The similarity is

saved for sentence two. Dealing with the last sentence is a little bit different. Sentence three and two are

compared and the similarity is saved for sentence three.

8

Page 9: Auto mat i c Su mmari zat i onpeople.uncw.edu/tagliarinig/Courses/380/F2016 papers and...TextRank 8 The Original Idea 8 Formal Statement of the Si mil arit y Eq uat i on 8 Implementation

Time Complexity for the Similarity Equation There are a two steps to the similarity equation. Given two sentences (denoted i and j), the first

operation must prepare the sentences to be compared. This involves removing any punctuation that would

cause two strings to differ. The time complexity for this step is O(10 + 10 ) where n is the number of wordsni nj

in a sentence. The second step compares the words in the sentences. The time complexity for this step is O( ni* ). Therefore, the overall time complexity for the similarity equation is O(10 + 10 + * ).nj ni nj ni nj

Results

The Texts to Summarize Our team selected five texts to summarize. We ran each through the algorithms two separate times

with varying summary lengths. This provided us with 10 summaries per algorithm, a total of thirty. The original

texts we decided on summarizing were Cinderella by the Grimm Brothers (156 sentences), Abraham Lincoln’s

Gettysburg Address (10 sentences), Eisenhower’s Farewell Address (84 sentences), General MacArthur’s ‘Duty,

Honor, Country’ (84 sentences), and Yellow Submarine by The Beatles (36 sentences).

*You can find all of the summaries at the end of this paper.

Speed & Efficiency Speed was determined by the time it took for the algorithm to complete its process and output to a text file.

This was computed by clocking the start and end time via a language’s standard library.

9

Page 10: Auto mat i c Su mmari zat i onpeople.uncw.edu/tagliarinig/Courses/380/F2016 papers and...TextRank 8 The Original Idea 8 Formal Statement of the Si mil arit y Eq uat i on 8 Implementation

Results:

● SMMRY was always the slowest, probably due to the use of NLTK in the implementation

● SumBasic was the fastest, probably due to the simplicity of the pseudocode

Efficiency was determined by measuring the RAM and CPU usage during an algorithm’s runtime. Data was

gathered using the ps UNIX command and wrote to a data file for analysis.

10

Page 11: Auto mat i c Su mmari zat i onpeople.uncw.edu/tagliarinig/Courses/380/F2016 papers and...TextRank 8 The Original Idea 8 Formal Statement of the Si mil arit y Eq uat i on 8 Implementation

Results:

● On average, TextRank had the lowest CPU usage

● SMMRY had high CPU usage due to dependence on NLTK

● SumBasic had random CPU spikes, but since this is average CPU usage over time, the results could be

misleading due to fast execution times

Results:

● SumBasic performed the worst due to implementation of worst case

● SMMRY had pretty consistent memory usage

11

Page 12: Auto mat i c Su mmari zat i onpeople.uncw.edu/tagliarinig/Courses/380/F2016 papers and...TextRank 8 The Original Idea 8 Formal Statement of the Si mil arit y Eq uat i on 8 Implementation

*All speed and efficiency metrics were gathered on a testbench running Linux with a 3.5GHz 8 core processor

and 16GB of 1600MHz RAM. Any necessary data files were loaded from storage into a RAM drive prior to

runtime.

Readability Readability was us implementing a manual checklist, where we read through each summary and graded them

based on our rubric.

Grading Rubric:

4 3 2 1

Purpose Statement Clear

Purpose statement is clearly defined within the summary.

The purpose statement is there but is not fully defined.

The purpose statement can be found it bits and pieces.

No Purpose Statement

Starts Well Clearly starts the summary off in the direction the original author intended.

Less clear, but the preceding sentences help get the summary started.

The start of the paragraph is in the summary somewhere.

The start is at the end, or the summary did not include something to start the text off.

Ends Well Clearly ends the summary in the direction the original author intended.

Less clear, but the preceding sentences help get the summary ended.

The end of the paragraph is in the summary somewhere.

The end is at the start, or the summary just trailed off without a conclusion.

Sentence Order

Sentences are in a correct order such that reading is fluid and understandable

Majority of sentences are in order such that the reader has little trouble understanding

Majority of sentences are out of order, but the reader can understand the summary with difficulty

Every sentence is out of order presenting an unintelligible summary

Main Points Clear

Reader can determine all the main points of the original document from summary

Reader can determine the majority of main points of the original document from the summary

Reader cannot determine the majority of main points of the original document from the summary

Reader cannot determine any of the main points of the original document form the summary

Tone Tone is the same as the original document

Tone is changed slightly (i.e. positive to mostly positive)

Tone is changed vastly (i.e. positive tone to mostly

Tone is opposite of original document (i.e. positive to

12

Page 13: Auto mat i c Su mmari zat i onpeople.uncw.edu/tagliarinig/Courses/380/F2016 papers and...TextRank 8 The Original Idea 8 Formal Statement of the Si mil arit y Eq uat i on 8 Implementation

negative tone) negative)

Results:

● TextRank scored the highest on average

● SumBasic had the least deviation in readability scores

● SMMRY performed better in some summaries; however, it performed the worst with other summaries

Conclusion SMMRY uses the least memory on average and produces summaries with good readability

scores, but it occasionally produces summaries with low readability scores, is the slowest on average, and uses the most CPU on average. TextRank produced the highest average readability scores, used only slightly more memory than SMMRY, and had consistent CPU usage compared to SMMRY and SumBasic. However, speed was not as fast as SumBasic, but significantly faster than SMMRY. SumBasic was consistently the fastest algorithm, but had the highest memory usage and produces average readability scores. Furthermore, CPU usage was inconsistent for SumBasic. SMMRY

● Pros: Lowest memory usage, can produce good summaries

● Cons: Slowest, highest CPU usage on average, can produce bad summaries

13

Page 14: Auto mat i c Su mmari zat i onpeople.uncw.edu/tagliarinig/Courses/380/F2016 papers and...TextRank 8 The Original Idea 8 Formal Statement of the Si mil arit y Eq uat i on 8 Implementation

TextRank

● Pros: Highest average readability scores, consistent CPU usage,

● Cons: Slower than SumBasic, requires more memory than SMMRY

SumBasic

● Pros: Consistently the fastest, consistent readability scores

● Cons: Highest memory usage, inconsistent CPU usage, average readability scores

Future Work

TextRank ● Look into implementing a regular expression for the preprocessor

● Figure out ways to decrease RAM usage

● Have every sentence cast a vote for every other sentence

● Deal with sentence co-occurrence

SMMRY ● Prevent conjunction words from being tokenized

● Do not allow for summaries being longer than original text

● Reduce NLTK library size

● Handle other UNICODE encoding other than ASCII

SumBasic ● Better dictionary lookups

● Associate grammar counterparts and contractions (e.g. city and cities, it’s and it is)

● Reduce implementation time complexity

Questions and Answers 1. In the TextRank Similarity Equation, what is the purpose of normalizing?

a. To avoid the promotion of long sentences

2. What is the purpose of a preprocessor?

a. It is needed to separate sentences into an array for the algorithms to compare and rank them.

3. What defines a good summary?

a. A good summary has a clear purpose statement, starts/ends well, maintains sentence order,

clearly states main point, and keeps the tone consistent with the original text.

4. What type of approach do our three algorithms utilize?

a. Extraction. The process of extraction is done by selecting a subset of existing words, phrases, or

sentences to form a summary.

14

Page 15: Auto mat i c Su mmari zat i onpeople.uncw.edu/tagliarinig/Courses/380/F2016 papers and...TextRank 8 The Original Idea 8 Formal Statement of the Si mil arit y Eq uat i on 8 Implementation

5. What is the purpose of squaring the probability of each word in a chosen sentence in the SumBasic

algorithm?

a. To provide context sensitivity. i.e. change the notion of “what is most important to include”

based on already summarized information

Summaries

SumBasic Cinderella - 25 sentences

When they came to the kitchen, Cinderella was lying there in the ashes as usual, for she had jumped

down from the other side of the tree, had taken the beautiful dress back to the bird in the hazel tree,

and had put on her gray smock. The girl went through the back door into the garden, and called out,

"You tame pigeons, you turtledoves, and all you birds beneath the sky, come and help me to gather:

The good ones go into the pot, The bad ones go into your crop." The next morning, he went with it to

the man, and said to him, "No one shall be my wife except for the one whose foot fits this golden

shoe." He turned his horse around and took the false bride home again, saying that she was not the

right one, and that the other sister should try on the shoe. Then her mother gave her a knife, and said,

"Cut a piece off your heel. The pigeons nodded their heads and began to pick, pick, pick, pick.

The prince danced only with her, and whenever anyone else asked her to dance, he would say, "She is

my dance partner." When they passed the hazel tree, the two pigeons were sitting in it, and they cried

out: Rook di goo, rook di goo! On the third day, when her parents and sisters had gone away,

Cinderella went again to her mother's grave and said to the tree: Shake and quiver, little tree, Throw

gold and silver down to me. He had them bring him an ax and a pick so that he could break the pigeon

coop apart, but no one was inside. Cinderella began to cry, and then the stepmother said, "You may go

if you are able to pick two bowls of lentils out of the ashes for me in one hour," thinking to herself, "She

will never be able to do that." He looked down at her foot and saw how the blood was running out of

her shoe, and how it had stained her white stocking all red. However, because Cinderella kept asking,

the stepmother finally said, "I have scattered a bowl of lentils into the ashes for you. When she arrived

at the festival in this dress, everyone was so astonished that they did not know what to say. He waited

until her father came, then said to him, "The unknown girl has eluded me, and I believe she has climbed

up the pear tree. When evening came Cinderella wanted to leave, and the prince tried to escort her,

but she ran away from him so quickly that he could not follow her. They took her beautiful clothes away

from her, dressed her in an old gray smock, and gave her wooden shoes. When the bridal couple

walked into the church, the older sister walked on their right side and the younger on their left side,

and the pigeons pecked out one eye from each of them. A rich man's wife became sick, and when she

felt that her end was drawing near, she called her only daughter to her bedside and said, "Dear child,

remain pious and good, and then our dear God will always protect you, and I will look down on you

from heaven and be near you." The prince told him to send her to him, but the mother answered, "Oh,

no, she is much too dirty. This time the bird threw down to her a dress that was more splendid and

magnificent than any she had yet had, and the slippers were of pure gold. They never once thought it

was Cinderella, for they thought that she was sitting at home in the dirt, looking for lentils in the ashes.

"Father, break off for me the first twig that brushes against your hat on your way home." Cinderella

went to this tree three times every day, and beneath it she wept and prayed. The girl took the bowl to

15

Page 16: Auto mat i c Su mmari zat i onpeople.uncw.edu/tagliarinig/Courses/380/F2016 papers and...TextRank 8 The Original Idea 8 Formal Statement of the Si mil arit y Eq uat i on 8 Implementation

her stepmother, and was happy, thinking that now she would be allowed to go to the festival with

them.

Cinderella - 50 sentences

When they came to the kitchen, Cinderella was lying there in the ashes as usual, for she had jumped

down from the other side of the tree, had taken the beautiful dress back to the bird in the hazel tree,

and had put on her gray smock. The girl went through the back door into the garden, and called out,

"You tame pigeons, you turtledoves, and all you birds beneath the sky, come and help me to gather:

The good ones go into the pot, The bad ones go into your crop." The next morning, he went with it to

the man, and said to him, "No one shall be my wife except for the one whose foot fits this golden

shoe." He turned his horse around and took the false bride home again, saying that she was not the

right one, and that the other sister should try on the shoe. Then her mother gave her a knife, and said,

"Cut a piece off your heel. The pigeons nodded their heads and began to pick, pick, pick, pick. The

prince danced only with her, and whenever anyone else asked her to dance, he would say, "She is my

dance partner." When they passed the hazel tree, the two pigeons were sitting in it, and they cried out:

Rook di goo, rook di goo! On the third day, when her parents and sisters had gone away, Cinderella

went again to her mother's grave and said to the tree: Shake and quiver, little tree, Throw gold and

silver down to me. He had them bring him an ax and a pick so that he could break the pigeon coop

apart, but no one was inside. Cinderella began to cry, and then the stepmother said, "You may go if you

are able to pick two bowls of lentils out of the ashes for me in one hour," thinking to herself, "She will

never be able to do that." He looked down at her foot and saw how the blood was running out of her

shoe, and how it had stained her white stocking all red. However, because Cinderella kept asking, the

stepmother finally said, "I have scattered a bowl of lentils into the ashes for you. When she arrived at

the festival in this dress, everyone was so astonished that they did not know what to say. He waited

until her father came, then said to him, "The unknown girl has eluded me, and I believe she has climbed

up the pear tree. When evening came Cinderella wanted to leave, and the prince tried to escort her,

but she ran away from him so quickly that he could not follow her. They took her beautiful clothes away

from her, dressed her in an old gray smock, and gave her wooden shoes. When the bridal couple

walked into the church, the older sister walked on their right side and the younger on their left side,

and the pigeons pecked out one eye from each of them. A rich man's wife became sick, and when she

felt that her end was drawing near, she called her only daughter to her bedside and said, "Dear child,

remain pious and good, and then our dear God will always protect you, and I will look down on you

from heaven and be near you." The prince told him to send her to him, but the mother answered, "Oh,

no, she is much too dirty. This time the bird threw down to her a dress that was more splendid and

magnificent than any she had yet had, and the slippers were of pure gold. They never once thought it

was Cinderella, for they thought that she was sitting at home in the dirt, looking for lentils in the ashes.

"Father, break off for me the first twig that brushes against your hat on your way home."

Cinderella went to this tree three times every day, and beneath it she wept and prayed. The girl took

the bowl to her stepmother, and was happy, thinking that now she would be allowed to go to the

festival with them. The prince had waited until she came, then immediately took her by the hand, and

danced only with her. Before a half hour had passed they were finished, and they all flew out again.

One day it happened that the father was going to the fair, and he asked his two stepdaughters what he

should bring back for them. You are not coming with us, for you have no clothes, and you don't know

how to dance. Two white pigeons came in through the kitchen window, and then the turtledoves, and

finally all the birds beneath the sky came whirring and swarming in, and lit around the ashes.

16

Page 17: Auto mat i c Su mmari zat i onpeople.uncw.edu/tagliarinig/Courses/380/F2016 papers and...TextRank 8 The Original Idea 8 Formal Statement of the Si mil arit y Eq uat i on 8 Implementation

When evening came she wanted to leave, and the prince followed her, wanting to see into which house

she went. The girl cut off her toe, forced her foot into the shoe, swallowed the pain, and went out to

the prince. When the two stepsisters heard that they too had been invited, they were in high spirits.

When she stood up the prince looked into her face, and he recognized the beautiful girl who had

danced with him. So he bought beautiful dresses, pearls, and jewels for his two stepdaughters. And the

others also began to pick, pick, pick, pick. He took her on his horse as his bride and rode away with her.

When winter came the snow spread a white cloth over the grave, and when the spring sun had

removed it again, the man took himself another wife. When she ran down the stairs, her left slipper

stuck in the pitch. You have neither clothes nor shoes, and yet you want to dance!" With this she

turned her back on Cinderella, and hurried away with her two proud daughters. She went into her

bedroom, and got her toes into the shoe all right, but her heel was too large. They gathered all the

good grains into the bowls. She could not get her big toe into it, for the shoe was too small for her. The

shoe is too tight, This bride is not right! When you are queen you will no longer have to go on foot."

After they had cried this out, they both flew down and lit on Cinderella's shoulders, one on the right,

the other on the left, and remained sitting there. "There is only a deformed little Cinderella from my

first wife, but she cannot possibly be the bride." However, they had to ride past the grave, and there,

on the hazel tree, sat the two pigeons, crying out: Rook di goo, rook di goo! "Why should that stupid

goose sit in the parlor with us?"

Eisenhower - 10 sentences

To all the peoples of the world, I once more give expression to America's prayerful and continuing

aspiration: We pray that peoples of all faiths, all races, all nations, may have their great human needs

satisfied; that those now denied opportunity shall come to enjoy it to the full; that all who yearn for

freedom may experience its spiritual blessings; that those who have freedom will understand, also, its

heavy responsibilities; that all who are insensitive to the needs of others will learn charity; that the

scourges of poverty, disease and ignorance will be made to disappear from the earth, and that, in the

goodness of time, all peoples will come to live together in a peace guaranteed by the binding force of

mutual respect and love. But each proposal must be weighed in light of a broader consideration; the

need to maintain balance in and among national programs – balance between the private and the

public economy, balance between the cost and hoped for advantages – balance between the clearly

necessary and the comfortably desirable; balance between our essential requirements as a nation and

the duties imposed by the nation upon the individual; balance between the actions of the moment and

the national welfare of the future. As one who has witnessed the horror and the lingering sadness of

war – as one who knows that another war could utterly destroy this civilization which has been so

slowly and painfully built over thousands of years – I wish I could say tonight that a lasting peace is in

sight. This evening I come to you with a message of leave-taking and farewell, and to share a few final

thoughts with you, my countrymen. Understandably proud of this pre-eminence, we yet realize that

America's leadership and prestige depend, not merely upon our unmatched material progress, riches

and military strength, but on how we use our power in the interests of world peace and human

betterment. It is the task of statesmanship to mold, to balance, and to integrate these and other

forces, new and old, within the principles of our democratic system – ever aiming toward the supreme

goals of our free society. In meeting them, whether foreign or domestic, great or small, there is a

recurring temptation to feel that some spectacular and costly action could become the miraculous

solution to all current difficulties. The total influence – economic, political, even spiritual – is felt in

every city, every Statehouse, every office of the Federal government. In this final relationship, the

17

Page 18: Auto mat i c Su mmari zat i onpeople.uncw.edu/tagliarinig/Courses/380/F2016 papers and...TextRank 8 The Original Idea 8 Formal Statement of the Si mil arit y Eq uat i on 8 Implementation

Congress and the Administration have, on most vital issues, cooperated well, to serve the nation well

rather than mere partisanship, and so have assured that the business of the nation should go forward.

A huge increase in the newer elements of our defenses; development of unrealistic programs to cure

every ill in agriculture; a dramatic expansion in basic and applied research – these and many other

possibilities, each possibly promising in itself, may be suggested as the only way to the road we wish to

travel.

Eisenhower - 25 sentences

To all the peoples of the world, I once more give expression to America's prayerful and continuing

aspiration: We pray that peoples of all faiths, all races, all nations, may have their great human needs

satisfied; that those now denied opportunity shall come to enjoy it to the full; that all who yearn for

freedom may experience its spiritual blessings; that those who have freedom will understand, also, its

heavy responsibilities; that all who are insensitive to the needs of others will learn charity; that the

scourges of poverty, disease and ignorance will be made to disappear from the earth, and that, in the

goodness of time, all peoples will come to live together in a peace guaranteed by the binding force of

mutual respect and love. But each proposal must be weighed in light of a broader consideration; the

need to maintain balance in and among national programs – balance between the private and the

public economy, balance between the cost and hoped for advantages – balance between the clearly

necessary and the comfortably desirable; balance between our essential requirements as a nation and

the duties imposed by the nation upon the individual; balance between the actions of the moment and

the national welfare of the future. As one who has witnessed the horror and the lingering sadness of

war – as one who knows that another war could utterly destroy this civilization which has been so

slowly and painfully built over thousands of years – I wish I could say tonight that a lasting peace is in

sight. This evening I come to you with a message of leave-taking and farewell, and to share a few final

thoughts with you, my countrymen. Understandably proud of this pre-eminence, we yet realize that

America's leadership and prestige depend, not merely upon our unmatched material progress, riches

and military strength, but on how we use our power in the interests of world peace and human

betterment. It is the task of statesmanship to mold, to balance, and to integrate these and other forces,

new and old, within the principles of our democratic system – ever aiming toward the supreme goals of

our free society. In meeting them, whether foreign or domestic, great or small, there is a recurring

temptation to feel that some spectacular and costly action could become the miraculous solution to all

current difficulties. The total influence – economic, political, even spiritual – is felt in every city, every

Statehouse, every office of the Federal government. In this final relationship, the Congress and the

Administration have, on most vital issues, cooperated well, to serve the nation well rather than mere

partisanship, and so have assured that the business of the nation should go forward. A huge increase in

the newer elements of our defenses; development of unrealistic programs to cure every ill in

agriculture; a dramatic expansion in basic and applied research – these and many other possibilities,

each possibly promising in itself, may be suggested as the only way to the road we wish to travel. My

own relations with Congress, which began on a remote and tenuous basis when, long ago, a member of

the Senate appointed me to West Point, have since ranged to the intimate during the war and

immediate post-war period, and finally to the mutually interdependent during these past eight years.

But now we can no longer risk emergency improvisation of national defense; we have been compelled

to create a permanent armaments industry of vast proportions. So – in this my last good night to you as

your President – I thank you for the many opportunities you have given me for public service in war and

peace. To meet it successfully, there is called for, not so much the emotional and transitory sacrifices of

18

Page 19: Auto mat i c Su mmari zat i onpeople.uncw.edu/tagliarinig/Courses/380/F2016 papers and...TextRank 8 The Original Idea 8 Formal Statement of the Si mil arit y Eq uat i on 8 Implementation

crisis, but rather those which enable us to carry forward steadily, surely, and without complaint the

burdens of a prolonged and complex struggle – with liberty the stake.

Three days from now, after a half century of service of our country, I shall lay down the responsibilities

of office as, in traditional and solemn ceremony, the authority of the Presidency is vested in my

successor. As a private citizen, I shall never cease to do what little I can to help the world advance along

that road. As we peer into society's future, we – you and I, and our government – must avoid the

impulse to live only for today, plundering for, for our own ease and convenience, the precious

resources of tomorrow. This conjunction of an immense military establishment and a large arms

industry is new in the American experience. In the same fashion, the free university, historically the

fountainhead of free ideas and scientific discovery, has experienced a revolution in the conduct of

research. I trust that in that service you find some things worthy; as for the rest of it, I know you will

find ways to improve performance in the future. The record of many decades stands as proof that our

people and their Government have, in the main, understood these truths and have responded to them

well in the face of threat and stress. Partly because of the huge costs involved, a government contract

becomes virtually a substitute for intellectual curiosity. Any failure traceable to arrogance or our lack of

comprehension or readiness to sacrifice would inflict upon us a grievous hurt, both at home and

abroad. Good evening, my fellow Americans: First, I should like to express my gratitude to the radio and

television networks for the opportunity they have given me over the years to bring reports and

messages to our nation. We annually spend on military security more than the net income of all United

States corporations.

Gettysburg - 2 sentences

It is rather for us to be here dedicated to the great task remaining before us -- that from these honored

dead we take increased devotion to that cause for which they gave the last full measure of devotion --

that we here highly resolve that these dead shall not have died in vain -- that this nation, under God,

shall have a new birth of freedom -- and that government of the people, by the people, for the people,

shall not perish from the earth. Now we are engaged in a great civil war, testing whether that nation, or

any nation so conceived and so dedicated, can long endure.

Gettysburg - 5 sentences

It is rather for us to be here dedicated to the great task remaining before us -- that from these honored

dead we take increased devotion to that cause for which they gave the last full measure of devotion --

that we here highly resolve that these dead shall not have died in vain -- that this nation, under God,

shall have a new birth of freedom -- and that government of the people, by the people, for the people,

shall not perish from the earth. Now we are engaged in a great civil war, testing whether that nation, or

any nation so conceived and so dedicated, can long endure. The brave men, living and dead, who

struggled here, have consecrated it, far above our poor power to add or detract. The world will little

note, nor long remember what we say here, but it can never forget what they did here. Four score and

seven years ago our fathers brought forth on this continent, a new nation, conceived in Liberty, and

dedicated to the proposition that all men are created equal.

MacArthur - 10 sentences

19

Page 20: Auto mat i c Su mmari zat i onpeople.uncw.edu/tagliarinig/Courses/380/F2016 papers and...TextRank 8 The Original Idea 8 Formal Statement of the Si mil arit y Eq uat i on 8 Implementation

We speak in strange terms: of harnessing the cosmic energy; of making winds and tides work for us; of

creating unheard synthetic materials to supplement or even replace our old standard basics; to purify

sea water for our drink; of mining ocean floors for new fields of wealth and food; of disease

preventatives to expand life into the hundreds of years; of controlling the weather for a more equitable

distribution of heat and cold, of rain and shine; of space ships to the moon; of the primary target in

war, no longer limited to the armed forces of an enemy, but instead to include his civil populations; of

ultimate conflict between a united human race and the sinister forces of some other planetary galaxy;

of such dreams and fantasies as to make life the most exciting of all time. They teach you to be proud

and unbending in honest failure, but humble and gentle in success; not to substitute words for actions,

not to seek the path of comfort, but to face the stress and spur of difficulty and challenge; to learn to

stand up in the storm but to have compassion on those who fall; to master yourself before you seek to

master others; to have a heart that is clean, a goal that is high; to learn to laugh, yet never forget how

to weep; to reach into the future yet never neglect the past; to be serious yet never to take yourself too

seriously; to be modest so that you will remember the simplicity of true greatness, the open mind of

true wisdom, the meekness of true strength. Let civilian voices argue the merits or demerits of our

processes of government; whether our strength is being sapped by deficit financing, indulged in too

long, by federal paternalism grown too mighty, by power groups grown too arrogant, by politics grown

too corrupt, by crime grown too rampant, by morals grown too low, by taxes grown too high, by

extremists grown too violent; whether our personal liberties are as thorough and complete as they

should be. But when I think of his patience under adversity, of his courage under fire, and of his

modesty in victory, I am filled with an emotion of admiration I cannot put into words. And 20 years

after, on the other side of the globe, again the filth of murky foxholes, the stench of ghostly trenches,

the slime of dripping dugouts; those boiling suns of relentless heat, those torrential rains of devastating

storms; the loneliness and utter desolation of jungle trails; the bitterness of long separation from those

they loved and cherished; the deadly pestilence of tropical disease; the horror of stricken areas of war;

their resolute and determined defense, their swift and sure attack, their indomitable purpose, their

complete and decisive victory -- always victory. That I should be integrated in this way with so noble an

ideal arouses a sense of pride and yet of humility which will be with me always Duty, Honor, Country:

Those three hallowed words reverently dictate what you ought to be, what you can be, what you will

be. They are your rallying points: to build courage when courage seems to fail; to regain faith when

there seems to be little cause for faith; to create hope when hope becomes forlorn. Every pedant, every

demagogue, every cynic, every hypocrite, every troublemaker, and I am sorry to say, some others of an

entirely different character, will try to downgrade them even to the extent of mockery and ridicule.

From one end of the world to the other he has drained deep the chalice of courage.

Today marks my final roll call with you, but I want you to know that when I cross the river my last

conscious thoughts will be of The Corps, and The Corps, and The Corps.

MacArthur - 25 Sentences

We speak in strange terms: of harnessing the cosmic energy; of making winds and tides work for us; of

creating unheard synthetic materials to supplement or even replace our old standard basics; to purify

sea water for our drink; of mining ocean floors for new fields of wealth and food; of disease

preventatives to expand life into the hundreds of years; of controlling the weather for a more equitable

distribution of heat and cold, of rain and shine; of space ships to the moon; of the primary target in

war, no longer limited to the armed forces of an enemy, but instead to include his civil populations; of

ultimate conflict between a united human race and the sinister forces of some other planetary galaxy;

20

Page 21: Auto mat i c Su mmari zat i onpeople.uncw.edu/tagliarinig/Courses/380/F2016 papers and...TextRank 8 The Original Idea 8 Formal Statement of the Si mil arit y Eq uat i on 8 Implementation

of such dreams and fantasies as to make life the most exciting of all time. They teach you to be proud

and unbending in honest failure, but humble and gentle in success; not to substitute words for actions,

not to seek the path of comfort, but to face the stress and spur of difficulty and challenge; to learn to

stand up in the storm but to have compassion on those who fall; to master yourself before you seek to

master others; to have a heart that is clean, a goal that is high; to learn to laugh, yet never forget how

to weep; to reach into the future yet never neglect the past; to be serious yet never to take yourself too

seriously; to be modest so that you will remember the simplicity of true greatness, the open mind of

true wisdom, the meekness of true strength. Let civilian voices argue the merits or demerits of our

processes of government; whether our strength is being sapped by deficit financing, indulged in too

long, by federal paternalism grown too mighty, by power groups grown too arrogant, by politics grown

too corrupt, by crime grown too rampant, by morals grown too low, by taxes grown too high, by

extremists grown too violent; whether our personal liberties are as thorough and complete as they

should be. But when I think of his patience under adversity, of his courage under fire, and of his

modesty in victory, I am filled with an emotion of admiration I cannot put into words. And 20 years

after, on the other side of the globe, again the filth of murky foxholes, the stench of ghostly trenches,

the slime of dripping dugouts; those boiling suns of relentless heat, those torrential rains of devastating

storms; the loneliness and utter desolation of jungle trails; the bitterness of long separation from those

they loved and cherished; the deadly pestilence of tropical disease; the horror of stricken areas of war;

their resolute and determined defense, their swift and sure attack, their indomitable purpose, their

complete and decisive victory -- always victory. That I should be integrated in this way with so noble an

ideal arouses a sense of pride and yet of humility which will be with me always Duty, Honor, Country:

Those three hallowed words reverently dictate what you ought to be, what you can be, what you will

be. They are your rallying points: to build courage when courage seems to fail; to regain faith when

there seems to be little cause for faith; to create hope when hope becomes forlorn. Every pedant, every

demagogue, every cynic, every hypocrite, every troublemaker, and I am sorry to say, some others of an

entirely different character, will try to downgrade them even to the extent of mockery and ridicule.

From one end of the world to the other he has drained deep the chalice of courage. Today marks my

final roll call with you, but I want you to know that when I cross the river my last conscious thoughts

will be of The Corps, and The Corps, and The Corps. Its requirements are for the things that are right,

and its restraints are from the things that are wrong. All other public purposes, all other public projects,

all other public needs, great or small, will find others for their accomplishment. And through all this

welter of change and development, your mission remains fixed, determined, inviolable: it is to win our

wars. I regarded him then as I regard him now -- as one of the world's noblest figures, not only as one

of the finest military characters, but also as one of the most stainless. As I listened to those songs [of

the glee club], in memory's eye I could see those staggering columns of the First World War, bending

under soggy packs, on many a weary march from dripping dusk to drizzling dawn, slogging ankle-deep

through the mire of shell-shocked roads, to form grimly for the attack, blue-lipped, covered with sludge

and mud, chilled by the wind and rain, driving home to their objective, and for many, to the judgment

seat of God. The code which those words perpetuate embraces the highest moral laws and will stand

the test of any ethics or philosophies ever promulgated for the uplift of mankind. On the contrary, the

soldier, above all other people, prays for peace, for he must suffer and bear the deepest wounds and

scars of war. I do not know the dignity of their birth, but I do know the glory of their death. Others will

debate the controversial issues, national and international, which divide men's minds; but serene, calm,

aloof, you stand as the Nation's war-guardian, as its lifeguard from the raging tides of international

conflict, as its gladiator in the arena of battle. They give you a temper of the will, a quality of the

imagination, a vigor of the emotions, a freshness of the deep springs of life, a temperamental

21

Page 22: Auto mat i c Su mmari zat i onpeople.uncw.edu/tagliarinig/Courses/380/F2016 papers and...TextRank 8 The Original Idea 8 Formal Statement of the Si mil arit y Eq uat i on 8 Implementation

predominance of courage over timidity, of an appetite for adventure over love of ease. He has written

his own history and written it in red on his enemy's breast. He belongs to posterity as the instructor of

future generations in the principles of liberty and freedom. But in the evening of my memory, always I

come back to West Point. It is the story of the American man-at-arms.

Were you to do so, a million ghosts in olive drab, in brown khaki, in blue and gray, would rise from their

white crosses thundering those magic words: Duty, Honor, Country.

Yellow Submarine - 6 sentences

In our yellow (In our yellow) submarine (Submarine, ha, ha). Everyone of us (Everyone of us) has all we

need (Has all we need). As we live a life of ease (A life of ease). Sky of blue (Sky of blue) and sea of

green (Sea of green). Cut the cable, drop the cable! Full speed ahead, Mr.Boatswain, full speed ahead!

Yellow Submarine - 12 sentences

In our yellow (In our yellow) submarine (Submarine, ha, ha). Everyone of us (Everyone of us) has all we

need (Has all we need). As we live a life of ease (A life of ease). Sky of blue (Sky of blue) and sea of

green (Sea of green). Cut the cable, drop the cable! Full speed ahead, Mr.Boatswain, full speed ahead!

Lived a man who sailed to sea. Aye, sir, aye! Captain, captain! We all live in a yellow submarine. And the

band begins to play. And we lived beneath the waves.

22

Page 23: Auto mat i c Su mmari zat i onpeople.uncw.edu/tagliarinig/Courses/380/F2016 papers and...TextRank 8 The Original Idea 8 Formal Statement of the Si mil arit y Eq uat i on 8 Implementation

TextRank

Cinderella - 25 sentences

With this she closed her eyes and died. Then he broke off the twig and took it with him. Cinderella

went to this tree three times every day, and beneath it she wept and prayed. The girl went through the

back door into the garden, and called out, "You tame pigeons, you turtledoves, and all you birds

beneath the sky, come and help me to gather: The good ones go into the pot, The bad ones go into

your crop." The pigeons nodded their heads and began to pick, pick, pick, pick. Cinderella began to cry,

and then the stepmother said, "You may go if you are able to pick two bowls of lentils out of the ashes

for me in one hour," thinking to herself, "She will never be able to do that." The girl went through the

back door into the garden, and called out, "You tame pigeons, you turtledoves, and all you birds

beneath the sky, come and help me to gather: The good ones go into the pot, The bad ones go into

your crop." The pigeons nodded their heads and began to pick, pick, pick, pick. Now that no one else

was at home, Cinderella went to her mother's grave beneath the hazel tree, and cried out: Shake and

quiver, little tree, Throw gold and silver down to me. They thought she must be a foreign princess, for

she looked so beautiful in the golden dress. However, she eluded him and jumped into the pigeon

coop. Cinderella had quickly jumped down from the back of the pigeon coop and had run to the hazel

tree. Then, dressed in her gray smock, she had returned to the ashes in the kitchen. When others

came and asked her to dance with them, he said, "She is my dance partner." When evening came she

wanted to leave, and the prince followed her, wanting to see into which house she went. He had an ax

brought to him and cut down the tree, but no one was in it. When they came to the kitchen, Cinderella

was lying there in the ashes as usual, for she had jumped down from the other side of the tree, had

taken the beautiful dress back to the bird in the hazel tree, and had put on her gray smock. On the

third day, when her parents and sisters had gone away, Cinderella went again to her mother's grave

and said to the tree: Shake and quiver, little tree, Throw gold and silver down to me. The prince

danced only with her, and whenever anyone else asked her to dance, he would say, "She is my dance

partner." With her mother standing by, the older one took the shoe into her bedroom to try it on.

Then he looked at her foot and saw how the blood was running from it. But the prince insisted on it,

and they had to call Cinderella. She first washed her hands and face clean, and then went and bowed

down before the prince, who gave her the golden shoe. When the wedding with the prince was to be

held, the two false sisters came, wanting to gain favor with Cinderella and to share her good fortune.

When the bridal couple walked into the church, the older sister walked on their right side and the

younger on their left side, and the pigeons pecked out one eye from each of them.

Cinderella - 50 sentences

With this she closed her eyes and died. Besides this, the sisters did everything imaginable to hurt her.

They made fun of her, scattered peas and lentils into the ashes for her, so that she had to sit and pick

them out again. In the evening when she had worked herself weary, there was no bed for her. So he

bought beautiful dresses, pearls, and jewels for his two stepdaughters. On his way home, as he was

riding through a green thicket, a hazel twig brushed against him and knocked off his hat. Then he broke

off the twig and took it with him. Arriving home, he gave his stepdaughters the things that they had

asked for, and he gave Cinderella the twig from the hazel bush. Cinderella went to this tree three times

every day, and beneath it she wept and prayed. Now it happened that the king proclaimed a festival

23

Page 24: Auto mat i c Su mmari zat i onpeople.uncw.edu/tagliarinig/Courses/380/F2016 papers and...TextRank 8 The Original Idea 8 Formal Statement of the Si mil arit y Eq uat i on 8 Implementation

that was to last three days. All the beautiful young girls in the land were invited, so that his son could

select a bride for himself. "You, all covered with dust and dirt, and you want to go to the festival?. If

you can pick them out again in two hours, then you may go with us." The girl went through the back

door into the garden, and called out, "You tame pigeons, you turtledoves, and all you birds beneath the

sky, come and help me to gather: The good ones go into the pot, The bad ones go into your crop." The

pigeons nodded their heads and began to pick, pick, pick, pick. The girl took the bowl to her

stepmother, and was happy, thinking that now she would be allowed to go to the festival with them.

Cinderella began to cry, and then the stepmother said, "You may go if you are able to pick two bowls of

lentils out of the ashes for me in one hour," thinking to herself, "She will never be able to do that." The

girl went through the back door into the garden, and called out, "You tame pigeons, you turtledoves,

and all you birds beneath the sky, come and help me to gather: The good ones go into the pot, The

bad ones go into your crop." The pigeons nodded their heads and began to pick, pick, pick, pick. With

this she turned her back on Cinderella, and hurried away with her two proud daughters. Now that no

one else was at home, Cinderella went to her mother's grave beneath the hazel tree, and cried out:

Shake and quiver, little tree, Throw gold and silver down to me. Then the bird threw a gold and silver

dress down to her, and slippers embroidered with silk and silver. They thought she must be a foreign

princess, for she looked so beautiful in the golden dress. Furthermore, he would dance with no one

else. He never let go of her hand, and whenever anyone else came and asked her to dance, he would

say, "She is my dance partner." She danced until evening, and then she wanted to go home. However,

she eluded him and jumped into the pigeon coop. Cinderella had quickly jumped down from the back

of the pigeon coop and had run to the hazel tree. There she had taken off her beautiful clothes and laid

them on the grave, and the bird had taken them away again. Then, dressed in her gray smock, she had

returned to the ashes in the kitchen. The prince had waited until she came, then immediately took her

by the hand, and danced only with her. When others came and asked her to dance with them, he said,

"She is my dance partner." When evening came she wanted to leave, and the prince followed her,

wanting to see into which house she went. He had an ax brought to him and cut down the tree, but no

one was in it. When they came to the kitchen, Cinderella was lying there in the ashes as usual, for she

had jumped down from the other side of the tree, had taken the beautiful dress back to the bird in the

hazel tree, and had put on her gray smock. On the third day, when her parents and sisters had gone

away, Cinderella went again to her mother's grave and said to the tree: Shake and quiver, little tree,

Throw gold and silver down to me. This time the bird threw down to her a dress that was more

splendid and magnificent than any she had yet had, and the slippers were of pure gold. The prince

danced only with her, and whenever anyone else asked her to dance, he would say, "She is my dance

partner." The next morning, he went with it to the man, and said to him, "No one shall be my wife

except for the one whose foot fits this golden shoe." With her mother standing by, the older one took

the shoe into her bedroom to try it on. Then he looked at her foot and saw how the blood was running

from it. He turned his horse around and took the false bride home again, saying that she was not the

right one, and that the other sister should try on the shoe. She went into her bedroom, and got her

toes into the shoe all right, but her heel was too large. "There is only a deformed little Cinderella from

my first wife, but she cannot possibly be the bride." But the prince insisted on it, and they had to call

Cinderella. She first washed her hands and face clean, and then went and bowed down before the

prince, who gave her the golden shoe. She sat down on a stool, pulled her foot out of the heavy

wooden shoe, and put it into the slipper, and it fitted her perfectly. When the wedding with the prince

was to be held, the two false sisters came, wanting to gain favor with Cinderella and to share her good

fortune. When the bridal couple walked into the church, the older sister walked on their right side and

the younger on their left side, and the pigeons pecked out one eye from each of them. Afterwards, as

24

Page 25: Auto mat i c Su mmari zat i onpeople.uncw.edu/tagliarinig/Courses/380/F2016 papers and...TextRank 8 The Original Idea 8 Formal Statement of the Si mil arit y Eq uat i on 8 Implementation

they came out of the church, the older one was on the left side, and the younger one on the right side,

and then the pigeons pecked out the other eye from each of them.

Eisenhower - 10 sentences

Our people expect their President and the Congress to find essential agreement on questions of great

moment, the wise resolution of which will better shape the future of the nation. My own relations with

Congress, which began on a remote and tenuous basis when, long ago, a member of the Senate

appointed me to West Point, have since ranged to the intimate during the war and immediate post-war

period, and finally to the mutually interdependent during these past eight years. Understandably

proud of this pre-eminence, we yet realize that America's leadership and prestige depend, not merely

upon our unmatched material progress, riches and military strength, but on how we use our power in

the interests of world peace and human betterment. In meeting them, whether foreign or domestic,

great or small, there is a recurring temptation to feel that some spectacular and costly action could

become the miraculous solution to all current difficulties. A huge increase in the newer elements of our

defenses; development of unrealistic programs to cure every ill in agriculture; a dramatic expansion in

basic and applied research – these and many other possibilities, each possibly promising in itself, may

be suggested as the only way to the road we wish to travel. Today, the solitary inventor, tinkering in his

shop, has been overshadowed by task forces of scientists in laboratories and testing fields. Yet, in

holding scientific research and discovery in respect, as we should, we must also be alert to the equal

and opposite danger that public policy could itself become the captive of a scientific-technological elite.

Because this need is so sharp and apparent I confess that I lay down my official responsibilities in this

field with a definite sense of disappointment. So – in this my last good night to you as your President –

I thank you for the many opportunities you have given me for public service in war and peace. May we

be ever unswerving in devotion to principle, confident but humble with power, diligent in pursuit of the

Nations' great goals.

Eisenhower - 25 sentences

My special thanks go to them for the opportunity of addressing you this evening. Three days from now,

after a half century of service of our country, I shall lay down the responsibilities of office as, in

traditional and solemn ceremony, the authority of the Presidency is vested in my successor. Like every

other citizen, I wish the new President, and all who will labor with him, Godspeed. I pray that the

coming years will be blessed with peace and prosperity for all. Our people expect their President and

the Congress to find essential agreement on questions of great moment, the wise resolution of which

will better shape the future of the nation. My own relations with Congress, which began on a remote

and tenuous basis when, long ago, a member of the Senate appointed me to West Point, have since

ranged to the intimate during the war and immediate post-war period, and finally to the mutually

interdependent during these past eight years. In this final relationship, the Congress and the

Administration have, on most vital issues, cooperated well, to serve the nation well rather than mere

partisanship, and so have assured that the business of the nation should go forward. Despite these

holocausts America is today the strongest, the most influential and most productive nation in the

world. Understandably proud of this pre-eminence, we yet realize that America's leadership and

prestige depend, not merely upon our unmatched material progress, riches and military strength, but

on how we use our power in the interests of world peace and human betterment. Unhappily the

danger it poses promises to be of indefinite duration. In meeting them, whether foreign or domestic,

25

Page 26: Auto mat i c Su mmari zat i onpeople.uncw.edu/tagliarinig/Courses/380/F2016 papers and...TextRank 8 The Original Idea 8 Formal Statement of the Si mil arit y Eq uat i on 8 Implementation

great or small, there is a recurring temptation to feel that some spectacular and costly action could

become the miraculous solution to all current difficulties. A huge increase in the newer elements of our

defenses; development of unrealistic programs to cure every ill in agriculture; a dramatic expansion in

basic and applied research – these and many other possibilities, each possibly promising in itself, may

be suggested as the only way to the road we wish to travel. Our toil, resources and livelihood are all

involved; so is the very structure of our society. Today, the solitary inventor, tinkering in his shop, has

been overshadowed by task forces of scientists in laboratories and testing fields. The prospect of

domination of the nation's scholars by Federal employment, project allocations, and the power of

money is ever present – and is gravely to be regarded. Yet, in holding scientific research and discovery

in respect, as we should, we must also be alert to the equal and opposite danger that public policy

could itself become the captive of a scientific-technological elite. As we peer into society's future, we –

you and I, and our government – must avoid the impulse to live only for today, plundering for, for our

own ease and convenience, the precious resources of tomorrow. We want democracy to survive for all

generations to come, not to become the insolvent phantom of tomorrow. Down the long lane of the

history yet to be written America knows that this world of ours, ever growing smaller, must avoid

becoming a community of dreadful fear and hate, and be, instead, a proud confederation of mutual

trust and respect. Because this need is so sharp and apparent I confess that I lay down my official

responsibilities in this field with a definite sense of disappointment. As one who has witnessed the

horror and the lingering sadness of war – as one who knows that another war could utterly destroy this

civilization which has been so slowly and painfully built over thousands of years – I wish I could say

tonight that a lasting peace is in sight. So – in this my last good night to you as your President – I thank

you for the many opportunities you have given me for public service in war and peace. I trust that in

that service you find some things worthy; as for the rest of it, I know you will find ways to improve

performance in the future. You and I – my fellow citizens – need to be strong in our faith that all

nations, under God, will reach the goal of peace with justice. May we be ever unswerving in devotion

to principle, confident but humble with power, diligent in pursuit of the Nations' great goals.

Gettysburg - 2 sentences

It is for us the living, rather, to be dedicated here to the unfinished work which they who fought here

have thus far so nobly advanced. It is rather for us to be here dedicated to the great task remaining

before us -- that from these honored dead we take increased devotion to that cause for which they

gave the last full measure of devotion -- that we here highly resolve that these dead shall not have died

in vain -- that this nation, under God, shall have a new birth of freedom -- and that government of the

people, by the people, for the people, shall not perish from the earth.

Gettysburg - 5 sentences

Four score and seven years ago our fathers brought forth on this continent, a new nation, conceived in

Liberty, and dedicated to the proposition that all men are created equal. Now we are engaged in a

great civil war, testing whether that nation, or any nation so conceived and so dedicated, can long

endure. We are met on a great battle-field of that war. It is for us the living, rather, to be dedicated

here to the unfinished work which they who fought here have thus far so nobly advanced. It is rather

for us to be here dedicated to the great task remaining before us -- that from these honored dead we

take increased devotion to that cause for which they gave the last full measure of devotion -- that we

here highly resolve that these dead shall not have died in vain -- that this nation, under God, shall have

26

Page 27: Auto mat i c Su mmari zat i onpeople.uncw.edu/tagliarinig/Courses/380/F2016 papers and...TextRank 8 The Original Idea 8 Formal Statement of the Si mil arit y Eq uat i on 8 Implementation

a new birth of freedom -- and that government of the people, by the people, for the people, shall not

perish from the earth.

MacArthur - 10 sentences

They make you strong enough to know when you are weak, and brave enough to face yourself when

you are afraid. They teach you to be proud and unbending in honest failure, but humble and gentle in

success; not to substitute words for actions, not to seek the path of comfort, but to face the stress and

spur of difficulty and challenge; to learn to stand up in the storm but to have compassion on those who

fall; to master yourself before you seek to master others; to have a heart that is clean, a goal that is

high; to learn to laugh, yet never forget how to weep; to reach into the future yet never neglect the

past; to be serious yet never to take yourself too seriously; to be modest so that you will remember the

simplicity of true greatness, the open mind of true wisdom, the meekness of true strength. My

estimate of him was formed on the battlefield many, many years ago, and has never changed. He

belongs to history as furnishing one of the greatest examples of successful patriotism. From one end of

the world to the other he has drained deep the chalice of courage. They died unquestioning,

uncomplaining, with faith in their hearts, and on their lips the hope that we would go on to victory.

Always, for them: Duty, Honor, Country; always their blood and sweat and tears, as we sought the way

and the light and the truth. The thrust into outer space of the satellite, spheres, and missiles mark the

beginning of another epoch in the long story of mankind. We are reaching out for a new and boundless

frontier. I listen vainly, but with thirsty ears, for the witching melody of faint bugles blowing reveille, of

far drums beating the long roll.

MacArthur - 25 sentences

That is the animation of this medallion. That I should be integrated in this way with so noble an ideal

arouses a sense of pride and yet of humility which will be with me always Duty, Honor, Country: Those

three hallowed words reverently dictate what you ought to be, what you can be, what you will be. But

these are some of the things they do: They build your basic character. They make you strong enough to

know when you are weak, and brave enough to face yourself when you are afraid. They teach you to

be proud and unbending in honest failure, but humble and gentle in success; not to substitute words

for actions, not to seek the path of comfort, but to face the stress and spur of difficulty and challenge;

to learn to stand up in the storm but to have compassion on those who fall; to master yourself before

you seek to master others; to have a heart that is clean, a goal that is high; to learn to laugh, yet never

forget how to weep; to reach into the future yet never neglect the past; to be serious yet never to take

yourself too seriously; to be modest so that you will remember the simplicity of true greatness, the

open mind of true wisdom, the meekness of true strength. They give you a temper of the will, a quality

of the imagination, a vigor of the emotions, a freshness of the deep springs of life, a temperamental

predominance of courage over timidity, of an appetite for adventure over love of ease. Are they

reliable? My estimate of him was formed on the battlefield many, many years ago, and has never

changed. He has written his own history and written it in red on his enemy's breast. He belongs to

history as furnishing one of the greatest examples of successful patriotism. He belongs to posterity as

the instructor of future generations in the principles of liberty and freedom. From one end of the world

to the other he has drained deep the chalice of courage. As I listened to those songs [of the glee club],

in memory's eye I could see those staggering columns of the First World War, bending under soggy

packs, on many a weary march from dripping dusk to drizzling dawn, slogging ankle-deep through the

27

Page 28: Auto mat i c Su mmari zat i onpeople.uncw.edu/tagliarinig/Courses/380/F2016 papers and...TextRank 8 The Original Idea 8 Formal Statement of the Si mil arit y Eq uat i on 8 Implementation

mire of shell-shocked roads, to form grimly for the attack, blue-lipped, covered with sludge and mud,

chilled by the wind and rain, driving home to their objective, and for many, to the judgment seat of

God. They died unquestioning, uncomplaining, with faith in their hearts, and on their lips the hope that

we would go on to victory. Always, for them: Duty, Honor, Country; always their blood and sweat and

tears, as we sought the way and the light and the truth. In battle and in the face of danger and death,

he discloses those divine attributes which his Maker gave when he created man in his own image. No

physical courage and no brute instinct can take the place of the Divine help which alone can sustain

him. The thrust into outer space of the satellite, spheres, and missiles mark the beginning of another

epoch in the long story of mankind. We are reaching out for a new and boundless frontier. But you are

the ones who are trained to fight. Yours is the profession of arms, the will to win, the sure knowledge

that in war there is no substitute for victory; that if you lose, the nation will be destroyed; that the very

obsession of your public service must be: Duty, Honor, Country. Others will debate the controversial

issues, national and international, which divide men's minds; but serene, calm, aloof, you stand as the

Nation's war-guardian, as its lifeguard from the raging tides of international conflict, as its gladiator in

the arena of battle. On the contrary, the soldier, above all other people, prays for peace, for he must

suffer and bear the deepest wounds and scars of war. I listen vainly, but with thirsty ears, for the

witching melody of faint bugles blowing reveille, of far drums beating the long roll. I bid you farewell.

Yellow Submarine - 6 sentences

We all live in a yellow submarine. We all live in a yellow submarine. We all live in a yellow submarine.

We all live in a yellow submarine. We all live in a yellow submarine. We all live in a yellow submarine.

We all live in a yellow submarine. We all live in a yellow submarine.

Yellow Submarine - 12 sentences

In our yellow submarine. We all live in a yellow submarine. Yellow submarine, yellow submarine. We

all live in a yellow submarine. Yellow submarine, yellow submarine. We all live in a yellow submarine.

Yellow submarine, yellow submarine. We all live in a yellow submarine. Yellow submarine, yellow

submarine. As we live a life of ease (A life of ease). Everyone of us (Everyone of us) has all we need

(Has all we need). We all live in a yellow submarine. Yellow submarine, yellow submarine. We all live

in a yellow submarine. Yellow submarine, yellow submarine. We all live in a yellow submarine. Yellow

submarine, yellow submarine. We all live in a yellow submarine. Yellow submarine, yellow submarine.

28

Page 29: Auto mat i c Su mmari zat i onpeople.uncw.edu/tagliarinig/Courses/380/F2016 papers and...TextRank 8 The Original Idea 8 Formal Statement of the Si mil arit y Eq uat i on 8 Implementation

SMMRY Cinderella - 50 Sentences

A rich man's wife became sick, and when she felt that her end was drawing near, she called her only

daughter to her bedside and said, "Dear child, remain pious and good, and then our dear God will

always protect you, and I will look down on you from heaven and be near you." A rich man's wife

became sick, and when she felt that her end was drawing near, she called her only daughter to her

bedside and said, "Dear child, remain pious and good, and then our dear God will always protect you,

and I will look down on you from heaven and be near you." A rich man's wife became sick, and when

she felt that her end was drawing near, she called her only daughter to her bedside and said, "Dear

child, remain pious and good, and then our dear God will always protect you, and I will look down on

you from heaven and be near you." A rich man's wife became sick, and when she felt that her end was

drawing near, she called her only daughter to her bedside and said, "Dear child, remain pious and good,

and then our dear God will always protect you, and I will look down on you from heaven and be near

you." A rich man's wife became sick, and when she felt that her end was drawing near, she called her

only daughter to her bedside and said, "Dear child, remain pious and good, and then our dear God will

always protect you, and I will look down on you from heaven and be near you." The girl went out to her

mother's grave every day and wept, and she remained pious and good. When winter came the snow

spread a white cloth over the grave, and when the spring sun had removed it again, the man took

himself another wife. They took her beautiful clothes away from her, dressed her in an old gray smock,

and gave her wooden shoes. They took her beautiful clothes away from her, dressed her in an old gray

smock, and gave her wooden shoes. There she had to do hard work from morning until evening, get up

before daybreak, carry water, make the fires, cook, and wash. There she had to do hard work from

morning until evening, get up before daybreak, carry water, make the fires, cook, and wash. Instead she

had to sleep by the hearth in the ashes. And because she always looked dusty and dirty, they called her

Cinderella. One day it happened that the father was going to the fair, and he asked his two

stepdaughters what he should bring back for them. "Pearls and jewels," said the other. Cinderella

thanked him, went to her mother's grave, and planted the branch on it, and she wept so much that her

tears fell upon it and watered it. A white bird came to the tree every time, and whenever she expressed

a wish, the bird would throw down to her what she had wished for. A white bird came to the tree every

time, and whenever she expressed a wish, the bird would throw down to her what she had wished for.

A white bird came to the tree every time, and whenever she expressed a wish, the bird would throw

down to her what she had wished for. All the beautiful young girls in the land were invited, so that his

son could select a bride for himself. Cinderella obeyed, but wept, because she too would have liked to

go to the dance with them. However, because Cinderella kept asking, the stepmother finally said, "I

have scattered a bowl of lentils into the ashes for you. If you can pick them out again in two hours, then

you may go with us." If you can pick them out again in two hours, then you may go with us." And the

others also began to pick, pick, pick, pick. They gathered all the good grains into the bowl. We would be

ashamed of you." They never once thought it was Cinderella, for they thought that she was sitting at

home in the dirt, looking for lentils in the ashes. He never let go of her hand, and whenever anyone else

came and asked her to dance, he would say, "She is my dance partner." However, she eluded him and

jumped into the pigeon coop. The prince waited until her father came, and then he told him that the

unknown girl had jumped into the pigeon coop. When they got home Cinderella was lying in the ashes,

dressed in her dirty clothes. A dim little oil-lamp was burning in the fireplace. A dim little oil-lamp was

29

Page 30: Auto mat i c Su mmari zat i onpeople.uncw.edu/tagliarinig/Courses/380/F2016 papers and...TextRank 8 The Original Idea 8 Formal Statement of the Si mil arit y Eq uat i on 8 Implementation

burning in the fireplace. Then, dressed in her gray smock, she had returned to the ashes in the kitchen.

When evening came she wanted to leave, and the prince followed her, wanting to see into which house

she went. When evening came she wanted to leave, and the prince followed her, wanting to see into

which house she went. A beautiful tall tree stood there, on which hung the most magnificent pears. She

climbed as nimbly as a squirrel into the branches, and the prince did not know where she had gone. The

prince picked it up. It was small and dainty, and of pure gold. It was small and dainty, and of pure gold.

The next morning, he went with it to the man, and said to him, "No one shall be my wife except for the

one whose foot fits this golden shoe." However, they had to ride past the grave, and there, on the hazel

tree, sat the two pigeons, crying out:

Rook di goo, rook di goo! She went into her bedroom, and got her toes into the shoe all right, but her

heel was too large. "Don't you have another daughter?" The prince told him to send her to him, but the

mother answered, "Oh, no, she is much too dirty. The prince told him to send her to him, but the

mother answered, "Oh, no, she is much too dirty. She first washed her hands and face clean, and then

went and bowed down before the prince, who gave her the golden shoe. She sat down on a stool,

pulled her foot out of the heavy wooden shoe, and put it into the slipper, and it fitted her perfectly.

Cinderella - 25 Sentences

A rich man's wife became sick, and when she felt that her end was drawing near, she called her only

daughter to her bedside and said, "Dear child, remain pious and good, and then our dear God will

always protect you, and I will look down on you from heaven and be near you." A rich man's wife

became sick, and when she felt that her end was drawing near, she called her only daughter to her

bedside and said, "Dear child, remain pious and good, and then our dear God will always protect you,

and I will look down on you from heaven and be near you." The girl went out to her mother's grave

every day and wept, and she remained pious and good. There she had to do hard work from morning

until evening, get up before daybreak, carry water, make the fires, cook, and wash. Instead she had to

sleep by the hearth in the ashes. And because she always looked dusty and dirty, they called her

Cinderella. One day it happened that the father was going to the fair, and he asked his two

stepdaughters what he should bring back for them. "Pearls and jewels," said the other. A white bird

came to the tree every time, and whenever she expressed a wish, the bird would throw down to her

what she had wished for. All the beautiful young girls in the land were invited, so that his son could

select a bride for himself. Cinderella obeyed, but wept, because she too would have liked to go to the

dance with them. However, because Cinderella kept asking, the stepmother finally said, "I have

scattered a bowl of lentils into the ashes for you. We would be ashamed of you." They never once

thought it was Cinderella, for they thought that she was sitting at home in the dirt, looking for lentils in

the ashes. However, she eluded him and jumped into the pigeon coop. When they got home Cinderella

was lying in the ashes, dressed in her dirty clothes. A dim little oil-lamp was burning in the fireplace. A

dim little oil-lamp was burning in the fireplace. Then, dressed in her gray smock, she had returned to

the ashes in the kitchen. When evening came she wanted to leave, and the prince followed her,

wanting to see into which house she went. It was small and dainty, and of pure gold. The next morning,

he went with it to the man, and said to him, "No one shall be my wife except for the one whose foot fits

this golden shoe." The prince told him to send her to him, but the mother answered, "Oh, no, she is

much too dirty. The prince told him to send her to him, but the mother answered, "Oh, no, she is much

30

Page 31: Auto mat i c Su mmari zat i onpeople.uncw.edu/tagliarinig/Courses/380/F2016 papers and...TextRank 8 The Original Idea 8 Formal Statement of the Si mil arit y Eq uat i on 8 Implementation

too dirty. She first washed her hands and face clean, and then went and bowed down before the

prince, who gave her the golden shoe.

Eisenhower - 10 sentences

Good evening, my fellow Americans: First, I should like to express my gratitude to the radio and

television networks for the opportunity they have given me over the years to bring reports and

messages to our nation. My own relations with Congress, which began on a remote and tenuous basis

when, long ago, a member of the Senate appointed me to West Point, have since ranged to the

intimate during the war and immediate post-war period, and finally to the mutually interdependent

during these past eight years. In this final relationship, the Congress and the Administration have, on

most vital issues, cooperated well, to serve the nation well rather than mere partisanship, and so have

assured that the business of the nation should go forward. We now stand ten years past the midpoint

of a century that has witnessed four major wars among great nations. Throughout America's adventure

in free government, such basic purposes have been to keep the peace; to foster progress in human

achievement, and to enhance liberty, dignity and integrity among peoples and among nations. Any

failure traceable to arrogance or our lack of comprehension or readiness to sacrifice would inflict upon

us a grievous hurt, both at home and abroad. But each proposal must be weighed in light of a broader

consideration; the need to maintain balance in and among national programs balance between the

private and the public economy, balance between the cost and hoped for advantages balance between

the clearly necessary and the comfortably desirable; balance between our essential requirements as a

nation and the duties imposed by the nation upon the individual; balance between the actions of the

moment and the national welfare of the future. Our toil, resources and livelihood are all involved; so is

the very structure of our society. As we peer into society's future, we you and I, and our government

must avoid the impulse to live only for today, plundering for, for our own ease and convenience, the

precious resources of tomorrow. Down the long lane of the history yet to be written America knows

that this world of ours, ever growing smaller, must avoid becoming a community of dreadful fear and

hate, and be, instead, a proud confederation of mutual trust and respect.

Eisenhower - 25 sentences

Good evening, my fellow Americans: First, I should like to express my gratitude to the radio and

television networks for the opportunity they have given me over the years to bring reports and

messages to our nation. Like every other citizen, I wish the new President, and all who will labor with

him, Godspeed. My own relations with Congress, which began on a remote and tenuous basis when,

long ago, a member of the Senate appointed me to West Point, have since ranged to the intimate

during the war and immediate post-war period, and finally to the mutually interdependent during these

past eight years. My own relations with Congress, which began on a remote and tenuous basis when,

long ago, a member of the Senate appointed me to West Point, have since ranged to the intimate

during the war and immediate post-war period, and finally to the mutually interdependent during these

past eight years. My own relations with Congress, which began on a remote and tenuous basis when,

long ago, a member of the Senate appointed me to West Point, have since ranged to the intimate

during the war and immediate post-war period, and finally to the mutually interdependent during these

past eight years. In this final relationship, the Congress and the Administration have, on most vital

issues, cooperated well, to serve the nation well rather than mere partisanship, and so have assured

that the business of the nation should go forward. We now stand ten years past the midpoint of a

31

Page 32: Auto mat i c Su mmari zat i onpeople.uncw.edu/tagliarinig/Courses/380/F2016 papers and...TextRank 8 The Original Idea 8 Formal Statement of the Si mil arit y Eq uat i on 8 Implementation

century that has witnessed four major wars among great nations. Understandably proud of this

pre-eminence, we yet realize that America's leadership and prestige depend, not merely upon our

unmatched material progress, riches and military strength, but on how we use our power in the

interests of world peace and human betterment. Throughout America's adventure in free government,

such basic purposes have been to keep the peace; to foster progress in human achievement, and to

enhance liberty, dignity and integrity among peoples and among nations. Throughout America's

adventure in free government, such basic purposes have been to keep the peace; to foster progress in

human achievement, and to enhance liberty, dignity and integrity among peoples and among nations.

Any failure traceable to arrogance or our lack of comprehension or readiness to sacrifice would inflict

upon us a grievous hurt, both at home and abroad. Any failure traceable to arrogance or our lack of

comprehension or readiness to sacrifice would inflict upon us a grievous hurt, both at home and

abroad. We face a hostile ideology global in scope, atheistic in character, ruthless in purpose, and

insidious in method. Crises there will continue to be. Crises there will continue to be. But each proposal

must be weighed in light of a broader consideration; the need to maintain balance in and among

national programs balance between the private and the public economy, balance between the cost and

hoped for advantages balance between the clearly necessary and the comfortably desirable; balance

between our essential requirements as a nation and the duties imposed by the nation upon the

individual; balance between the actions of the moment and the national welfare of the future. Our

arms must be mighty, ready for instant action, so that no potential aggressor may be tempted to risk

his own destruction. Added to this, three and a half million men and women are directly engaged in the

defense establishment. Our toil, resources and livelihood are all involved; so is the very structure of our

society. Our toil, resources and livelihood are all involved; so is the very structure of our society. As we

peer into society's future, we you and I, and our government must avoid the impulse to live only for

today, plundering for, for our own ease and convenience, the precious resources of tomorrow. Down

the long lane of the history yet to be written America knows that this world of ours, ever growing

smaller, must avoid becoming a community of dreadful fear and hate, and be, instead, a proud

confederation of mutual trust and respect. Together we must learn how to compose differences, not

with arms, but with intellect and decent purpose. As one who has witnessed the horror and the

lingering sadness of war as one who knows that another war could utterly destroy this civilization which

has been so slowly and painfully built over thousands of years I wish I could say tonight that a lasting

peace is in sight. So in this my last good night to you as your President I thank you for the many

opportunities you have given me for public service in war and peace.

Gettysburg - 2 sentences

Four score and seven years ago our fathers brought forth on this continent, a new nation, conceived in

Liberty, and dedicated to the proposition that all men are created equal. The world will little note, nor

long remember what we say here, but it can never forget what they did here.

Gettysburg - 5 sentences

Four score and seven years ago our fathers brought forth on this continent, a new nation, conceived in

Liberty, and dedicated to the proposition that all men are created equal. Four score and seven years

ago our fathers brought forth on this continent, a new nation, conceived in Liberty, and dedicated to

the proposition that all men are created equal. Four score and seven years ago our fathers brought

forth on this continent, a new nation, conceived in Liberty, and dedicated to the proposition that all

32

Page 33: Auto mat i c Su mmari zat i onpeople.uncw.edu/tagliarinig/Courses/380/F2016 papers and...TextRank 8 The Original Idea 8 Formal Statement of the Si mil arit y Eq uat i on 8 Implementation

men are created equal. The world will little note, nor long remember what we say here, but it can never

forget what they did here. It is rather for us to be here dedicated to the great task remaining before us

-- that from these honored dead we take increased devotion to that cause for which they gave the last

full measure of devotion -- that we here highly resolve that these dead shall not have died in vain -- that

this nation, under God, shall have a new birth of freedom -- and that government of the people, by the

people, for the people, shall not perish from the earth.

MacArthur - 10 sentences

General Westmoreland, General Grove, distinguished guests, and gentlemen of the Corps! But this

award is not intended primarily to honor a personality, but to symbolize a great moral code -- the code

of conduct and chivalry of those who guard this beloved land of culture and ancient descent. Every

pedant, every demagogue, every cynic, every hypocrite, every troublemaker, and I am sorry to say,

some others of an entirely different character, will try to downgrade them even to the extent of

mockery and ridicule. They teach you to be proud and unbending in honest failure, but humble and

gentle in success; not to substitute words for actions, not to seek the path of comfort, but to face the

stress and spur of difficulty and challenge; to learn to stand up in the storm but to have compassion on

those who fall; to master yourself before you seek to master others; to have a heart that is clean, a goal

that is high; to learn to laugh, yet never forget how to weep; to reach into the future yet never neglect

the past; to be serious yet never to take yourself too seriously; to be modest so that you will remember

the simplicity of true greatness, the open mind of true wisdom, the meekness of true strength. They

give you a temper of the will, a quality of the imagination, a vigor of the emotions, a freshness of the

deep springs of life, a temperamental predominance of courage over timidity, of an appetite for

adventure over love of ease. And 20 years after, on the other side of the globe, again the filth of murky

foxholes, the stench of ghostly trenches, the slime of dripping dugouts; those boiling suns of relentless

heat, those torrential rains of devastating storms; the loneliness and utter desolation of jungle trails;

the bitterness of long separation from those they loved and cherished; the deadly pestilence of tropical

disease; the horror of stricken areas of war; their resolute and determined defense, their swift and sure

attack, their indomitable purpose, their complete and decisive victory -- always victory. We speak in

strange terms: of harnessing the cosmic energy; of making winds and tides work for us; of creating

unheard synthetic materials to supplement or even replace our old standard basics; to purify sea water

for our drink; of mining ocean floors for new fields of wealth and food; of disease preventatives to

expand life into the hundreds of years; of controlling the weather for a more equitable distribution of

heat and cold, of rain and shine; of space ships to the moon; of the primary target in war, no longer

limited to the armed forces of an enemy, but instead to include his civil populations; of ultimate conflict

between a united human race and the sinister forces of some other planetary galaxy; of such dreams

and fantasies as to make life the most exciting of all time. We speak in strange terms: of harnessing the

cosmic energy; of making winds and tides work for us; of creating unheard synthetic materials to

supplement or even replace our old standard basics; to purify sea water for our drink; of mining ocean

floors for new fields of wealth and food; of disease preventatives to expand life into the hundreds of

years; of controlling the weather for a more equitable distribution of heat and cold, of rain and shine; of

space ships to the moon; of the primary target in war, no longer limited to the armed forces of an

enemy, but instead to include his civil populations; of ultimate conflict between a united human race

and the sinister forces of some other planetary galaxy; of such dreams and fantasies as to make life the

most exciting of all time. Others will debate the controversial issues, national and international, which

divide men's minds; but serene, calm, aloof, you stand as the Nation's war-guardian, as its lifeguard

33

Page 34: Auto mat i c Su mmari zat i onpeople.uncw.edu/tagliarinig/Courses/380/F2016 papers and...TextRank 8 The Original Idea 8 Formal Statement of the Si mil arit y Eq uat i on 8 Implementation

from the raging tides of international conflict, as its gladiator in the arena of battle. Let civilian voices

argue the merits or demerits of our processes of government; whether our strength is being sapped by

deficit financing, indulged in too long, by federal paternalism grown too mighty, by power groups

grown too arrogant, by politics grown too corrupt, by crime grown too rampant, by morals grown too

low, by taxes grown too high, by extremists grown too violent; whether our personal liberties are as

thorough and complete as they should be. Were you to do so, a million ghosts in olive drab, in brown

khaki, in blue and gray, would rise from their white crosses thundering those magic words: Duty, Honor,

Country.

MacArthur - 25 sentences

Duty, Honor, Country: Those three hallowed words reverently dictate what you ought to be, what you

can be, what you will be. Every pedant, every demagogue, every cynic, every hypocrite, every

troublemaker, and I am sorry to say, some others of an entirely different character, will try to

downgrade them even to the extent of mockery and ridicule. Every pedant, every demagogue, every

cynic, every hypocrite, every troublemaker, and I am sorry to say, some others of an entirely different

character, will try to downgrade them even to the extent of mockery and ridicule. They teach you to be

proud and unbending in honest failure, but humble and gentle in success; not to substitute words for

actions, not to seek the path of comfort, but to face the stress and spur of difficulty and challenge; to

learn to stand up in the storm but to have compassion on those who fall; to master yourself before you

seek to master others; to have a heart that is clean, a goal that is high; to learn to laugh, yet never

forget how to weep; to reach into the future yet never neglect the past; to be serious yet never to take

yourself too seriously; to be modest so that you will remember the simplicity of true greatness, the

open mind of true wisdom, the meekness of true strength. They teach you to be proud and unbending

in honest failure, but humble and gentle in success; not to substitute words for actions, not to seek the

path of comfort, but to face the stress and spur of difficulty and challenge; to learn to stand up in the

storm but to have compassion on those who fall; to master yourself before you seek to master others;

to have a heart that is clean, a goal that is high; to learn to laugh, yet never forget how to weep; to

reach into the future yet never neglect the past; to be serious yet never to take yourself too seriously;

to be modest so that you will remember the simplicity of true greatness, the open mind of true

wisdom, the meekness of true strength. They give you a temper of the will, a quality of the imagination,

a vigor of the emotions, a freshness of the deep springs of life, a temperamental predominance of

courage over timidity, of an appetite for adventure over love of ease. And 20 years after, on the other

side of the globe, again the filth of murky foxholes, the stench of ghostly trenches, the slime of dripping

dugouts; those boiling suns of relentless heat, those torrential rains of devastating storms; the

loneliness and utter desolation of jungle trails; the bitterness of long separation from those they loved

and cherished; the deadly pestilence of tropical disease; the horror of stricken areas of war; their

resolute and determined defense, their swift and sure attack, their indomitable purpose, their

complete and decisive victory -- always victory. And 20 years after, on the other side of the globe, again

the filth of murky foxholes, the stench of ghostly trenches, the slime of dripping dugouts; those boiling

suns of relentless heat, those torrential rains of devastating storms; the loneliness and utter desolation

of jungle trails; the bitterness of long separation from those they loved and cherished; the deadly

pestilence of tropical disease; the horror of stricken areas of war; their resolute and determined

defense, their swift and sure attack, their indomitable purpose, their complete and decisive victory --

always victory. The code which those words perpetuate embraces the highest moral laws and will stand

the test of any ethics or philosophies ever promulgated for the uplift of mankind. The soldier, above all

34

Page 35: Auto mat i c Su mmari zat i onpeople.uncw.edu/tagliarinig/Courses/380/F2016 papers and...TextRank 8 The Original Idea 8 Formal Statement of the Si mil arit y Eq uat i on 8 Implementation

other men, is required to practice the greatest act of religious training -- sacrifice. We deal now not

with things of this world alone, but with the illimitable distances and as yet unfathomed mysteries of

the universe. We speak in strange terms: of harnessing the cosmic energy; of making winds and tides

work for us; of creating unheard synthetic materials to supplement or even replace our old standard

basics; to purify sea water for our drink; of mining ocean floors for new fields of wealth and food; of

disease preventatives to expand life into the hundreds of years; of controlling the weather for a more

equitable distribution of heat and cold, of rain and shine; of space ships to the moon; of the primary

target in war, no longer limited to the armed forces of an enemy, but instead to include his civil

populations; of ultimate conflict between a united human race and the sinister forces of some other

planetary galaxy; of such dreams and fantasies as to make life the most exciting of all time. We speak in

strange terms: of harnessing the cosmic energy; of making winds and tides work for us; of creating

unheard synthetic materials to supplement or even replace our old standard basics; to purify sea water

for our drink; of mining ocean floors for new fields of wealth and food; of disease preventatives to

expand life into the hundreds of years; of controlling the weather for a more equitable distribution of

heat and cold, of rain and shine; of space ships to the moon; of the primary target in war, no longer

limited to the armed forces of an enemy, but instead to include his civil populations; of ultimate conflict

between a united human race and the sinister forces of some other planetary galaxy; of such dreams

and fantasies as to make life the most exciting of all time. We speak in strange terms: of harnessing the

cosmic energy; of making winds and tides work for us; of creating unheard synthetic materials to

supplement or even replace our old standard basics; to purify sea water for our drink; of mining ocean

floors for new fields of wealth and food; of disease preventatives to expand life into the hundreds of

years; of controlling the weather for a more equitable distribution of heat and cold, of rain and shine; of

space ships to the moon; of the primary target in war, no longer limited to the armed forces of an

enemy, but instead to include his civil populations; of ultimate conflict between a united human race

and the sinister forces of some other planetary galaxy; of such dreams and fantasies as to make life the

most exciting of all time. And through all this welter of change and development, your mission remains

fixed, determined, inviolable: it is to win our wars. Yours is the profession of arms, the will to win, the

sure knowledge that in war there is no substitute for victory; that if you lose, the nation will be

destroyed; that the very obsession of your public service must be: Duty, Honor, Country. Others will

debate the controversial issues, national and international, which divide men's minds; but serene, calm,

aloof, you stand as the Nation's war-guardian, as its lifeguard from the raging tides of international

conflict, as its gladiator in the arena of battle. Others will debate the controversial issues, national and

international, which divide men's minds; but serene, calm, aloof, you stand as the Nation's

war-guardian, as its lifeguard from the raging tides of international conflict, as its gladiator in the arena

of battle. Let civilian voices argue the merits or demerits of our processes of government; whether our

strength is being sapped by deficit financing, indulged in too long, by federal paternalism grown too

mighty, by power groups grown too arrogant, by politics grown too corrupt, by crime grown too

rampant, by morals grown too low, by taxes grown too high, by extremists grown too violent; whether

our personal liberties are as thorough and complete as they should be. From your ranks come the great

captains who hold the nation's destiny in their hands the moment the war tocsin sounds. Were you to

do so, a million ghosts in olive drab, in brown khaki, in blue and gray, would rise from their white

crosses thundering those magic words: Duty, Honor, Country. Were you to do so, a million ghosts in

olive drab, in brown khaki, in blue and gray, would rise from their white crosses thundering those magic

words: Duty, Honor, Country. In my dreams I hear again the crash of guns, the rattle of musketry, the

strange, mournful mutter of the battlefield. Today marks my final roll call with you, but I want you to

35

Page 36: Auto mat i c Su mmari zat i onpeople.uncw.edu/tagliarinig/Courses/380/F2016 papers and...TextRank 8 The Original Idea 8 Formal Statement of the Si mil arit y Eq uat i on 8 Implementation

know that when I cross the river my last conscious thoughts will be of The Corps, and The Corps, and

The Corps

Yellow Submarine - 6 sentences

In the town where I was born. In our yellow submarine. And the band begins to play. Full speed ahead,

Mr. Boatswain, full speed ahead! Everyone of us (Everyone of us) has all we need (Has all we need).

Everyone of us (Everyone of us) has all we need (Has all we need). In our yellow submarine.

Yellow Submarine - 12 sentences

In the town where I was born. Lived a man who sailed to sea. In our yellow submarine. And the band

begins to play. Full speed ahead, Mr. Boatswain, full speed ahead! Full speed ahead, Mr. Boatswain, full

speed ahead! Cut the cable, drop the cable! Aye, sir, aye! Aye, sir, aye! Captain, captain! As we live a life

of ease (A life of ease). As we live a life of ease (A life of ease). Everyone of us (Everyone of us) has all

we need (Has all we need). Everyone of us (Everyone of us) has all we need (Has all we need). Everyone

of us (Everyone of us) has all we need (Has all we need). In our yellow (In our yellow) submarine

(Submarine, ha, ha).

36

Page 37: Auto mat i c Su mmari zat i onpeople.uncw.edu/tagliarinig/Courses/380/F2016 papers and...TextRank 8 The Original Idea 8 Formal Statement of the Si mil arit y Eq uat i on 8 Implementation

Works Cited

1. https://en.wikipedia.org/wiki/Automatic_summarization

2. http://smmry.com/about

3. https://www.cis.upenn.edu/~nenkova/papers/ipm.pdf

4. http://web.eecs.umich.edu/~mihalcea/papers/mihalcea.emnlp04.pdf

37