6
Text Mining using pTrees Posit ion 1 0 0 0 0 1 0 Term buy DTPe in PpTreeSet index (T,D) Doc3 Doc2 Doc1 1 0 DTPe Position Table Pos T1D1 T1D2 T1D3...T9D1…T9D3 1 1 0 1 ... 0 … 0 7 0 0 . . . 1 1 . . . 1 2 3 4 5 6 7 Doc3 Doc2 Doc1 .Doc ... Term 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 . . . 0 . . . 0 . . . 1 0 0 0 0 0 0 0 0 0 . . . 0 1 0 0 0 0 0 . . . 1 0 0 0 0 1 0 . . . DTPe Data Cube 1 2 9 Ter m 1 2 3 D TDcard P=k k=1..7 DTPe k=1..7 TDRolodexCards 1 2 7 Pos 1 2 3 D PDcard T=k k=1..9 DTPe k=1..9 PDCards 1 2 7 Pos 1 2 9 T PT card D=k k=1,2 ,3 DTPe k=1..3 PTCar DTPe Document Table: Doc T1P1…T1P7 . . . T9P1…T9P7 1 1 0 . . . 0 0 2 0 0 . . . 1 0 3 0 0 . . . 1 1 Classical Document Table: Doc Auth… Date . . .Subj 1 …Subj m 1 1 1/2/13 . . . 0 0 2 0 2/2/15 . . . 1 0 3 0 3/3/14 . . . 1 1 0 0 0 0 0 0 0 . . . DTPe DocTbl DpTreeSet indexed by (T,P)) Position 1 2 3 4 5 6 7 Term an and April are apple 0 0 0 0 0 0 0 . . . 0 0 1 0 0 0 0 . . . 0 0 0 1 0 0 1 . . . 0 0 0 0 0 0 0 . . . always 1 0 0 0 0 0 0 . . . all 0 0 0 0 0 0 0 . . . AAPL buy 0 1 0 0 0 0 0 . . . 0 1 0 0 0 0 1 0 . . . 0 0 Classical DocTbl DpTreeSet 1 Auth Date 0 Subj 1 0 Subj m DTPe Term Table: Term P1D1 P1D2 P1D3...P7D1…P7D3 1 1 0 1 ... 0 … 0 9 0 0 . . . 1 1 . . . DTPe Term Usage Table: Term P1D1 P1D2 P1D3...P7D1…P7D3 1 noun verb adj adv …noun 9 adj noun noun adj noun . . . Doc3 Doc2 Doc1 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 1 0 0 0 1 0 0 0 1 0 DTPe TpTreeS index (D,P) Positions 1 0 0 0 0 0 1 0 0 1 P1D1 noun 1 0 0 0 0 0 0 0 0 P1D1 adj S 0 1 . . . 1 0

Text Mining using pTrees Position 100 0010... Term buy DTPe in PpTreeSet index (T,D) Doc3 Doc2 Doc1 1 0 DTPe Position Table Pos T1D1 T1D2 T1D3...T9D1…T9D3

Embed Size (px)

Citation preview

Page 1: Text Mining using pTrees Position 100 0010... Term buy DTPe in PpTreeSet index (T,D) Doc3 Doc2 Doc1 1 0 DTPe Position Table Pos T1D1 T1D2 T1D3...T9D1…T9D3

Text Mining using pTrees

Position

1 0 0 0 0 1 0 . . .

Term buy

DTPe in PpTreeSet index (T,D)

Doc3

Doc2

Doc1

1 0

DTPe Position TablePos T1D1 T1D2 T1D3...T9D1…T9D31 1 0 1 ... 0 … 0

7 0 … 0 . . . 1 … 1

...

1 2 3 4 5 6 7 Doc3 Doc2

Doc1

.Doc

... T

erm

0

0

0

0

0

0

0

0

0

0

0

0

0

0

1

0

0

0

0

0

0

1

0

0

0

0

0

0

0

0

0

0

0

0

0

0

0 . . .

0 . . .

0 . . .

1

0

0

0 0 0 0 0 0 0 . . .

0 1 0 0 0 0 0 . . .

1 0 0 0 0 1 0 . . .

DTPe Data Cube

1

2

9

Term1 2 3 D

TDcardP=kk=1..7

DTPe k=1..7 TDRolodexCards

1

2

7

Pos1 2 3 D

PDcardT=kk=1..9

DTPe k=1..9 PDCards

1

2

7

Pos1 2 … 9 T

PT cardD=kk=1,2,3

DTPe k=1..3 PTCards

DTPe Document Table: Doc T1P1…T1P7 . . . T9P1…T9P71 1 … 0 . . . 0 … 0

2 0 … 0 . . . 1 … 0

3 0 … 0 . . . 1 … 1

Classical Document Table:Doc Auth… Date . . .Subj1 …Subjm

1 1 1/2/13 . . . 0 … 0

2 0 2/2/15 . . . 1 … 0

3 0 3/3/14 . . . 1 … 1

0 0 0 0 0 0 0 . . .

DTPe DocTbl DpTreeSet indexed by (T,P))Position 1 2 3 4 5 6 7

Term

an

and

April

are

apple

0 0 0 0 0 0 0 . . .

0 0 1 0 0 0 0 . . .

0 0 0 1 0 0 1 . . .

0 0 0 0 0 0 0 . . .

always 1 0 0 0 0 0 0 . . .

all 0 0 0 0 0 0 0 . . .

AAPL

buy

0 1 0 0 0 0 0 . . .

01 0 0 0 0 1 0 . . .

0 0

Classical DocTbl DpTreeSet

1

Auth Date 0

Subj1

0

Subjm

DTPe Term Table:Term P1D1 P1D2 P1D3...P7D1…P7D3

1 1 0 1 ... 0 … 0

9 0 … 0 . . . 1 … 1

...

DTPe Term Usage Table:Term P1D1 P1D2 P1D3...P7D1…P7D3

1 noun verb adj adv …noun

9 adj noun noun adj noun

...

Doc3 Doc2 Doc1

0

0

0

0

0

0

0

0

1

0

0

0

0

0

0

0

0

1

0

0

0

0

0

0

0

0

1

0

0

0

0

0

0

0

0

1

0

0

0

0

0

0

0

0

1

0

0

0

1

0

0

0

1

0

DTPe TpTreeSet index (D,P) Positions 1 2 …

0

0

0

0

0

1

0

0

1

P1D1noun

1

0

0

0

0

0

0

0

0

P1D1 adj

S 0 … 1 . . . 1 … 0

Page 2: Text Mining using pTrees Position 100 0010... Term buy DTPe in PpTreeSet index (T,D) Doc3 Doc2 Doc1 1 0 DTPe Position Table Pos T1D1 T1D2 T1D3...T9D1…T9D3

A2565 256 Documents 24 Positions1390Terms

12$36#Apple#BeInspired#bendgate#EU#flashcrash#'s$1,001$1,111$1.001$1.23$1.28$1.42$1.50-2.00$10$10.15$10.23$100.44$100.66$101.11$101.54$101.70's$101.80$102$102.00$102.03$102.15$102.17$110$110/$130$120$123$125$126$135$154$1600-$3200$19$2.70$200$3,500$3.1B$3.2B$3.50$3.77$32,000$39.88B$4.50$40$42.1B$460$48$500$51$540$55$575$580$63.5-$66.5$65$660$675$7-9B$80$810$9.16$9.65$90.00$900M$910$93.52$AAPL$AET$AKAM$ALSX$AMBA$AMZN$ASTI$AZN$BABA$BBRY$BIDU$BIOL$BP$CAT$CMG$CRUS$CTRL$DRIV$FB$FEYE$FIO$FORD$GLUU$GM$GOOG$GTAT$HIVE$HLF$HPQ$HURC$IBM$ICLD$IDCC$IDRA$IDTI$IG$IL$IMMR$INTC$INVN$ISR$JAKK$JCP$LIQD$LOCO$MLNX$MOBI$MS$NFLX$NQ$NTE$NUAN$NVTL$OTR$OVTI$P$PRAN$PXLW$RIMM$SBUX$SIMO$SIRI$SKUL$SONS$SPY$T$TWTR$UA$UNXL$VHC$VMW$VZ$YELP$YHOO$YOD$ZAGG$ZNGA&amp(morgan(Piper)(US$32000US(which.50c;$150@AJtrd:@AnalystWir@BloombergT@bobbirebel@Burns277@Carl_C_Ica@CBOE:@Chi_trader@cnbc:@DeidreZune@Doobcox680@ForbesGame@GearMarket@jazzstanda@jimmylong:@Legacy_Tra@Mazmasta@MicroFundy@Momentum_C@OptionsTra@poisedtotr@PTTResearc@RedDogT3Li@RedDogT3Li@ReutersIns@Thestreetm@todd_harri@TradeHawk:@WaltBTIG:@YahooFinancompanion+0.40.5%1%1.4M100%10-K11511912-month12th13%13th1515-30%15k1M2.220000200120142015207,00035M.-37.5-38.538-39M3pm44.3M4/24/2015405496,0004am5050%50-inch50M54%5S6+69M6M70%75K88000008M9/29/2014900009-11th9498.899pmaAAPLaboutaboveacceptingaccidentallaccommodatiaccordingAckmanactionactivatedactivationsactiveactivismactivistsactuallyaddaddedaddingadditionadmitsAdvisorsafteragainagoahahhaaaheadAislealertalertsallallocationall-timealreadyalsoalthoughamamazinglyAmazonAmericaamidananalystandAndroidannouncedannouncemenannouncesanotheranyanymoreanythingAppappearsAppleApple?sApple'sAppleTvapproachesapprox.areareaArgusArmoraroundarticleasaskingatAT&TattentionAvenueaveragebackbadBankBarclaysbasedbatterybebearsbeatBEATSbeenbeforebegunbeingbeliefbelievebelievesBelizebelowbendbendablebetabetterbetter-thanBGCbidbigbiggerbiggestBillBillionbitbiuyBlackBerryBlairblockbusterbloggerblowblowoutBMObodybondboostBostonbothbounceBoutiqueboysbrainerbreakbreakingBrianBroncoBTIGbubblesbuildingbuilt-inbullbullishbullsbusinessbutbuybuybackbuyerbuyingbuyoutbyC.callcallscancantcan'tCantorCapcapexCapitalcapitulatincasecashcaughtcautiousCBOECDNCEOCESCHAchainchangedchannelchargingchartchattercheapcheckChiefchillinchimeChinaChinesechipsCHUcitesCitibankcitingclarifycleanupclearlyClevelandclicheclientscliffcloudCNBCCoinsCollinComcastcomecomingcommentingcommentsCommercialcommisioncomparisoncompetitionconconcernsconferenceconfidenceconfidentconfirmconfirmatioconfirmedconfirmingconsensusConsumercontactscontinuatiocontinuecontractcontrollercontrolsConvictionCookcoolCooperman'sCorecorrectcorrectioncouldcourtcovercoversCowenCraigcrazyCreditCrosscrowdcrowdscrushedcustomercustomerscustycutcutscuttingCYDdailyDamndatadaydaysdealdebutDecemberdefendeddefendingdefenseDelaydelayeddeleteddemandDemarkderivativedesigndeskdesksdetailsDetwilerDeutshcedevelpersdevicediddidntdidn'tdifferentdipDirectordisasterdiscoverdissesdistributedistributiodividenddodocumentsdonateddon'tdoubleDoughertydowndowngradedowngradeddowngradesdowngradingdriverdrivesdroppingdueduringDylanearlierearlyearningsEinhornElectronicsembarrassinemployeeendendingengineerenrolledenteringEPSEquityE-readersessentiallyestimatesEuropeevaluatingeventevereveryoneExexampleexclusivesexpectexpectationexpectationexpectedexpectsextremeF2QfadefailedfallfallingfarFebfewFifthfiledfillfinalfinallyfindfirm'sfirstfitsfiveflatflowfocusingfolksfollowfollowupforFordforecastingforeverForstallFoxconnfromfront-runnefullFundfuturefuturesFwiwfy2013fy2014fyigaingainsgamegaminggapgappingGearGenegesturegetgetsgettingGilfordGillisgiveGladGlassGlobalGnomegoingGoldmangonnagoodGooglegotgottengrantedgreatgreatergrossGROUP'SgrowthGuessguidanceguideguidesguru'sguyguyshackedhadhahaHaiHai'sHallumhandharshhashavehaven'thavingheheadingheardhearinghelphelpinghelpshenceherherehere'she'shighhigherhighlighthighlightedhighshimhiringhishistoryhitholdholdersHollyHonhopehothousehowHPHTCHubertyhugeIIBMiBooksIdIDC:ieifImI'mImagineIMHOimpactininauguralinauguratesInc.IncreaseincreasedindexesIndiaindicatingindustryinformationinitatinginitiatedinlineInstitutionInsuranceintegratedIntoIntroductioinventoriesInvestinginvestorInvestorsiOS6iOS8iPadiPadsiPhoneIphone5Iphone5SIphone6iPhonesIrelandisISIisntISPsissuedititsIt'siwatchJaffrayJCPJefferiesJerryJMPJobsJohnjoinjournalismJPJPMjum;sjumpjustjusticeKassKatyKeepkeykickedkiddingkindaknownknowsKoreaKudosLAlanguageLarganlargeLargenlastlatelaterlaunchleadleavingleftlegalizesLegendaryLemmeLeonlessLetlevelLGlicensinglikelikelylinelinkliplistlittleliveloadedlocationslonglongslookinglookslotslovelowlowerlowestLQMTlurkingLuxembourgMacsmademaintainedmajormakemakersmakesmakingmanagementManagerManyMapsMarchmarginmarginsmarketMarketsMarshallmassiveMaymaybeMcafeeMcDougalMcNamee:MeeksmeetmemomentioningMentorMerrill'smidmid-FebruarmightMillerminmini2MinstermissedMktsMmmmMobilemodelingmojomomentmomentsMondaymoneymoreMorganMorgansmorningmostmovemoversmovesmoviemullingmultipleMunstermymyselfnailednamenamesnearneedneedsnegativenegotiatingnetNetflixNeutralnewnewsNextnicenightnightsnitnoNorthlandnotnotenotesnothingnotingnownumbersNYNYCNYTNYUobligationOctofoffofferofficialoffsetsohOmegaononeonlineonly'on-the-go'openopeningopeningsoperatingopinionopportunityororderordersOrientalOtelliniotherOTRouchouroutoutperformoverOvernightownownedPagingpaidPandorapanelpanicpanickingpartialPartnersPassportpatentpatentspatiencePaulPaypaymentsPCpdapenpeopleperperformPerhingperspectivePhisonphonepiecePiperPipersplaceplanningplansplaypleasepluspoisedpoorPopepopularpopularityportfoliopositivepositive.possibilitypossiblePostpostspotentialPRprepredictedpredictionspreinstallepremiumpre-orderspreppingpresentingprettyprevailpreviewpricepricedPricespriductsprimepriorprobproceedproductsprofitProfitsProgrammingproposedprotectionprovidingprovingpullbackpulledpulsepumpingpurchasepursuingpushputPut/CallputsputtingQ1Q3Q4quarterquartersquestionsquietlyraiseraisedraisesraisingrallyingrangrangeratingratioRBCrereadyreasonsreboundrecordrecordedrecordsrecoveryrecruitingregardsreitreiteratedreiteratingrelaxreliefremovingreplacedreportreportedreportingreportsResearchresginedresignedRetailretractreturnrevealedrevenuerevenuesreversalrexxamridiculousrippingroderohRTrumorrunrunningrutsabbaticalSachssaidsalessameSamsungSapphireSaturnasawsaysayinsayingsaysSchackSculleyscurryingsecondsecuritiesseeSeeingseenseessellsellingseniorsensesensitivesensorSentsentimentSeptemberseriesservicesetsettleseveralShanghaishareshareholdersharesshiftShmuckshockedshortshotsshouldShowshowcasingshowingshowsshutsidesidessignsignssincesinglesiteslashedslashingslowslownesssluggishsmallSmart\nCoveSmartphonesmokedsmugglersosocket.solarsoldsolicsomesoonsouldsourcesourcesspacespeakspeakingspillspokespotspottedspreadSquarestabilizatiStanleystanley)StarbucksstartstartedStartsstatementstayStellarStevestickstillstockstocksstopstoppedstorestraddlestraightstrangestrappedstrategicstreamStreaming-Tstreetstrengthensstrongstrong buysubssubscriberssuesugarcoatsuggestssuingSuisse:SundaysuppliersupplierssuppliessupplysupportsureSwiftswingsystemT-tableTabletsTaiwanTaiwan'stakingtalkstargetteardowntechtechnicianstermterrifictesttgtthanthatthatsthetheirthemtheretheythingsthinkthinksthisthosethoughtsthreethroughthrowsTiertillTimtimeTimestotodaytodaystoldTomtomororwtomorrowtonighttonitetootooktopTopekatopstouchtradetradertradestradingtrainingtrialtriggertryTSMCTumblrturnedTVtweettweetedTwitterU.S.UBSuglyunderwhelmiunitunitsupupdateupgradeupgradedupgradesupsideUrbanususeusersusingusualutterlyvaluevaluesvariousVerizonversusveryviavideoviewvisibilityvolumeVPvsvs.wwaitwaitingwakewasWatchweweakweaknesswearableWedbushWedgeweekweeklyweeksweightingwellwerewhatwhat'swhenwherewhichwhilewhitewhowhywildwillWilliamwinwinningwinsWintekwirelesswithwonwonderwontworkworkersworldworriedworstworthworthywouldwouldn?twowwrongWSJXiaomi'syearYear?sYELPyesyesterdayyetyouyuan

at one of those sensitivemoments give her a iwatch$SBUX three reasons Starbucksshares might stay hot In 2015nice looking daily chart on $JAKK for a swing trade herebeen a nice run for subs from $2.70 trade at $3.77$IDRA could run to the $3.50 area today$AAPL Apple plans investor call ahead of a potentialbond sales$AAPL Apple Profits jum;s 13% on boost from iPhone6$AAPL ! Apple reports better-thearnings as strong iPhone demand offsets sluggish iPad salesreversal on the $SPY again wow we are just all over the place todayout $AAPL @ $102.17 day tradeout $AAPL @ $102 push I spoke about earlierin $AAPL @ $101.54 long$AAPL push over $102first target on $AAPL is $101.80 area todayRT @AnalystWJefferiesStarts Apple $AAPL at Hold $110 price targetnice move on $AAPL here$AAPL chart update for 9/29/2014on a break test for $100.44 on $AAPL$AAPL test $100.66RT @DeidreZuNYT #EU commisioncan sue Ireland nit $AAPL at the court of justice in LuxembourgRT @CBOE: active puts CBOE $AAPLnice recovery on $AAPL todayRT @WaltBTIGit's embarrassI didn't check for myself earlier but #bendgateis ridiculousRT @WaltBTIGjust stopped in an AT&T store to try and bend a 6+ you have to be kidding Mentor that is nothing bendable$AAPL 98.89 area$AAPL pumping this morning left some money on the table on day trade out at $101.70'strading $AAPL this morning from $101.11 longwinning trading alerts from this morning $TWTR $AAPL $GLUUtook another swing on $AAPL $102.03 looking for an upsidenice call on our $AAPL trade $102.15 in pre market$AAPL to launch new iPad operatingsystem$AAPL first target is $102.00 areaRT @Thestreesubscribetrade alerts from yesterdaymaking us money $ALSX $AAPL $BIOL $NVTLcrazy action on $AAPL chart here guystrade alerts we have made money on this week $AAPL $GLUU $IMMR $PXLW $SONSnot a bad day all and all $3,500 on $AAPL tradeRT @poisedtojoin @PTTReseaas we live tweet during $AAPL IPhone6 eventsome morning movers for you $HURC $AMBA $LOCO $PRAN $AAPL $BP $MOBI $IL $ICLDnew training video series out for our paid subscribersRT @Momentum@Burns277nice calls on $LIQD $ASTI $IG $AAPLnice short on $AAPL for us this morning$AAPL what a move here solic buying coming inRT @GearMark#Apple $AAPL posts second straight profit gain as IPhone sales jumpRT @YahooFinRT @cnbc: earnings alert Apple Q3 EPS $1.28 vs. $1.23$AAPL Apple upgraded to outperforfrom market perform at JMP securitiesRT @Thestreetrade alerts are out ! sign up here for daily trading alertsRT @bobbirebU.S. week ahead earnings here's our preview of the big names to watch $AAPL $MS$GLUU three reasons why this small cap stock could continue to outperfor$AAPLwow $AAPL looks like its going to $90.00key support on $AAPL at $93.52nice bounce here on $AAPLRT @Bloomberbreaking IBM to sell iPhones iPads to business clients$GLUU nice trade here already up 15k on this onetook partial profits on $PXLW today$AAPL Apple heading to new all-time highs and no one can stop itnice looking chart on $PXLW watch for a continuationwe did pretty well on $ISR this amjust paid for my accommodadown there with one trade #BeInspir$FB $TWTR $AAPLRT @ForbesGahas Apple gotten its mojo backpre market movers 4/24/2015$AAPL $PXLW $GM $AET $CAT $ZNGA $AZN $SIRIhearing $OTR also said $IDTI most likely won the AAPL Iwatch deal providingwireless charging chips$GTAT -- $OTR says that $GTAT most likely won the AAPL Iwatch deal for sapphire cover glass worth $4.50 per watchTier 1 tech desk noting that a well known blogger is commentinthat $AAPL is negotiatiw ISPs for their own CDN prob negative for $AKAMGene Munster (Piper) commentinon $AAPL / beats potentialdeal believes better use of capital would be for : $YELP $TWTR or $YHOO Squarealso tonite Apple $AAPL is getting downgradetonite to buy from strong buy over at ISI GROUP'S Brian Marshall Guess he didnt get the memois this $AAPL buyout of BEATS the final blow to $SKUL Id say so$VHC opinion strengthe$VHC case vs $AAPL - clearly for $VHC$ZNGA having a nice day on this - $AAPL and $GOOG pursuing video game makershearing ClevelandResearch out \ negative on $AAPL modeling F2Q earnings at $9.65 consensus$10.15$NQ informatiI tweeted is 100% correct the $AAPL $NUAN I got hacked$AAPL Apple in talks with Comcast About Streamingservice note sure where Netflix $NFLX fits in here$INVN gapping higher on Boutique house out with comments that they won a contract from $AAPL for the Iphone6waiting on full confirmattold that $AAPL not a downgradewas deleted from Merrill'sU.S. Equity Core portfolioreplaced by $VMWFwiw ClevelandResearch has a negative note out on $AAPL - few concerns also China Mobile are below expectatithey saydo activistsever tweet when they sell $3 Billion worth of $AAPLhope you loaded up on Shmuck Insurance $AAPLalso I saw Overnightchatter was that AAPL is now raising Iphone orders to 38-39M units vs. prior 35M although I cant confirm thatDetwiler call on $AAPL makes sense - TSMC #'s were inline and Hon Hai's were a beatFwiw hearing Detwiler out positive commentinthat $AAPL had a blowout DecemberWSJ saying its official - $AAPL Apple and China Mobile sign deal to offer iphonebigger than todays upgrade of $AAPL is China Mobile has quietly begun taking pre-orderfor Apple iPhones$GLUU Chief says Google Glass could trigger another $AAPL iphone moment for gamingNorthlandraising YELP price tgt to $80 from $51 they expect a beat and raise in EPS tonite $AAPL and Android mobile being the driverEx $AAPL CEO John Sculley mulling $BBRY bid report$AAPL - Gene Munster over at the Fifth Avenue store taking the pulse of the crowd while lurking around - maybe he's chillin with Kass Gnomenot seeing anything on $AAPL weakness but Gene Munster is in NYC today and Boston tomorrow no details yet from contacts thereRT @todd_harTwitter legalizesfront-runin stocks $AAPL $NFLX $FB $CMG $UAa positive.sign for $AAPL business - Hon Hai recruitin90000 Chinese workers to fill massive $AAPL ordersCollin Gillis from BGC nailed $GOOG last week tonite note he cuts fy2013 numbers and fy2014 Buy $500 tgt but expects guide lower $AAPLrut roh - $AAPL - Apple May Delay Introductof IPhone 5S the chinese supplier crushed today in China tradingfwiw Tim Cook CEO of $AAPL to speak at All Things D conferenctonight at 9pm$AAPL filed a patent for a touch sensor panel design possible competitifor $UNXLno wonder why Otellini is leaving kicked out of $INTC - he turned down being in the $AAPL Iphone6not helping $AAPL at all that UBS downgradeHon Hai big $AAPL supplier citing poor salessigns of things to come seen this ugly ending in 2001 - meet Dylan the day traderLemme clarify Largan said the worst of order cuts is over Largen has greater visibilitand long lead times of other $AAPL suppliers$AAPL supplier Largan reported above expectatishowing signs of order stabilizain the supply chain worst appears over for $AAPLRT $NTE getting hit on sell side comments slashed numbers$NTE getting hit on sell side comments slashed numbers$IDCC upgraded to buy from hold @ Doughertywith a $48 tgt expect higher $AAPL margins per deviceBMO Capital tonite slashing price target on $AAPL to $460 from $580give the bears credit when its due Cross Research has been utterly negative on $AAPL foreverTaiwan's CommerciaTimes reportingthat the $AAPL Iphone5S low priced iPhone and iPad mini2 could all be delayedHon Hai big $AAPL manager downgradeby Barclays RBC also cutting numbers on $AAPL on weak demand for slowness in MarchGoldman Sachs removing $AAPL from the ConvictioBuy Listcan't wait for the inaugural4am pre market trading tomorrow gonna be a wild oneBTIG upgrade on $AAPL is $540 tgtvery cool $AAPL patent issued 'on-the-gwireless charging via an iPad Smart\nCowith a built-in batteryso what's the consensusout there if and when $AAPL guides lower which everyone (which everyone knows throws in the cash distributto sugarcoatmaybe the new Pope will join up with Einhorn and get Tim Cook to distributthe cash to shareholdand shut everyone up already$AAPL needs to buy Twitter and distributthe cash to shareholdIMHO thats the only relief they will get to help the stock pricefyi ClevelandResearch downgrade$AAPL stock accordingto the noteClevelandResearch slashing $AAPL estimates$9.16 versus consensusof $10.23hearing OTR Global cautious on $AAPL Iphones inventoribuilding in EuropePaging Gene Munster $AAPL cleanup the spill in Aisle 4RBC positive on $AAPL says the addition of an iWatch add $7-9B in revenue and $1.50-2.0in EPSgood piece in the NY Timeswouldn?t be so worried about Leon CoopermanOmega Advisors selling all his $AAPL he rode $RIMM $BBRY 1.4M sharesRT @Legacy_Tthink differentImagine if Einhorn had rang $AAPL Jobs with the same lipnote out from Goldman Sachs tonite on $AAPL reit Buy and $660 tgt believes activism will prevail for increasedcapital allocationLegendaryFund Manager Bill Miller made comments that $AAPL is worth 50% higherfollowup re $AAPL TV - A 50-inch TV has a proposed price of 20000 yuan (US$32000accordingto the article and $AAPL sourceShanghai Oriental Morning Post confirminwith Sources that $AAPL TV will debut in May Prices range from $1600-$32but $32,000 for a 50Gene Munster spotted in a white Ford Bronco on the 405 with Passport in hand Belize with McafeeTom Demark is a prime example why all market technicianeed to pay attentionto newswhere are the boys from Topeka with their $1,111 targetTopeka reit $!,111 tgt on $AAPL they love the Verizon numbers that were out this AManother weak sign for $AAPL VP Retail Jerry McDougal resignedKudos to OTR Global on $AAPL this AM good through of Iphone sales in China essentialfalling off a cliff CHU and CHAvery shocked to see Gene \ the bull \ Munster from Piper actually cut his target on $AAPL today and lower some EPS estimatesCitibank making a Sunday night statementdowngradi$AAPL to Neutral from Buy tgt cut to $575 from $675 for tomorrowfyi Morgan Stanley is having a 3pm conferenccall today with $AAPL analyst Katy Huberty in regards to $AAPL TV opportunitysell side notes on $AAPL make you wonder if AppleTv kinda got the short end of the stick on thisRT @RedDogT3In case you missed it here is WSJ article with my thoughts on $AAPLa few derivativdesks I speak to are mentioninpossible \ re weightingfor $AAPL on the various indexesCowen out with another view of $VHC still values patents at approx. $3.1B and sees 70% upside to the stock$AAPL initiatedBUY for tomorrow at Citibank with a $675 tgt did they just wake up and discover $AAPLCantor upgrades $AAPL to strong bufrom buyingGoldman Sachs note out on $AAPL and HTC netCowen says they value $VHC patents at $3.2B and view $AAPL as a buyer of $VHC in the $55 price range which they say makes sense$IDCC up on comments from a boutique house ie deal with $AAPL licensingdeal could be worth $900M using .50c increase in pda numbersGoldman Sachs comments on $AAPL moves today belief Forstall is the fall guy on the failed MapsRT @RedDogT3Investorswho owned stock and sold in the money calls in $AAPL win Keep premium and in weeks stock should$AAPL highs of the day Goldman Sachs comments about entering a straddle on the name in addition to last nights pieceGoldman Sachs has a positive $AAPL note out for tomorrow reit $810$FIO getting hit off $MLNX news $AAPL cutting back on the 2.2 customerSeeing sell side comments on $VHC$AAPL added to solar buy list at Deutshce bank nownot sure its known $AAPL bull Gene Munster from Piper in LA Oct 9-11th showcasinthem not sure why he would need to do thatterrific alerts on the high beta by @RedDogT3$AAPL call spot on nice work if you heard him$VHC - William Blair making comments sayin to buy the stock near term tgt of $40 possibilithat $AAPL will settle prior to the trial$P - $AAPL seen putting Pandora in play amid online shiftGene Munster from Piper getting a little cliche on $AAPL$GTAT up on Piper Jaffray note $19 tgt Gene Munster says $AAPL evaluatinSapphire for mobile phone covers$YELP rallying after $AAPL confirmedits September12th event $YELP to be integrateinto iOS6 Iphone5Topeka reiterati$1,111 target on $AAPL based on Wintek reportinghuge sales in Taiwan they are major supplier to $AAPL$VHC reiteratebuy and $65 target Gilford expected $AAPL trial to proceed and confidentthat $VHC will winGlad to be back from my sabbaticagreat calls around today $HLF $AAPLmultiple $AAPL key senior employee resgined yesterdaycheck out this flow chartJP Morgans upgrade on $OVTI today is essentialconfirminwhat we had days ago with $AAPL iPhone5 wins JPM admits they got it wrong$AAPL Im told Topeka Cap Mkts has a note out reit $1,111 tgt defendingthe stock and saying its down on poor journalisand cheap shots@RedDogT3$AAPl great trading as usualTopeka Capital Markets that had the $1.001 $AAPL target is out raising it again to a street high of $1,111this is great $AAPL defended now Topeka saying AT&T iPhone activationeed to be put into perspectiveI spoke to soon Pipers Gene Munster reit $910 target on $AAPL not focusing on Iphone activatiobut on top top line sales future products$AAPL bulls scurryingto find Gene Minster to come on CNBC for a defense on this missed activatiofrom $VZ and $T$AAPL not good jefferiessaying that $T activated4.3M Iphones in q1 less than the 6M expectatiouch@RedDogT3nice trading great follow in the stream@RedDogT3are you looking for a big gap down tomororw $AAPL any level tomorrow on a gap down to get long$JCP Bill Ackman Perhing Square is speaking now NYU Schack REIT conferencsays that JCP poised to rebound with new ceo from $AAPLLQMT Korea times is reportingthat LQMT is likely to be in Apple's new iphone5Many people asking for the $FORD $AAPL link here it isStellar early call on $AAPL by Wedge Partners$FORD deal with $AAPL iphone priducts on their siteHolly bubbles Topeka Capital Markets initating$AAPL with a $1,001 price target$AAPL I'm sure this is going to be highlightMonday ex Apple TV engineer disses firm's post Steve Jobs design$ZAGG presentintomorrow @ Wedbush conferencmid day $AAPL event tomorrow as wellC. Hallum reit buy on $SIMO Phison said controlleunit sales would double which is + industrysources indicatinthat $AMZN is opening a retail store ie $AAPL to sell Amazon exclusiveE-readersand TabletsJefferiesout saying that they believe $AAPL will pay a dividend later this year$VHC up on documentsshowing that $VHC is suing $AAPL again rexxam of the caseRT @TradeHaw$AAPL prepping movie cloud service bad for $NFLX$CTRL showing up on \ several sell side reports as a comparisoto own into CEST- Mobile CEO predictiofor 2015 - thinks wearable $AAPL Iwatch will be huge$IDTI speaking at Barclays next week - Consumer ElectroniShowCraig Hallum and OTR Global both very high on $IDTI - citing a big potentialwin at LG and $AAPLKaty Huberty (morgan stanley) also has a \ bull case on $AAPL and raises to ;$150 with prior tgt of $135 using a $10 EPS tgtKaty Huberty (Morgan Stanley) taking Apple $AAPL target up to $126 from $135Sell side said $AAPL teardown wont be out till 2015 belief is that $IDTI won the wireless charging socket. Let the chart guru's chime insome pretty harsh language from $GLUU - so $AAPL is 54% custy of $GLUUthe bigger highlightis that $BIDU $BABA Samsung and $AAPL \ could follow Xiaomi's lead and make a strategicmove with $YOD as welllooks like $HIVE had to retract their PR yesterday&amp added that they donated in support of $AAPL $AAPLanother sell side analyst making comments on the $HIVE $AAPL news says $HIVE isnt worthy of the 50M market cap add sees 8M tops hence fade$AAPL oh my$AAPL #flashcra2AAPL is forecastiflat revenue for the first timeRT @MicroFunNew Tumblr post Why the Google downgradeis a year too late$AAPL March $110/$130call ratio spread trades$AAPL out of pullback channel$CRUS - Next $AAPL supplier disaster$AAPL seeing large December 115 to 119$AAPL calls hot in early trade 75K calls trading already$AAPL - please no questionson all the calls trading today@Doobcox6It's an AAPL supplier they are all getting smoked on earnings buy the rumorweekly calls active $HPQ $AAPL $IBM ahead of HP announcement$AAPL margin guidance bit underwhelsee if they fade this time$AAPL Q1 guides $63.5-$66revenues 37.5-38.5gross margins$AAPL $1.42 vs. $1.31 Revenues $42.1B vs. $39.88Ba sentimentextreme popular trade looks to be short the stock and buy upside call protectio$AAPL$AAPL trading 496,000 calls to 207,000 puts so far into earnings 0.4 Put/Call ratio would be lowest recorded into EPS in 8 quarterslots of big guys running $BABA $AAPL $BIDU@Mazmasta@OptionsT$AAPL making its push into payments and $DRIV started acceptingBit Coins maybe$AAPL Apple's Swift ProgrammiLanguage proving popular with develpers$AAPL Mmmm i wonder how big the buyback will be announcedon the con call$AAPL yes Apple can double from here$AAPL just be patience longs it will pay off big time don't panic sell$AAPL RBC raises Apple price target to $123 cites higher than expected iPhone6 demand\ @Chi_tradPaul Meeks Director of InstitutiInvestingSaturna Capital on CNBC just now : \ $AAPL should be at $154\ @jazzstan$AAPL sell before its too late$AAPL $FB $BABA futures dropping but China ripping higher on the open strange no$AAPL Bank of America approache800000 customersenrolled in Apple pay\ $AAPL Credit Suisse: Apple?s capex and purchase obligatioguidance in 10-K shows managemenconfidence\ @AJtrd: $AAPL ahahhaa CNBC folks just changed their sides not bullish anymore Damn$AAPL Iphone6 gets Sent Into space by Urban Armor Gear$AAPL huge China growth - Apple planning five new Chinese retail store openings by Feb hiring for 15 new locations$AAPL Apple says iBooks adding 1M new users a week since being preinstalon iOS8$AAPL $BABA $FEYE $FB I haven't sold one single stock no panic here long and strong$AAPL sales start in 1 min$AAPL $BBRY BlackBerrdeleted a tweet that it accidentasent from an iPhone$AAPL Apple Watch iPhone companionapp revealed$AAPL added on this dip no brainer$AAPL pulled back 0.5% and people panickinghaha$AAPL Apple granted patent for gesture controlsApple Inc. to report record sales in China and India$AAPL McNamee: Apple amazinglycheap$AAPL Apple to return $200 Billion to holders$AAPL IDC: Q4 2014 PC growth better than expected all-time high for Macs predicted$AAPL Apple helps supplies Foxconn TSMC hit record Q4 revenues\ @jimmylon$SPY $AAPL a 6 year bull market is finally capitulatget ready for a slow 15-30% correction$AAPL Chinese iPhone smuggler caught with 94 iPhones strapped to his body$AAPL Apple inaugurat13th store in China to massive crowds$AAPL 5 reasons why you sould still biuy Apple today$AAPL Apple's iPhone6 drives 50% Increase In US Smartphonmarket shares$AAPL Apple announcesnew App Store records says New Year?s Day biggest sales day in history$AAPL Apple Watch could boost stock$AAPL UBS has maintaineits \ buy rating on shares of AAPL with a 12-month price target of $125$AAPL UBS data suggests Apple sold 69M iPhones in blockbustDecember quarter$AAPL popularitof the iPhone6 plus sees Apple make market share gains around the world$AAPL Apple Watch launch expected in March retail training set for mid-February$AAPL 2015 is the year of the Apple Watch$AAPL its down 1% and people panickingrelax folks and buy while its cheap$AAPL Apple Pay impact on paymentsreiteratebuy and the price target was raised to $125 from $120 at Argus $AAPL$AAPL below average volume no need to panic boys add more if you like the stock long term$AAPL nice pullback adding$AAPL Apple?s next big device pen

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155156157158159160161162163164165166167168169170171172173174175176177178179180181182183184185186187188189190191192193194195196197198199200201202203204205206207208209210211212213214215216217218219220221222223224225226227228229230231232233234235236237238239240241242243244245246247248249250251252253254255256

Page 3: Text Mining using pTrees Position 100 0010... Term buy DTPe in PpTreeSet index (T,D) Doc3 Doc2 Doc1 1 0 DTPe Position Table Pos T1D1 T1D2 T1D3...T9D1…T9D3

A2565 Consider phrases nice day, nice call(s), nice run, nice short, nice move, nice bounce, nice recovery,. E.g., Retrieve docs PDnice,pos AND PDday,pos+1 and then do human sentiment analysis

niceday0000100000000000

0001000000000000

Doc#=4*16+4=68

Doc68: $ZNGA having a nice day on this-$AAPL and $GOOG pursuing video game makers

nicecall 0 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0

0 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0

Doc#=1*16+14=30

Doc30: nice call on our $AAPL trade $102.15 in pre market

nicecalls 0 0 1 0 0 0 0 0 0 0 0 0 0 0 0 0

0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0

Doc#=2*16+8=40

Doc40: RT @Momentum@Burns277nice calls on $LIQD $ASTI $IG $AAPL

nicerun 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0

0 0 0 1 0 0 0 0 0 0 0 0 0 0 0 0

Doc#=0*16+4=4

Doc4: been a nice run for subs from $2.70 trade at $3.77

niceshort0010000000000000

0000000010000000

Doc#=2*16+9=41

Doc41: nice short on $AAPL for us this morning

nicemove1000000000000000

0000000000000001

Doc#=0*16+16=16

Doc16: nice move on $AAPL here

nicebounce0001000000000000

0010000000000000

Doc#=3*16+ 3=51

Doc51: nice bounce here on $AAPL

nicerecovery0100000000000000

0000010000000000

Doc#=1*16+ 6=22

Doc22: nice recovery on $AAPL today

I realize “nice ___” is expressing a stock rise after the fact, which is probably a useless signal ?But these may be all from a different analyst and the combo may mean a good day for $AAPL tomorrow also?I’m not a stock analyst and haven’t identified a good signal here (don’t waste real money trying it!)The point is, with Document, Term and Position pTrees, a lot of decision support analysis can be done.What is a better key word for future up ticks? “expect”, “watch”, “expect a nice ____”, …Maybe? If Japanese or Chinese market tweets are:“nice _____” then buy in the US exchange as soon as it opens?Again, work with a person who does this for a living and just act as a decision supporter for that person. Your counterpart should have a semi-automated trading system running and tested out. You would just add the advantage of decision support based on Positions of Terms and Phrases from a big collection of tweets?

1. Retrieve all NonPureZero DpTrees DPnice.pos

2. For each such, Retrieve NPZ DPday.pos+1

3. pos, AND the two pTrees

niceP=11000000000000000

0010000000000000

niceP=11000000000000000

0000000000000001

niceP=10100000000000000

0000010000000000

niceP=10100000000000000

0000000000000100

niceP=40010000000000000

0000000100000000

niceP=10010000000000000

0000000010000000

niceP=10001000000000000

0010000000000000

niceP=20001000000000000

0000100000000000

niceP=10001000000000000

0000000010000000

niceP=40000100000000000

0001000000000000

niceP=d0000000001000000

0000010000000000

niceP=20000000000000001

0000000000000010

niceP=20000000000100000

0000000100000000

niceP=31000000000000000

0001000000000000

Retrieve all NPZ DpTrees DPday.2 None!Retrieve all NPZ DpTrees DPday.3 None!Retrieve all NPZ DpTrees DPday.4 AND with DPnice,3 produces zero pTree

dayP=40010000000000000

0001000000000000

niceP=31000000000000000

0001000000000000

Retrieve all NPZ DpTrees DPday.5 AND with the 2 DPnice,4

niceP=40000100000000000

0001000000000000

dayP=50000100000000000

0001000000000000

Retrieve all NPZ DpTrees DPday.e None!

Page 4: Text Mining using pTrees Position 100 0010... Term buy DTPe in PpTreeSet index (T,D) Doc3 Doc2 Doc1 1 0 DTPe Position Table Pos T1D1 T1D2 T1D3...T9D1…T9D3

A general strategy:Every tweet has a date and refers to a [set of] stock.Look back over the market history and identify (Stock, date) corresponding to “wish I had bought” situations.Characterize the tweet base just prior to that date and involving that stock.Using some metric which measures the “distance” or “difference” between two tweetbases, look for a near neighbor tweetbase and when found buy that stock.

What distance?A simple distance between two tweetbases (sets of tweets on a given day) might be to compare the vocabularies. Two tweetbases are close if their vocabularies are close (many of the same words).

A better distance might be like the above but only counting key words (which indicate positive sentiment on that stock).

Other?

Page 5: Text Mining using pTrees Position 100 0010... Term buy DTPe in PpTreeSet index (T,D) Doc3 Doc2 Doc1 1 0 DTPe Position Table Pos T1D1 T1D2 T1D3...T9D1…T9D3

APPENDIX: Text Mining using pTrees Sentiment analysis, SA on small datasets (yesterday’s AAPL tweets) w NLP.A new SA signal which is faster/more_accurate/uses_vertical_data?Position info for phrase analysis, but then pTrees are not necessary

0

0

0

0

0

0

0

0

1

0

0

0

0

0

0

0

0

1

0

0

0

0

0

0

0

0

1

0

0

0

0

0

0

0

0

1

0

0

0

0

0

0

0

0

1

0

0

0

1

0

0

0

1

0

DTPe expressed as TpTreeSet index (D,P) Positions 1 2 … Doc3 Doc2 Doc1

Best approach? Compose a historical TBHG (deep and wide) TrainingSet, TS(stock,day,.) containing a column for every pertinent Wall Street and Main Street input (e.g., Russia invades Kiev!) on each stock on each day. Class label: increased/decreased (by a threshold % the next day?). Build a Hulls around the “increased” and “decreased’ classes. Classify each stock each day. Buy increasers on margins. Sell decreasers short. A SA column would be a pertinent Wall Street measurement column.

0 0 0 0 0 0 0 . . .

DTPe DT expressed as DpTreeSet indexed by (T,P))Position 1 2 3 4 5 6 7

Term

an

and

April

are

apple

0 0 0 0 0 0 0 . . .

0 0 1 0 0 0 0 . . .

0 1 0 1 0 0 1 . . .

0 0 0 0 0 0 0 . . .

always 1 0 0 0 0 0 0 . . .

all 0 0 0 0 0 0 0 . . .

AAPL

buy

0 1 0 0 0 0 1 . . .

01 0 0 0 0 1 0 . . .

Position

1 0 0 0 0 1 0 . . .

Term buy

DTPe as PpTreeSet index (T,D)

Doc3

Doc2

Doc1

Document Table:Doc T1P1…T1P7 . . . T9P1…T9P71 1 … 0 . . . 0 … 0

2 0 … 0 . . . 1 … 0

3 0 … 0 . . . 1 … 1

0 0

1 0 DTPe expressed as Position Table

Pos T1D1 T1D2 T1D3...T9D1…T9D31 1 0 1 ... 0 … 0

7 0 … 0 . . . 1 … 1

...

Term Table:Term P1D1 P1D2 P1D3...P7D1…P7D3

1 1 0 1 ... 0 … 0

9 0 … 0 . . . 1 … 1

...

1 2 3 4 5 6 7 Doc3

Doc2 Doc1

.Doc

s

... T

erm

s

0

0

0

0

0

0

0

0

0

1

0

0

0

0

1

0

0

0

0

0

0

1

0

0

0

0

0

0

0

0

0

0

0

0

0

0

0 . . .

0 . . .

0 . . .

1

0

0

0 0 0 0 0 0 0 . . .

0 1 0 0 0 0 1 . . .

1 0 0 0 0 1 0 . . .

DTPeDocument Term Position existential Data Cube

1 2 3 4 5 6 7 Doc3

Doc2 Doc1

.Doc

s

... T

erm

s

0

0

0

0

0

0

0

0

0

3

0

0

0

0

4

0

0

0

0

0

0

1

0

0

0

0

0

0

0

0

0

0

0

0

0

0

0 . . .

0 . . .

0 . . .

2

0

0

0 0 0 0 0 0 0 . . .

0 3 0 0 0 0 1 . . .

5 0 0 0 0 2 0 . . .

DTPtfDocTermPos termfrequency Data Cube

DTPtf bitsliced gives multiple binary DataCubes

One can use any measurement or data structure of measurements, e.g., DTPtfidf in which each cell has a decimal tfidf measurement, which can be bitsliced directly into whole number bitslices plus fractional bitslices (one for each binary digit to the right of the binary point-no need to shift!).

In all cases we have 1 or more bitslice DTP bianry cubes (fro DTPe we have only the units bitslice)

Use DTPe DataCube when doing Data WarehousingUse DTPe DocTbl for Doc Classification/ClusteringUse DTPe TD Rolodex Card when doing TD relationship ARM, etc.

1

2

9

Term

1 2 3 D

TD cardP=kk=1..7

DTPe as k=1..7 TD Rolodex Cards

1

2

7

Pos

1 2 3 D

PD cardT=kk=1..9

DTPe as k=1..9 PD Rolodex Cards

1

2

7

Pos

1 2 … 9Term

PT cardD=kk=1,2,3

DTPe as k=1..3 PT Rolodex Cards

Page 6: Text Mining using pTrees Position 100 0010... Term buy DTPe in PpTreeSet index (T,D) Doc3 Doc2 Doc1 1 0 DTPe Position Table Pos T1D1 T1D2 T1D3...T9D1…T9D3

Text Mining using pTrees

Position

1 0 0 0 0 1 0 . . .

Term buy

DTPe in PpTreeSet index (T,D)

Doc3

Doc2

Doc1

1 0

DTPe Position TablePos T1D1 T1D2 T1D3...T9D1…T9D31 1 0 1 ... 0 … 0

7 0 … 0 . . . 1 … 1

...

1 2 3 4 5 6 7 Doc3 Doc2

Doc1

.Doc

... T

erm

0

0

0

0

0

0

0

0

0

1

0

0

0

0

1

0

0

0

0

0

0

1

0

0

0

0

0

0

0

0

0

0

0

0

0

0

0 . . .

0 . . .

0 . . .

1

0

0

0 0 0 0 0 0 0 . . .

0 1 0 0 0 0 1 . . .

1 0 0 0 0 1 0 . . .

DTPe Data Cube

1

2

9

Term1 2 3 D

TDcardP=kk=1..7

DTPe k=1..7 TDRolodexCards

1

2

7

Pos1 2 3 D

PDcardT=kk=1..9

DTPe k=1..9 PDCards

1

2

7

Pos1 2 … 9 T

PT cardD=kk=1,2,3

DTPe k=1..3 PTCards

DTPe Document Table: Doc T1P1…T1P7 . . . T9P1…T9P71 1 … 0 . . . 0 … 0

2 0 … 0 . . . 1 … 0

3 0 … 0 . . . 1 … 1

Classical Document Table:Doc Auth… Date . . .Subj1 …Subjm

1 1 1/2/13 . . . 0 … 0

2 0 2/2/15 . . . 1 … 0

3 0 3/3/14 . . . 1 … 1

0 0 0 0 0 0 0 . . .

DTPe DocTbl DpTreeSet indexed by (T,P))Position 1 2 3 4 5 6 7

Term

an

and

April

are

apple

0 0 0 0 0 0 0 . . .

0 0 1 0 0 0 0 . . .

0 1 0 1 0 0 1 . . .

0 0 0 0 0 0 0 . . .

always 1 0 0 0 0 0 0 . . .

all 0 0 0 0 0 0 0 . . .

AAPL

buy

0 1 0 0 0 0 1 . . .

01 0 0 0 0 1 0 . . .

0 0

Classical DocTbl DpTreeSet

1

Auth Date 0

Subj1

0

Subjm

DTPe Term Table:Term P1D1 P1D2 P1D3...P7D1…P7D3

1 1 0 1 ... 0 … 0

9 0 … 0 . . . 1 … 1

...

DTPe Term Usage Table:Term P1D1 P1D2 P1D3...P7D1…P7D3

1 noun verb adj adv …noun

9 adj noun noun adj noun

...

Doc3 Doc2 Doc1

0

0

0

0

0

0

0

0

1

0

0

0

0

0

0

0

0

1

0

0

0

0

0

0

0

0

1

0

0

0

0

0

0

0

0

1

0

0

0

0

0

0

0

0

1

0

0

0

1

0

0

0

1

0

DTPe TpTreeSet index (D,P) Positions 1 2 …

0

0

0

0

0

1

0

0

1

P1D1noun

1

0

0

0

0

0

0

0

0

P1D1 adj

D(TP)e Relationship Matrix ( 240x230 2D DataCube)Doc T1P1…T1P1K . . . T1MP1 … T1MP1K 1 0 0 1 0 2 0 0 0 1 .

.

.

1T 1 0 0 0

S 0 … 1 . . . 1 … 0

One could do classical ARM on D(TP)e. e.g., Pick an Athor (analyst) OO, and a stock, $AAPL.Use the Classical DpTrees to mask all Docs authored by OO.Use the DTPe DpTrees to mask all documents containing $AAPL.

Now we have a mask pTree identifying all tweets from OO about $AAPL.Use that mask to isolate that part of D(TP)e referring too OO and $AAPL

Mask2=OR (DPall_pos T=$AAPL).