37
RULES ENGINE FOR POPULARITY BASED RANKING Project Members: Nitu Singh Dnyaneshwari C External Guide: Amaresh Shirsat Internal Guide: Prof Ketaki Naik Sponsored By: Ubiqtas Technologies

Project Members: Nitu Singh Dnyaneshwari C External Guide: Amaresh Shirsat Internal Guide: Prof Ketaki Naik Sponsored By: Ubiqtas Technologies

  • View
    218

  • Download
    2

Embed Size (px)

Citation preview

Page 1: Project Members: Nitu Singh Dnyaneshwari C External Guide: Amaresh Shirsat Internal Guide: Prof Ketaki Naik Sponsored By: Ubiqtas Technologies

RULES ENGINE FOR POPULARITY BASED RANKING

Project Members: Nitu Singh Dnyaneshwari C

External Guide: Amaresh Shirsat

Internal Guide: Prof Ketaki Naik

Sponsored By: Ubiqtas Technologies

Page 2: Project Members: Nitu Singh Dnyaneshwari C External Guide: Amaresh Shirsat Internal Guide: Prof Ketaki Naik Sponsored By: Ubiqtas Technologies

AGENDA

Overview of Rules Engine Block diagram of Rules Engine Algorithms implemented Implementation details Merging rules and connector with the

framework Applications of rule engine Further enhancement of the project Questions please

Page 3: Project Members: Nitu Singh Dnyaneshwari C External Guide: Amaresh Shirsat Internal Guide: Prof Ketaki Naik Sponsored By: Ubiqtas Technologies

OVERVIEW OF RULES ENGINE What is the rules engine? A central repository for ranking algorithms and various data sources.

What do we mean by rules?Algorithms which are used to rank data e.g page ranking algorithm.

Why are we using rule engine ?To generalize page ranking algorithm .

Page 4: Project Members: Nitu Singh Dnyaneshwari C External Guide: Amaresh Shirsat Internal Guide: Prof Ketaki Naik Sponsored By: Ubiqtas Technologies

BLOCK DIAGRAM OF RULES ENGINE

Ranking algo

Source of data

connectors

Ranking algo & connector

User selects

Rules engine

Result

administrator

Designs the rules and appropriate connector and inserts them in framework

Page 5: Project Members: Nitu Singh Dnyaneshwari C External Guide: Amaresh Shirsat Internal Guide: Prof Ketaki Naik Sponsored By: Ubiqtas Technologies

ALGORITHMS IMPLEMENTED

Web ranking -Page ranking algorithm -Keyword relevance -Connector to read web pages Database ranking -querying the database -searching of the data -ranking providing a recordset

Page 6: Project Members: Nitu Singh Dnyaneshwari C External Guide: Amaresh Shirsat Internal Guide: Prof Ketaki Naik Sponsored By: Ubiqtas Technologies

PAGE RANKING ALGORITHM

What is a Page Ranking Algorithm? -A method to rank web pages. -Gives the page a numeric value. -Numeric value depends on the link

structure of the web.

continued…..

Page 7: Project Members: Nitu Singh Dnyaneshwari C External Guide: Amaresh Shirsat Internal Guide: Prof Ketaki Naik Sponsored By: Ubiqtas Technologies

FACTORS GOVERNING A RANK OF THE PAGE

In links-Links pointing to a page

Out links-Links pointed by a page

Damping factor

Page 8: Project Members: Nitu Singh Dnyaneshwari C External Guide: Amaresh Shirsat Internal Guide: Prof Ketaki Naik Sponsored By: Ubiqtas Technologies

A B C D

Dangling link Out-link from A

In-link to B

PR(C) = (1-dFactor) + dFactor PR (B) Out-links(B)Σ

Factors governing a rank of the page (contd…)

Page 9: Project Members: Nitu Singh Dnyaneshwari C External Guide: Amaresh Shirsat Internal Guide: Prof Ketaki Naik Sponsored By: Ubiqtas Technologies

EXPANDED DEFINITION OF TERMS

PR(c):: PR stands for page rank of page c.

n=(1-d)::normalisation factor values range from 0 to 1.

d::damping factor value generally is 0.85 but it can range from 0 to 1.

Page 10: Project Members: Nitu Singh Dnyaneshwari C External Guide: Amaresh Shirsat Internal Guide: Prof Ketaki Naik Sponsored By: Ubiqtas Technologies

EXPANDED DEFINITION OF TERMS (CONTD…)

PR(B)

Out-links(B)

The summation sign indicates sum of all the pages pointing to page C and divided by the number of out bound links of the page pointing to page C.

Page 11: Project Members: Nitu Singh Dnyaneshwari C External Guide: Amaresh Shirsat Internal Guide: Prof Ketaki Naik Sponsored By: Ubiqtas Technologies

EXAMPLE

AT=

Page 12: Project Members: Nitu Singh Dnyaneshwari C External Guide: Amaresh Shirsat Internal Guide: Prof Ketaki Naik Sponsored By: Ubiqtas Technologies

KEYWORD RELEVANCE ALGORITHM

Explanation of keyword relevance algorithm

The page which has maximum count of the

keyword is ranked high.

Page 13: Project Members: Nitu Singh Dnyaneshwari C External Guide: Amaresh Shirsat Internal Guide: Prof Ketaki Naik Sponsored By: Ubiqtas Technologies

FACTORS GOVERNING OF KEYWORD RELEVANCE ALGORITHM Total count : total number of keywords

that occur in a webpage(repetition allowed)

Total keyword occurance :number of unique keywords that occur in a webpage(repetition not allowed)

Page 14: Project Members: Nitu Singh Dnyaneshwari C External Guide: Amaresh Shirsat Internal Guide: Prof Ketaki Naik Sponsored By: Ubiqtas Technologies

EXAMPLE

if a page has keywords sun,moon,earth,moon then ,

total count = 4

Total keyword occurance=3

Page 15: Project Members: Nitu Singh Dnyaneshwari C External Guide: Amaresh Shirsat Internal Guide: Prof Ketaki Naik Sponsored By: Ubiqtas Technologies

CONNECTOR

What is a Connector ?-Interface to read data from a specified data source.

Rules engine consist of two connectors -Web Connector -Database Connector

Page 16: Project Members: Nitu Singh Dnyaneshwari C External Guide: Amaresh Shirsat Internal Guide: Prof Ketaki Naik Sponsored By: Ubiqtas Technologies

Web connector An application that gathers web graph

by navigating links

Data connector An application that gathers recordset

by navigating the travelling the record source

DIFFERENT TYPES OF CONNECTORS

Page 17: Project Members: Nitu Singh Dnyaneshwari C External Guide: Amaresh Shirsat Internal Guide: Prof Ketaki Naik Sponsored By: Ubiqtas Technologies

IMPLEMENTATION DETAILS

Page 18: Project Members: Nitu Singh Dnyaneshwari C External Guide: Amaresh Shirsat Internal Guide: Prof Ketaki Naik Sponsored By: Ubiqtas Technologies

PAGE RANKING ALGORITHM

Dynamic matrix of pages Using the formula for page ranking

Ranking of web pages

Page 19: Project Members: Nitu Singh Dnyaneshwari C External Guide: Amaresh Shirsat Internal Guide: Prof Ketaki Naik Sponsored By: Ubiqtas Technologies

KEYWORD RELEVANCE ALGORITHM

Skimp through a web page

Removal of stopwords

Find out the keywords given by user in web page (repetitive and nonrepeatitive)

Rank according to total count and total keyword occurance

Page 20: Project Members: Nitu Singh Dnyaneshwari C External Guide: Amaresh Shirsat Internal Guide: Prof Ketaki Naik Sponsored By: Ubiqtas Technologies

WEBCONNECTOR

Get the URL URL queue child URL linked list Scan child URL First URL in linked list acts as a parent URL

Go to that URL scan the entire page . URL’s present in the linked list are child

URL’s present in queue are parent.

Page 21: Project Members: Nitu Singh Dnyaneshwari C External Guide: Amaresh Shirsat Internal Guide: Prof Ketaki Naik Sponsored By: Ubiqtas Technologies

QUERYING A DATABASE

Ms access is used at backend Different tables are used in order to

store the data set Normal pl-sql queries can be used to

query the the datbase e.g.Select *from person ;

Page 22: Project Members: Nitu Singh Dnyaneshwari C External Guide: Amaresh Shirsat Internal Guide: Prof Ketaki Naik Sponsored By: Ubiqtas Technologies

RANKING AND PROVIDING A RECORDSET

It will perform searching through the database.

Use an sql query to rank the data

The connector collects data for which recommendation is required

The maximum recommended data is ranked high

Page 23: Project Members: Nitu Singh Dnyaneshwari C External Guide: Amaresh Shirsat Internal Guide: Prof Ketaki Naik Sponsored By: Ubiqtas Technologies

MERGING RULES AND CONNECTOR WITH THE FRAMEWORK

Page 24: Project Members: Nitu Singh Dnyaneshwari C External Guide: Amaresh Shirsat Internal Guide: Prof Ketaki Naik Sponsored By: Ubiqtas Technologies

Proj.dll

vc++ proj

C++

Windows application

Convert your vc project to com dll

Import your dll into the windows applic

Client side

dll

Page 25: Project Members: Nitu Singh Dnyaneshwari C External Guide: Amaresh Shirsat Internal Guide: Prof Ketaki Naik Sponsored By: Ubiqtas Technologies

FURTHER APPLICATION OF THE PROJECT

Page 26: Project Members: Nitu Singh Dnyaneshwari C External Guide: Amaresh Shirsat Internal Guide: Prof Ketaki Naik Sponsored By: Ubiqtas Technologies

SCRAPS=6055 FRIENDS=584

Page 27: Project Members: Nitu Singh Dnyaneshwari C External Guide: Amaresh Shirsat Internal Guide: Prof Ketaki Naik Sponsored By: Ubiqtas Technologies

SCRAPS=2192 FRIENDS=203

Page 28: Project Members: Nitu Singh Dnyaneshwari C External Guide: Amaresh Shirsat Internal Guide: Prof Ketaki Naik Sponsored By: Ubiqtas Technologies

SCRAPS=8872 FRIENDS=395

Page 29: Project Members: Nitu Singh Dnyaneshwari C External Guide: Amaresh Shirsat Internal Guide: Prof Ketaki Naik Sponsored By: Ubiqtas Technologies

SCRAPS=401 FRIENDS=112

Page 30: Project Members: Nitu Singh Dnyaneshwari C External Guide: Amaresh Shirsat Internal Guide: Prof Ketaki Naik Sponsored By: Ubiqtas Technologies

EXPLANATION OF E.G.

Design a rule for ranking a profile on basis of friends

Design a rule for ranking a profile on basis of scraps

Design a connector to get the information about number of friends and scraps

Page 31: Project Members: Nitu Singh Dnyaneshwari C External Guide: Amaresh Shirsat Internal Guide: Prof Ketaki Naik Sponsored By: Ubiqtas Technologies

…CONTINUED

Suppose user selects rank on the basis of friends

Then in the above example “rahul” would be popped first then “sarang” then “shailu” and finally “dnyaneshwari”

Page 32: Project Members: Nitu Singh Dnyaneshwari C External Guide: Amaresh Shirsat Internal Guide: Prof Ketaki Naik Sponsored By: Ubiqtas Technologies

REAL TIME APPLICATION OF THE PROJECT

Page 33: Project Members: Nitu Singh Dnyaneshwari C External Guide: Amaresh Shirsat Internal Guide: Prof Ketaki Naik Sponsored By: Ubiqtas Technologies
Page 34: Project Members: Nitu Singh Dnyaneshwari C External Guide: Amaresh Shirsat Internal Guide: Prof Ketaki Naik Sponsored By: Ubiqtas Technologies
Page 35: Project Members: Nitu Singh Dnyaneshwari C External Guide: Amaresh Shirsat Internal Guide: Prof Ketaki Naik Sponsored By: Ubiqtas Technologies
Page 36: Project Members: Nitu Singh Dnyaneshwari C External Guide: Amaresh Shirsat Internal Guide: Prof Ketaki Naik Sponsored By: Ubiqtas Technologies
Page 37: Project Members: Nitu Singh Dnyaneshwari C External Guide: Amaresh Shirsat Internal Guide: Prof Ketaki Naik Sponsored By: Ubiqtas Technologies

QUESTIONS ?