In The Name Of In The Name Of GodGod

e-Researche-Research

Kianoosh MokhtarianKianoosh MokhtarianAli JafariAli Jafari

Amir Reza KhosroshahiAmir Reza KhosroshahiMostafa AmiriMostafa Amiri

e-Research Methods, e-Research Methods, Strategies, and IssuesStrategies, and Issues

IntroductionIntroduction

Our anxiety is, in great part, the Our anxiety is, in great part, the result of trying to do today’s job with result of trying to do today’s job with yesterday’s toolyesterday’s tool

The Net changes everythingThe Net changes everything ResearchResearch

Detailed study of a subject, especially in Detailed study of a subject, especially in order to discover (new) information or order to discover (new) information or reach a (new) understanding. reach a (new) understanding. (Cambridge (Cambridge International Dictionary of English)International Dictionary of English)

What Does The What Does The ee Mean? Mean?

A few years ago A few years ago ee meant a tool meant a tool Primarily text basedPrimarily text based Operated on a relatively unsecure Operated on a relatively unsecure

communication linkcommunication link A wide variation in performance and qulaity A wide variation in performance and qulaity

of serviceof service

E-applications in educationE-applications in education Students and faculty could access the Students and faculty could access the

contents easilycontents easily

What Does The What Does The ee Mean? Mean? (cont’d)(cont’d)

Audio, video and multimedia Audio, video and multimedia channels in Net-based platoformschannels in Net-based platoforms

Also changed our connotations of the Net or Also changed our connotations of the Net or the e-worldthe e-world

Generally: the activity takes place on Generally: the activity takes place on a high-speed, digital network, a high-speed, digital network, available “anytime/anywhere”available “anytime/anywhere”

Today that network is the internetToday that network is the internet

Tips For Finding Useful Tips For Finding Useful InformationInformation

Begin the search by analyzing your needsBegin the search by analyzing your needs Isolate your keywordsIsolate your keywords Select a search tool that matches your Select a search tool that matches your

needsneeds Experiment with a variety of search Experiment with a variety of search

enginesengines Most researchers’ favorite engine, Most researchers’ favorite engine, http://http://

www.google.comwww.google.com , general, fast and , general, fast and effectiveeffective

Some Search ToolsSome Search Tools

http://http://www.mednet.comwww.mednet.com devoted to medical informationdevoted to medical information

http://http://www.searchenginecolossus.comwww.searchenginecolossus.com Focused on particular regions and countriesFocused on particular regions and countries

http://http://www.noodlequest.com/noodlequestwww.noodlequest.com/noodlequest//

To find appropriate search engines, or what To find appropriate search engines, or what engines are availableengines are available

Generates a list of engines, based on your Generates a list of engines, based on your Internet skills and your search needsInternet skills and your search needs

Research DesignResearch Design

Encompasses the procedures a Encompasses the procedures a researcher use to study a (set of) researcher use to study a (set of) question(s) or hypothesisquestion(s) or hypothesis

e-research design is almost like the e-research design is almost like the design process for non-Net-based design process for non-Net-based reasearchreasearch

Purpose of developing a research designPurpose of developing a research design clearly express a solvable, important problemclearly express a solvable, important problem Structure the research by illustraiting how the Structure the research by illustraiting how the

major parts of the project (measures, treatments, major parts of the project (measures, treatments, programs, etc) address the objective of the programs, etc) address the objective of the researchresearch

Research Design (cont’d)Research Design (cont’d)

Typically includes:Typically includes: A research methodology paradigmA research methodology paradigm The use of related and relevant literatureThe use of related and relevant literature The purpose and/or objectives of the studyThe purpose and/or objectives of the study A problem statement (research questions)A problem statement (research questions) An acknowledgment of limitationsAn acknowledgment of limitations A statement of the significance of the studyA statement of the significance of the study A plan for data collection and analysisA plan for data collection and analysis

Asking The AnswerableAsking The Answerable

One of the most difficult tasks: One of the most difficult tasks: decide on a problem in need of decide on a problem in need of investigationinvestigation

The question must be asked in a The question must be asked in a researchable mannerresearchable manner

Example:Example: Should researchers learn how to use the Should researchers learn how to use the

Internet for more efficient and effective Internet for more efficient and effective research?research?

Asking The Answerable Asking The Answerable (cont’d)(cont’d)

UnanswerableUnanswerable asks whether asks whether shouldshould or or should notshould not

Impossible in empirical referentsImpossible in empirical referents Rarely “yes/no” answerable events worthy of Rarely “yes/no” answerable events worthy of

studystudy Something may be shown to be effective in one Something may be shown to be effective in one

setting, but not to many other settingssetting, but not to many other settings Implies that the Internet supports “more Implies that the Internet supports “more

efficient and effective research”efficient and effective research” This assumption is itself a research questionThis assumption is itself a research question Should not be given in the research problem Should not be given in the research problem

statementstatement

Asking The Answerable Asking The Answerable (cont’d)(cont’d)

Should researchers learn how to use the Iternet Should researchers learn how to use the Iternet for more efficient and effective research?for more efficient and effective research?

Must be answerable and have clarityMust be answerable and have clarity How does the use of the Internet for research How does the use of the Internet for research

influence research effectiveness?influence research effectiveness?

Still needs further clarification throughStill needs further clarification through subquestions that narrow the focus of the studysubquestions that narrow the focus of the study definitions of key-words in more precise term definitions of key-words in more precise term

(e.g., (e.g., influenceinfluence and and effectivenesseffectiveness))

Research MethodsResearch Methods

Different ways of arriving at the Different ways of arriving at the knowledgeknowledge Literature reviewLiterature review

Involves a synthesis of existing researchesInvolves a synthesis of existing researches A search which results in a list of references to A search which results in a list of references to

books, other materials on the topicbooks, other materials on the topic Action researchAction research

Involves a partnership between the researcher Involves a partnership between the researcher and those in a situationand those in a situation

Focuses on solutions to real problems in daily Focuses on solutions to real problems in daily lifelife

Research Methods Research Methods (cont’d)(cont’d)

Critical theoryCritical theory Involves the deconstruction of systems, Involves the deconstruction of systems,

unfold hidden agendasunfold hidden agendas Historical researchHistorical research

Attempts to detail the objective Attempts to detail the objective reconstruction of historical eventsreconstruction of historical events

Mixed methodMixed method Combines a number of methodsCombines a number of methods Provides views from different Provides views from different

perspectives on a problemperspectives on a problem

Quantitative ResearchQuantitative Research

Associated with study of natural Associated with study of natural phenomenaphenomena

Concerned with the tabulation or numeric Concerned with the tabulation or numeric relevance of various kinds of behaviourrelevance of various kinds of behaviour

Oriented towards the quantity of facts, Oriented towards the quantity of facts, what the statistical evidence tells uswhat the statistical evidence tells us

• Laboratory experiments

• Formal methods (e.g. econometrics)

• Numerical methods such as mathematical modeling

Qualitative ResearchQualitative Research

Associated with study of social phenomenaAssociated with study of social phenomena Concerned with understanding the Concerned with understanding the

processes, which underlie various processes, which underlie various behavioural patternsbehavioural patterns

Focuses on quality of the subject under Focuses on quality of the subject under studystudy

Qualitative data sourcesQualitative data sources Observation and participant observation (fieldwork)Observation and participant observation (fieldwork) Interviews and questionnairesInterviews and questionnaires Documents and textsDocuments and texts The researcher’s impressions and reactionsThe researcher’s impressions and reactions

The Language And The The Language And The MethodMethod

e-Reasearch questions should be e-Reasearch questions should be worded in language that is worded in language that is compatible withcompatible with the focus of the studythe focus of the study the research methodthe research method

Qualitative researchQualitative research Quantitative researchQuantitative research

Qualitative ResearchQualitative Research

The research question is often The research question is often presented in the form of a presented in the form of a grand grand tourtour question question

Constructed through the use of Constructed through the use of nondirectional wordingnondirectional wording

Ensures unlimited inquiryEnsures unlimited inquiry discover, explain, explore, describe the discover, explain, explore, describe the

experience, …experience, …

How is social presence established How is social presence established in Web-based learning activities? in Web-based learning activities? (Ethnography)(Ethnography)

Quantitative researchQuantitative research

The research question is often The research question is often presented with a narrow focuspresented with a narrow focus

Use of directive wordingUse of directive wording affect, compare, determine, lead to, cause, affect, compare, determine, lead to, cause,

relate, …relate, …

Does the integration of the Internet Does the integration of the Internet into the highschool curriculum lead to into the highschool curriculum lead to increased self-directed learning skills increased self-directed learning skills when compared with curriculum that when compared with curriculum that does not integrate the Internet?does not integrate the Internet?

Ethics & The e-Ethics & The e-ResearcherResearcher

Necessary to build certain ruleNecessary to build certain rule Virtual wordVirtual word Lack of refereeLack of referee Important item in e-researchImportant item in e-research

How The Net Complicates How The Net Complicates EthicsEthics

Virtual world & too many culture Virtual world & too many culture Chat roomChat room E-ShoppingE-Shopping E-bankingE-banking E-governmentE-government Network security Network security

Privacy, Confidentiality, Privacy, Confidentiality, Autonomy, And The Respect Autonomy, And The Respect

For PersonsFor Persons Limitation for others to reach the Limitation for others to reach the

researchresearch Securing the information for others & Securing the information for others &

for researchers for researchers Important data out of reach of Important data out of reach of

membersmembers Using of privation programUsing of privation program

Obtaining Consent From Obtaining Consent From Online ParticipantOnline Participant

Give consent to gain the trust of Give consent to gain the trust of researcher & other membersresearcher & other members

Research must have identity, Research must have identity, targets, rollstargets, rolls

Obtaining explicit permissionObtaining explicit permission Seeking ways to connect between Seeking ways to connect between

participant participant

Obtaining Consent Obtaining Consent ElectronicallyElectronically

Verify by public keys infrastructure Verify by public keys infrastructure firmsfirms

such as verisign.comsuch as verisign.com

When Is Consent Needed? When Is Consent Needed? The Public Versus Private DilemmaThe Public Versus Private Dilemma

It ‘s not too necessary to get consent It ‘s not too necessary to get consent in public modein public mode

We must obtain satisfaction of We must obtain satisfaction of private researchprivate research

Reducing the potential to harmReducing the potential to harm

Tips For Ethical e-Tips For Ethical e-ResearchResearch

Understand & interpret ethics Understand & interpret ethics principle to developed for offline principle to developed for offline wordword

Make new rules by ethics baseMake new rules by ethics base Research to improve ethic rulesResearch to improve ethic rules Recognize any possible risk before Recognize any possible risk before

during & after research during & after research

The Golden RuleThe Golden Rule

The golden rule: The golden rule:

“ “do unto others as you would have do unto others as you would have them them

unto you”unto you”

Collaborative Collaborative e-Research

Big projectBig project Disbursed & long-time projectDisbursed & long-time project net' strengths for communications & net' strengths for communications &

sharing data to improve the projectsharing data to improve the project peer to peer networks can increase peer to peer networks can increase

& help e-research& help e-research

Collaboration ToolsCollaboration Tools

Communication toolsCommunication tools Data & document toolsData & document tools Application toolsApplication tools Project management tools Project management tools Community management tools Community management tools

Types Of Types Of e-Researche-ResearchCollaborationsCollaborations

So many type & level of process So many type & level of process communities of practice share three communities of practice share three

characteristics characteristics

1. the domain1. the domain

2. the community of the e-researcher2. the community of the e-researcher

3. the practice of the community 3. the practice of the community

Challenges Of e-Challenges Of e-Research CollaborationResearch Collaboration

Time Time Hardware & communications Hardware & communications

bandwidthbandwidth Third word countries & lack of Third word countries & lack of

infrastructure infrastructure A failed example in Canada A failed example in Canada

universities universities

Applications Of Applications Of Collaborative Software e-Collaborative Software e-

ResearchersResearchers Microsoft’s sharepoint team service Microsoft’s sharepoint team service CommunityzeroCommunityzero TimecrackingTimecracking

Methods Of ResearchMethods Of Research

InterviewsInterviews StructuredStructured Semi-structured Semi-structured Unstructured interviewsUnstructured interviews Focus groupsFocus groups

SurveysSurveys ConsensusConsensus

InterviewInterview

Data is gathered through direct Data is gathered through direct communication between individualscommunication between individuals

Structured InterviewsStructured Interviews

Generally referred to as a surveysGenerally referred to as a surveys Same sequenced and preestablished Same sequenced and preestablished

questionsquestions Fixed response categoriesFixed response categories A large carefully selected sampleA large carefully selected sample Data is analyzed numerically using Data is analyzed numerically using

statisticsstatistics GeneralizableGeneralizable

Semi-Structured And Semi-Structured And Unstructured InterviewsUnstructured Interviews

Conducted one-on-oneConducted one-on-one Face-to-face verbal interchangeFace-to-face verbal interchange Increasing opportunity to be Increasing opportunity to be

conducted on the Netconducted on the Net

Unstructured Vs. Semi-Unstructured Vs. Semi-structuredstructured

Unstructured interviews:Unstructured interviews: Undertaken in natural settingsUndertaken in natural settings Small number of loosely defined Small number of loosely defined

questionsquestions No precise orderNo precise order Broad and open-ended questionsBroad and open-ended questions Reflective comment, and follow-up Reflective comment, and follow-up

questionsquestions

Unstructured Vs. Semi-Unstructured Vs. Semi-structured (Cont’d)structured (Cont’d)

Semi-structured interviews:Semi-structured interviews: Preplanned and ordered questionsPreplanned and ordered questions May have follow-up questionsMay have follow-up questions It is both structured and It is both structured and

unstructuredunstructured

More In The BookMore In The Book

Interviewing skillsInterviewing skills Initiating the processInitiating the process Asking the questionsAsking the questions Analyzing the dataAnalyzing the data

Focus GroupsFocus Groups

Used to define research topics and Used to define research topics and questionsquestions

Draws data from a number of people Draws data from a number of people Non-quantitativeNon-quantitative Not indented to reach a consensusNot indented to reach a consensus Quality control mechanismQuality control mechanism

Focus Groups (Cont’d)Focus Groups (Cont’d)

Allows respondents to react and Allows respondents to react and build on responsesbuild on responses

Results not collected in individual Results not collected in individual interviewsinterviews

Results should not be generalizedResults should not be generalized

Why “Focus”?Why “Focus”?

Participants are similar in some wayParticipants are similar in some way Gather data about a single topic or Gather data about a single topic or

narrow a range of topicsnarrow a range of topics

Net-based Vs. Face-to-face Net-based Vs. Face-to-face Focus GroupsFocus Groups

TimeTime ExpensesExpenses Need to involve individuals from Need to involve individuals from

different geographic areasdifferent geographic areas

Net-based Focus GroupsNet-based Focus Groups

SynchronousSynchronous asynchronousasynchronous

Text-basedText-based ICQICQ Email GroupsEmail Groups

Audio-and/or Audio-and/or video basedvideo based NetMeetingNetMeeting CentraCentra

In The BookIn The Book

The processThe process Group sizeGroup size Participant characteristicsParticipant characteristics OrganizationOrganization The moderatorThe moderator Analyzing dataAnalyzing data

Why Consensus?Why Consensus?

Creates useful results on a Creates useful results on a consensus by experts in the fieldconsensus by experts in the field

Arrive at a agreed upon statementArrive at a agreed upon statement Achieving a single best answerAchieving a single best answer Reveal the extent of disagreementReveal the extent of disagreement

Consensus Vs. Focus Consensus Vs. Focus GroupsGroups

In consensus the goal is:In consensus the goal is: Achieving a single best answerAchieving a single best answer Or statically reveal the extent of Or statically reveal the extent of

disagreementdisagreement In Focus groups:In Focus groups:

Qualitative researchQualitative research Open-endedOpen-ended

Consensus TechniquesConsensus Techniques

Delphi methodDelphi method Nominal group techniqueNominal group technique WIKI systemWIKI system

Delphi MethodDelphi Method

Common root with Internet Common root with Internet (ARPANET)(ARPANET)

Participants remain anonymous to Participants remain anonymous to each othereach other

Easily adapted to the NetEasily adapted to the Net

Process Of Delphi Process Of Delphi MethodMethod

Sending letters of invitationSending letters of invitation Questions are providedQuestions are provided Results, together with reasons, are Results, together with reasons, are

analyzed and returnedanalyzed and returned Repeated two to five times until the Repeated two to five times until the

group reaches a consensusgroup reaches a consensus

Nominal Group Nominal Group TechniqueTechnique

Interaction occurs in real timeInteraction occurs in real time Traditionally face-to-faceTraditionally face-to-face

Nominal Group ProcessNominal Group Process

A facilitator introduces the issue, and A facilitator introduces the issue, and a questiona question

Allowing time for participants to write Allowing time for participants to write down individual opinionsdown individual opinions

The facilitator asks each participant in The facilitator asks each participant in turn to provide his or her answerturn to provide his or her answer

No discussion is allowed during this No discussion is allowed during this timetime

Next, they are invited to discussNext, they are invited to discuss

Nominal Group Process Nominal Group Process (Cont’d)(Cont’d)

Followed by one or more rounds of Followed by one or more rounds of individual estimatesindividual estimates

Ends with consensus or an “agree to Ends with consensus or an “agree to disagree”disagree”

Nominal Groups On The Nominal Groups On The NetNet

Text chatText chat Audio or video conferencingAudio or video conferencing Computers can be used to calculate Computers can be used to calculate

and display the degree of consensusand display the degree of consensus

Designed by Ward CunninghamDesigned by Ward Cunningham Native to the NetNative to the Net Allows users to jointly edit HTM Allows users to jointly edit HTM

documentsdocuments Any user can alter the pageAny user can alter the page

WIKI SystemWIKI System

Consensus In WIKI Consensus In WIKI SystemsSystems

The output of the group is a series of The output of the group is a series of documentsdocuments

Consensus is reached when all Consensus is reached when all participants are satisfiedparticipants are satisfied

Net-Based dissemination Net-Based dissemination of of

E-research resultsE-research results

Net-based dissemination of E-Net-based dissemination of E-research resultsresearch results Why it is important?Why it is important? What network tools is best?What network tools is best? Tips for effectively & efficiently Tips for effectively & efficiently

dissemination . dissemination .

Why publish your results?Why publish your results?

Because I have to .Because I have to . Because I want to get ahead .Because I want to get ahead . Because I need to learn from others .Because I need to learn from others . Because I need to clarify my own Because I need to clarify my own

thoughts .thoughts . Because I can be satisfying .Because I can be satisfying .

Creating quality contentCreating quality content

Difference between ways of process Difference between ways of process from the screen & from the text .from the screen & from the text .

Use the techniques of newspaper Use the techniques of newspaper editor , rather than novelists .editor , rather than novelists .

Using the inverted pyramid style of Using the inverted pyramid style of presentation .presentation .

Creating quality contentCreating quality content

For example a site that designed to assist For example a site that designed to assist researchers in publishing their results must ask researchers in publishing their results must ask author the following question :author the following question :

1- who are the intended readers ?1- who are the intended readers ?2- what did you do ?2- what did you do ?3- Why did you do it ?3- Why did you do it ?4- what happened?4- what happened?5- what do the results mean in theory ?5- what do the results mean in theory ?6- what do the results mean in practice ?6- what do the results mean in practice ?7- what is the key benefit for your readers ?7- what is the key benefit for your readers ?8- what remains unresolved ? 8- what remains unresolved ?

Network tools for Network tools for dissemination of E-research dissemination of E-research resultsresults1.1. Peer-reviewed articles .Peer-reviewed articles .

2.2. Popular press .Popular press .

3.3. Email lists of usenet groups .Email lists of usenet groups .

4.4. Virtual conference .Virtual conference .

Dissemination through Dissemination through peer-reviewed articlespeer-reviewed articles First filter : the editor of the selected First filter : the editor of the selected

peer-review journal .peer-review journal . Journal’s editorial review Journal’s editorial review

committee : review the research .committee : review the research .• Usually the reviewers send their publishing Usually the reviewers send their publishing

recommendation and ideas for improvement to recommendation and ideas for improvement to the author and … .the author and … .

Weakness of peer-reviewed Weakness of peer-reviewed articlearticle1.1. It can be very lengthy .It can be very lengthy .

2.2. Being narrow Being narrow (only two to three reviewers see (only two to three reviewers see

the work)the work) . .

3.3. Secretive Secretive (only the editor knows all the actors)(only the editor knows all the actors) . .

4.4. Arbitrary Arbitrary (the editor have a limited number of (the editor have a limited number of reviewers to choose from , none of whom may have the reviewers to choose from , none of whom may have the

necessary knowledge) necessary knowledge) ..

5.5. expensiveexpensive

advantages of peer-advantages of peer-reviewed articlereviewed article Increased accessibility .Increased accessibility . Improved capacity for search and Improved capacity for search and

retrieval .retrieval . Capacity to link to additional content Capacity to link to additional content

including source data .including source data . Capacity to publish whenever the review Capacity to publish whenever the review

is finished , rather than waiting for a is finished , rather than waiting for a publication data .publication data .

Increase speed of distribution .Increase speed of distribution . The ability to insert hyperlinks and The ability to insert hyperlinks and

multimedia into the publication . multimedia into the publication .

Dissemination through the Dissemination through the popular presspopular press It dose not have the academic prestige of It dose not have the academic prestige of

peer-reviewed publication .peer-reviewed publication . The review process is generally faster and The review process is generally faster and

often consist of only proofreading for often consist of only proofreading for grammatical errors by an editor. grammatical errors by an editor.

Your production may get much wider Your production may get much wider distribution .distribution .

You may be paid for your efforts !You may be paid for your efforts !

Dissemination through a Dissemination through a Web siteWeb site Are e-researchers able to Are e-researchers able to

dissemination their own articles via dissemination their own articles via their own site ?their own site ?

Dissemination through Dissemination through email lists or usenet groupsemail lists or usenet groups message must consist of a short message must consist of a short

abstract of result and at least one abstract of result and at least one method for further information .method for further information .

The subject of message must be The subject of message must be short & must grab the attention of short & must grab the attention of potential readers .potential readers .

Dissemination through Dissemination through virtual conferencevirtual conference Availability : anytime ,anyplace or both .Availability : anytime ,anyplace or both . Interactive .Interactive . Structured .Structured . Limited in time .Limited in time . Cost saving .Cost saving . More accessible .More accessible . Self-documenting .Self-documenting . Networked .Networked .

Tips for disseminations Tips for disseminations

Package the ideas in more than one Package the ideas in more than one of the format .of the format .

Post short announcement .Post short announcement . Participate and/or present in a Participate and/or present in a

virtual conferences .virtual conferences .

ReferencesReferences

E-research strategies, methods , E-research strategies, methods , issues issues

terry Anderson, heather kanukaterry Anderson, heather kanuka

www.e-research.cawww.e-research.ca

The endThe end