32
Classical and my Grid approaches to data mining in bioinformatics Peter Li School of Computing Science University of Newcastle upon Tyne

Classical and my Grid approaches to data mining in bioinformatics Peter Li School of Computing Science University of Newcastle upon Tyne

Embed Size (px)

Citation preview

Page 1: Classical and my Grid approaches to data mining in bioinformatics Peter Li School of Computing Science University of Newcastle upon Tyne

Classical and myGrid approaches to data mining in bioinformatics

Peter Li

School of Computing ScienceUniversity of Newcastle upon Tyne

Page 2: Classical and my Grid approaches to data mining in bioinformatics Peter Li School of Computing Science University of Newcastle upon Tyne

Outline

• Real life bioinformatics use cases– Graves’ disease– Williams-Beuren syndrome

• Classical approach to bioinformatics data analysis

• Bioinformatics workflows• Using myGrid workflows for data analysis• Issues for further work

Page 3: Classical and my Grid approaches to data mining in bioinformatics Peter Li School of Computing Science University of Newcastle upon Tyne

Application scenario1

Graves’ disease• Simon Pearce and Claire Jennings, Institute of

Human Genetics School of Clinical Medical Sciences, University of Newcastle

Page 4: Classical and my Grid approaches to data mining in bioinformatics Peter Li School of Computing Science University of Newcastle upon Tyne

Graves’ disease

• Autoimmune thyroid disease

• Lymphocytes attack thyroid gland cells causing hyperthyroidism

• An inherited disorder• Complex genetic basis• Symptoms:

– Increased pulse rate, sweating, heat intolerance

– goitre, exophthalmos

Page 5: Classical and my Grid approaches to data mining in bioinformatics Peter Li School of Computing Science University of Newcastle upon Tyne

In silico experiments in Graves’ disease

• Identification of genes:– Microarray data analysis– Gene annotation pipeline– Design of genotype assays

for SNP variations in genes• Distributed bioinformatics

services from Japan, Hong Kong, various sites in UK

• Different data types: textual, image, gene expression, etc.

Page 6: Classical and my Grid approaches to data mining in bioinformatics Peter Li School of Computing Science University of Newcastle upon Tyne

Classical approach to the bioinformatics of Graves’ diseaseData Analysis - Microarray

Import microarray data to Affymetrix data mining tool, run analyses and select gene

Experiment design to test hypotheses Find restriction sites and design primers by eye for genotyping experiments

Study annotations for many different genesUsing web html based resources

Select gene and visually examine SNPS lying within gene

Page 7: Classical and my Grid approaches to data mining in bioinformatics Peter Li School of Computing Science University of Newcastle upon Tyne

Application scenario2

Williams-Beuren Syndrome• Hannah Tipney, May Tassabehji, St Mary’s

Hospital, Manchester, UK• Gene prediction; gene and protein annotation • Services from USA, Japan, various sites in UK

Page 8: Classical and my Grid approaches to data mining in bioinformatics Peter Li School of Computing Science University of Newcastle upon Tyne

Williams-Beuren Syndrome (WBS)

• Contiguous sporadic gene deletion disorder

• 1/20,000 live births, caused by unequal crossover (homologous recombination) during meiosis

• Haploinsufficiency of the region results in the phenotype

• Multisystem phenotype – muscular, nervous, circulatory systems

• Characteristic facial features• Unique cognitive profile• Mental retardation (IQ 40-100,

mean~60, ‘normal’ mean ~ 100 )• Outgoing personality, friendly nature,

‘charming’

Page 9: Classical and my Grid approaches to data mining in bioinformatics Peter Li School of Computing Science University of Newcastle upon Tyne

Williams-Beuren Syndrome Microdeletion

Chr 7 ~155 Mb

~1.5 Mb7q11.23

GT

F2I

RF

C2

CY

LN

2

GT

F2I

RD

1

NC

F1

WB

SC

R1/

E1f

4H

LIM

K1

EL

N

CL

DN

4

CL

DN

3

ST

X1A

WB

SC

R18

WB

SC

R21

TB

L2

BC

L7B

BA

Z1B

FZ

D9

WB

SC

R5/

LA

B

WB

SC

R22

FK

BP

6

PO

M12

1

NO

LR

1

GT

F2I

RD

2

C-c

en

C-m

id

A-c

en

B-m

id

B-c

en

A-m

id

B-t

el

A-t

el

C-t

el

WB

SC

R14

ST

AG

3P

MS

2L

Block A

FK

BP

6T

PO

M12

1N

OL

R1

Block C

GT

F2I

PN

CF

1PG

TF

2IR

D2P

Block B

**

WBS

SVAS

Patient deletions

CTA-315H11

CTB-51J22

‘Gap’

Physical Map

Eicher E, Clark R & She, X An Assessment of the Sequence Gaps: Unfinished Business in a Finished Human Genome. Nature Genetics Reviews (2004) 5:345-354Hillier L et al. The DNA Sequence of Human Chromosome 7. Nature (2003) 424:157-164

Page 10: Classical and my Grid approaches to data mining in bioinformatics Peter Li School of Computing Science University of Newcastle upon Tyne

Filling a genomic gap in Silico

12181 acatttctac caacagtgga tgaggttgtt ggtctatgtt ctcaccaaat ttggtgttgt 12241 cagtctttta aattttaacc tttagagaag agtcatacag tcaatagcct tttttagctt 12301 gaccatccta atagatacac agtggtgtct cactgtgatt ttaatttgca ttttcctgct 12361 gactaattat gttgagcttg ttaccattta gacaacttca ttagagaagt gtctaatatt 12421 taggtgactt gcctgttttt ttttaattgg gatcttaatt tttttaaatt attgatttgt 12481 aggagctatt tatatattct ggatacaagt tctttatcag atacacagtt tgtgactatt 12541 ttcttataag tctgtggttt ttatattaat gtttttattg atgactgttt tttacaattg 12601 tggttaagta tacatgacat aaaacggatt atcttaacca ttttaaaatg taaaattcga 12661 tggcattaag tacatccaca atattgtgca actatcacca ctatcatact ccaaaagggc 12721 atccaatacc cattaagctg tcactcccca atctcccatt ttcccacccc tgacaatcaa 12781 taacccattt tctgtctcta tggatttgcc tgttctggat attcatatta atagaatcaa

1. Identify new, overlapping sequences of interest2. Characterise the new sequences at nucleotide and amino acid

level

Cutting and pasting between numerous web-based services i.e. BLAST, InterProScan etc

Page 11: Classical and my Grid approaches to data mining in bioinformatics Peter Li School of Computing Science University of Newcastle upon Tyne

Classical approach

• Frequently repeated - info rapidly added to public databases• Time consuming and mundane• Don’t always get results• Huge amount of interrelated data is produced – handled in

notebooks and files saved to local hard drive• Much knowledge remains undocumented: Bioinformatician does the analysis

Advantages: Specialist human intervention at every step, quick and easy accessto distributed services

Disadvantages: Labour intensive, time consuming, highly repetitive and error proneprocess, tacit procedure so difficult to share both protocol and results

Page 12: Classical and my Grid approaches to data mining in bioinformatics Peter Li School of Computing Science University of Newcastle upon Tyne

In silico experiments in bioinformatics

Bioinformatics analyses - in silico experiments - workflows

EMBL

BLAST

Clustal-W

Genscan

Resources/Services

Example workflow: Investigate the evolutionary relationships between proteins

Clustal-W

Proteinsequences

Multiplesequencealignment

Query

Page 13: Classical and my Grid approaches to data mining in bioinformatics Peter Li School of Computing Science University of Newcastle upon Tyne

Why workflows and services?

Workflow = general technique for describing and enacting a processWorkflow = describes what you want to do, not how you want to do itWeb Service = how you want to do itWeb Service = automated programmatic internet access to applications

• Automation– Capturing processes in an explicit manner– Tedium! Computers don’t get bored/distracted/hungry/impatient!– Saves repeated time and effort

• Modification, maintenance, substitution and personalisation • Easy to share, explain, relocate, reuse and build• Available to wider audience: don’t need to be a coder, just need to know

how to do Bioinformatics • Releases Scientists/Bioinformaticians to do other work• Record

– Provenance: what the data is like, where it came from, its quality– Management of data (LSID - Life Science IDentifiers)

Page 14: Classical and my Grid approaches to data mining in bioinformatics Peter Li School of Computing Science University of Newcastle upon Tyne

myGrid

• EPSRC e-Science pilot research project• Manchester, Newcastle, Sheffield, Southampton, Nottingham, EBI

and industrial partners.• ‘Targeted to develop open source software to support personalised

in silico experiments in biology on a Grid.’

Which means enabling scientists to….

Distributed computing – machines, tools, databanks, people

Provenance and data management

Workflow enactment and notification

A virtual lab ‘workbench’, a toolkit which serves life science communities.

Page 15: Classical and my Grid approaches to data mining in bioinformatics Peter Li School of Computing Science University of Newcastle upon Tyne

Workflow components

Scufl Simple Conceptual Unified Flow LanguageTaverna Writing, running workflows & examining resultsSOAPLAB Makes applications available

Freefluo Workflow engine to run workflows

Freefluo

SOAPLABWeb Service

Any Application

Web Service e.g. DDBJ BLAST

Page 16: Classical and my Grid approaches to data mining in bioinformatics Peter Li School of Computing Science University of Newcastle upon Tyne

The workflow experience

• Correct and biologically meaningful results• Automation

– Saved time, increased productivity– But you still require humans!

• Sharing– Other people have used and want to develop the workflows

• Change of work practises– Post hoc analysis. Don’t analyse data piece by piece receive

all data all at once– Data stored and collected in a more standardised manner– Results management

Have workflows delivered on their promise? YES!

Page 17: Classical and my Grid approaches to data mining in bioinformatics Peter Li School of Computing Science University of Newcastle upon Tyne

The workflow experience

• Activation Energy versus Reusability trade-off– Lack of ‘available’ services, levels of redundancy can be

limited – But once available can be reused for the greater good of the

community

• Instability of external bioinformatics web services– Research level– Reliant on other peoples servers– Taverna can retry or substitute before graceful failure

• Need Shim services in workflows

Page 18: Classical and my Grid approaches to data mining in bioinformatics Peter Li School of Computing Science University of Newcastle upon Tyne

Modelling in silico experiments as workflows requires Shims

• Unrecorded ‘steps’ which aren’t realised until attempting to build something

• Enable services to fit together

• Semantic, syntactic and format typing of data in workflow

• Data has to be filtered, transformed, parsed for consumption by services

Annotation Pipeline

GO MEDLINE KEGG SwissProt InterPro PDB Blast HGBASE

Query

Page 19: Classical and my Grid approaches to data mining in bioinformatics Peter Li School of Computing Science University of Newcastle upon Tyne

Shims

Sequencei.e. last known 3000bp

Mask BLASTIdentify new sequences and determine their degree of identity

Sequence database entryFasta format sequenceGenbank format sequence

Alignment of full query sequence V full ‘new’ sequence

Old BLAST result

Simplify and Compare

Lister

Retrieve

BLAST2

‘I want to identify new sequences which overlap with my query sequence and determine if they are useful’

Page 20: Classical and my Grid approaches to data mining in bioinformatics Peter Li School of Computing Science University of Newcastle upon Tyne

Biological results from WB syndrome

CTA-315H11 CTB-51J22

EL

N

WB

SC

R14

RP11-622P13 RP11-148M21 RP11-731K22

314,004bp extension

All nine known genes identified(40/45 exons identified)

CL

DN

4

CL

DN

3

ST

X1A

WB

SC

R18

WB

SC

R21

WB

SC

R22

WB

SC

R24

WB

SC

R27

WB

SC

R28

Four workflow cycles totalling ~ 10 hoursThe gap was correctly closed and all known features identified

Page 21: Classical and my Grid approaches to data mining in bioinformatics Peter Li School of Computing Science University of Newcastle upon Tyne

GD results: Differential expression and variations of the I kappa B-epsilon gene

Mean NFKBIE expression levels -

• Controls: 1.60 +/- 0.11 (SEM)

• GD: 2.22 +/- 0.20 (SEM)

• P=0.0047 (T-test)

n=303’ UTR SNP – 3948 C/A

- Mnl restriction site- χ2 = 9.1, p = 0.0025, Odds Ratio = 1.4

Page 22: Classical and my Grid approaches to data mining in bioinformatics Peter Li School of Computing Science University of Newcastle upon Tyne

Conclusions

• It works – a new tool has been developed which is being utilised by biologists

• More regularly undertaken, less mundane, less error prone

• More systematic collection and analysis of results• Increased productivity• Services: only as good as the individual services, lots

of them, we don’t own them, many are unique and at a single site, research level software, reliant on other peoples services

• Activation energy

Page 23: Classical and my Grid approaches to data mining in bioinformatics Peter Li School of Computing Science University of Newcastle upon Tyne

Issues and future directions1

• Transfer of large data sets between services (microarray data)– Passing data by value breaks Web services– Streaming (Inferno)– Pass by reference and use third party data

transfer (GridFTP, LSID)

Page 24: Classical and my Grid approaches to data mining in bioinformatics Peter Li School of Computing Science University of Newcastle upon Tyne

Issues and future directions2

• Data visualisation– How to visualise results mined from data

using workflows?

Page 25: Classical and my Grid approaches to data mining in bioinformatics Peter Li School of Computing Science University of Newcastle upon Tyne

Workflow results

• Large amounts of information (or datatypes)

• Results are implicitly linked within itself

• Results are implicitly linked outside of itself

• Genomic sequence is central co-ordinating point, but there are a number of different co-ordinate systems

• Need holistic view

Page 26: Classical and my Grid approaches to data mining in bioinformatics Peter Li School of Computing Science University of Newcastle upon Tyne

What’s the problem?

• No domain model in myGrid

• We need a model for visualisation

• But domain models are hard

• It’s not clear that the domain model should be in the middleware

Page 27: Classical and my Grid approaches to data mining in bioinformatics Peter Li School of Computing Science University of Newcastle upon Tyne

What have we done!?

• Bioinformatics PM (pre myGrid)

• One big distributed data heterogeneity and integration problem

Page 28: Classical and my Grid approaches to data mining in bioinformatics Peter Li School of Computing Science University of Newcastle upon Tyne

What have we done!?

• Bioinformatics PM (post myGrid)

• One big data heterogeneity and integration problem

Page 29: Classical and my Grid approaches to data mining in bioinformatics Peter Li School of Computing Science University of Newcastle upon Tyne

Initial Solutions

• Take the data

• Use something (Perl script or an MSc student) to map the data into a (partial) data model

• Visualise results which are linked via HTML pages

Page 30: Classical and my Grid approaches to data mining in bioinformatics Peter Li School of Computing Science University of Newcastle upon Tyne

A second solution

• Start to build visualisation information into the workflow, using beanshell scripts.

• http://www.mrl.nott.ac.uk/~sre/workflowblatest

• But what if we change the workflow?

Page 31: Classical and my Grid approaches to data mining in bioinformatics Peter Li School of Computing Science University of Newcastle upon Tyne

Summary

• Domain models are hard

• Workflows can obfuscate the model

• Visualisation requires one

• We can build some knowledge of a domain model into the workflow

• Is there a better way?

Page 32: Classical and my Grid approaches to data mining in bioinformatics Peter Li School of Computing Science University of Newcastle upon Tyne

CoreMatthew Addis, Nedim Alpdemir, Neil Davis, Alvaro Fernandes, Justin Ferris,

Robert Gaizaukaus, Kevin Glover, Carole Goble, Chris Greenhalgh, Mark Greenwood, Yikun Guo, Ananth Krishna, Peter Li, Phillip Lord, Darren Marvin, Simon Miles, Luc Moreau, Arijit Mukherjee, Tom Oinn, Juri Papay, Savas Parastatidis, Norman Paton, Terry Payne, Matthew Pocock Milena Radenkovic, Stefan Rennick-Egglestone, Peter Rice, Martin Senger, Nick Sharman, Robert Stevens, Victor Tan, Anil Wipat, Paul Watson and Chris Wroe.

UsersSimon Pearce and Claire Jennings, Institute of Human Genetics School of Clinical

Medical Sciences, University of Newcastle, UKHannah Tipney, May Tassabehji, Andy Brass, St Mary’s Hospital, Manchester,

UK

PostgraduatesMartin Szomszor, Duncan Hull, Jun Zhao, Pinar Alper, John Dickman, Keith

Flanagan, Antoon Goderis, Tracy Craddock, Alastair Hampshire

Acknowledgements