14
Validation of a class allocation method for wheelchair track athletes with impaired strength – a proof of concept study Mark Connick, Emma Beckman, Sean Tweedy The University of Queensland, Brisbane, Australia Photo by Simon Bruty

Mark Connick, Emma Beckman, Sean Tweedy The University of

  • Upload
    others

  • View
    1

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Mark Connick, Emma Beckman, Sean Tweedy The University of

Validationofaclassallocationmethodforwheelchairtrackathleteswithimpairedstrength– aproofofconceptstudy

MarkConnick,EmmaBeckman,SeanTweedy

TheUniversityofQueensland,Brisbane,AustraliaPhotobySimonBruty

Page 2: Mark Connick, Emma Beckman, Sean Tweedy The University of

Von Winterfeldt (2013). Proc. Natl. Acad. Sci. U.S.A. 2013 Aug 20; 110(Suppl 3): 14055–14061

EVIDENCE‐BASEDDECISIONMAKING

• Similaritieswithevidence‐basedmedicine?

• Centraltenets?

• Howshouldweproceed?

Page 3: Mark Connick, Emma Beckman, Sean Tweedy The University of

SCIENTIFICBASIS?

DECISION‐MAKINGINTHECURRENTSYSTEM

BASEDONCLINICALREASONING

Page 4: Mark Connick, Emma Beckman, Sean Tweedy The University of

Performance

EVIDENCE‐BASEDSYSTEM

TRANSPARENT,VALIDATEDDECISIONS

Page 5: Mark Connick, Emma Beckman, Sean Tweedy The University of

IDENTIFICATIONOFIMPAIRMENTTESTS

Isometricstrengthmeasure

PerformanceOutcome

Top‐Speed(0‐15m)correlation

Top‐Speed(Absolute)correlation

StrongestForearmPronation 0.70* 0.79*WeakestForearmPronation 0.70* 0.79*StrongestArmExtension 0.83* 0.88*WeakestArmExtension 0.81* 0.87*

IsolatedTrunk 0.54* 0.61*Arm+Trunk 0.73* 0.78*

• 32International‐levelwheelchairtrackracers

• ClassesT54‐T51

• Sixisometricstrengthtests

Connick,M.J.,Beckman,E.,Vanlandewijck,Y.,Malone,L.,Blomqvist,S.andTweedy,S.(Underreview).Novelisometricstrength measuresproduceavalidandevidence‐basedclassificationstructureforwheelchairtrackracing:Aclusteranalysis.BritishJournalofSportsMedicine

Page 6: Mark Connick, Emma Beckman, Sean Tweedy The University of

• 4clusters• Differencesfoundinthe6strengthtestsand2performance‐relatedoutcomes

IDENTIFICATIONOFACLASSSTRUCTURE

Page 7: Mark Connick, Emma Beckman, Sean Tweedy The University of

AIM

Toevaluatethevalidityofstatisticalrecommendersystemsforallocatingclassinwheelchairtrackracingathletes.

Page 8: Mark Connick, Emma Beckman, Sean Tweedy The University of

• K-nearest neighbour• Discriminant analysis• Artificial Neural Network• Naïve Bayes• Classification Decision Tree

METHODS

Original Data

Sampling n = 1200 (Gaussian Copula)

Cluster analysis (k = 4)

Evaluate recommender

systems (10-fold cross validation)

Recommender system

Final Prediction

Page 9: Mark Connick, Emma Beckman, Sean Tweedy The University of

RESULTS

Page 10: Mark Connick, Emma Beckman, Sean Tweedy The University of

RESULTS

0

2

4

6

8

10

12

14

16

18

k‐nearestneighbour

discriminantanalysis

artificialneuralnetwork

classificationtree

naïvebayes

Error(%

)

Classificationmethod

Page 11: Mark Connick, Emma Beckman, Sean Tweedy The University of

METHOD

Original Data

Recommender1

Sampling n = 1200

(Gaussian Copula)

Cluster analysis (k = 4)

Evaluate recommender

systems

Recommender2

•••

Majority vote Final predictions

Recommender Final Prediction

Recommender3

Page 12: Mark Connick, Emma Beckman, Sean Tweedy The University of

0

1

2

3

4

5

6

7

8

9

k‐nearestneighbour

discriminantanalysis

artificialneuralnetwork

ensemble

Error(%

)

Classificationmethod

RESULTS

Page 13: Mark Connick, Emma Beckman, Sean Tweedy The University of

• Inthispopulation,statisticalrecommendersystemsprovidevalidtoolsthatclassifierscanusetoallocateclass

• However,thiswasproof‐of‐conceptandphilosophicaldiscussionsareneeded– Potentialtranslationofthesemethods

• Preciseparametersmustbecalculatedinalarge‐scalestudy(i.e.testcloseto100%ofthepopulation)

• Influenceoftrainingandintentionalmisrepresentation• Remember,retainexpertopinionandathletecontext

DISCUSSION

Page 14: Mark Connick, Emma Beckman, Sean Tweedy The University of

THANKYOU

Acknowledgments:

• InternationalParalympicCommittee• TheZayhed HigherOrganisation forHumanitarianCareandSpecialNeeds• Ergotest• Theathletes

• SeanTweedy,MarkConnickandEmmaBeckmanaremembersoftheIPCClassificationResearchandDevelopmentCentre(PhysicalImpairments),whichissupportedbytheInternationalParalympicCommittee.