21
ml.lib: Robust, Cross-platform, Open-source Machine Learning for Max and Pure Data Jamie Bullock sociate Professor of Music Technology Birmingham City University Ali Momeni Associate Professor of Art Carnegie Mellon University

Nime 2015 slides 02 ali 2

Embed Size (px)

Citation preview

  1. 1. ml.lib: Robust, Cross-platform, Open-source Machine Learning for Max and Pure Data Jamie Bullock Associate Professor of Music Technology Birmingham City University Ali Momeni Associate Professor of Art Carnegie Mellon University
  2. 2. Cont, A. (2008). Antescofo: Anticipatory Synchronization and Control of Interactive Parameters in Computer Music (pp. 33 40). Presented at the International Computer Music Conference, Belfast, Ireland: Ann Arbor, MI: Scholarly Publishing Office, University of Michigan Library.
  3. 3. Deyle, T., Palinko, S., & Poole, E. S. (2007). Hambone: A bio-acoustic gesture interface. Computers. http://doi.org/10.1109/ISWC.2007.4373768
  4. 4. Sato, M., Poupyrev, I., & Harrison, C. (2012). Touch: enhancing touch interaction on humans, screens, liquids, and everyday objects. Chi, 483492. http://doi.org/10.1145/2207676.2207743
  5. 5. Ono, M., Shizuki, B., & Tanaka, J. (2013). Touch & activate (pp. 3140). Presented at the the 26th annual ACM symposium, New York, New York, USA: ACM Press. http://doi.org/10.1145/2501988.2501989
  6. 6. Poupyrev, Ivan, et al. "Botanicus Interacticus: interactive plants technology." ACM SIGGRAPH 2012 Emerging Technologies. ACM, 2012.
  7. 7. Nielsen,Usability Engineering (1993)
  8. 8. . Raskin, The Humane Interface (2000) : user actions should have the same effect regardless of the appl
  9. 9. add train map 3 .1 .4 .1 .5 .9 .2 .6 .1 .4 .1 .5 .9 .2 .6 3
  10. 10. record Manually segment time-varying input vectors
  11. 11. Dlib mlpack Shark Efficient Wide range of algorithms Well supported Good documentation GRT libsvm + others
  12. 12. GRT + FLEXT = ml.lib + UCD
  13. 13. Classification Adaptive Boosting Adaptive Naive Bayes Bootstrap Aggregator Decision Trees Dynamic Time Warping Finite State Machine Gaussian Mixture Model Hidden Markov Model k-Nearest Neighbour Linear Discriminant Analysis Minimum Distance Particle Classifier Random Forests Support Vector Machines Regression Artificial Neural Network Linear Regression Logistic Regression Multidimensional Regression Regression Tree Feature Extraction Peak Detection Min / Max Zero Crossings
  14. 14. Architecture
  15. 15. Common Attributes probs scaling Object-specific Attributes randomize_training_order mode num_outputs
  16. 16. Live Demo
  17. 17. Phone Orientation Sensing
  18. 18. Phone Gesture Mapping
  19. 19. Swept Frequency Sensing
  20. 20. Future Work Documentation!!! Sort out HMMs Implement GRT clustering algorithms Possible threaded train Maybe more feature extraction, LibXtract?
  21. 21. Thank You!