Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
156 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Learning Alternative Ways of Performing a Task (2404.02579v1)

Published 3 Apr 2024 in cs.AI

Abstract: A common way of learning to perform a task is to observe how it is carried out by experts. However, it is well known that for most tasks there is no unique way to perform them. This is especially noticeable the more complex the task is because factors such as the skill or the know-how of the expert may well affect the way she solves the task. In addition, learning from experts also suffers of having a small set of training examples generally coming from several experts (since experts are usually a limited and expensive resource), being all of them positive examples (i.e. examples that represent successful executions of the task). Traditional machine learning techniques are not useful in such scenarios, as they require extensive training data. Starting from very few executions of the task presented as activity sequences, we introduce a novel inductive approach for learning multiple models, with each one representing an alternative strategy of performing a task. By an iterative process based on generalisation and specialisation, we learn the underlying patterns that capture the different styles of performing a task exhibited by the examples. We illustrate our approach on two common activity recognition tasks: a surgical skills training task and a cooking domain. We evaluate the inferred models with respect to two metrics that measure how well the models represent the examples and capture the different forms of executing a task showed by the examples. We compare our results with the traditional process mining approach and show that a small set of meaningful examples is enough to obtain patterns that capture the different strategies that are followed to solve the tasks.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (71)
  1. Workflow management: models, methods, and systems. MIT press.
  2. van der Aalst, W. M. (2016). Process mining: data science in action. Springer.
  3. Rapidprom: mine your processes and not just your data. arXiv preprint arXiv:1703.03740, .
  4. Business process mining: An industrial application. Information Systems, 32, 713–732.
  5. Declarative bias for specific-to-general ilp systems. Machine Learning, 20, 119–154.
  6. Mining process models from workflow logs. In International Conference on Extending Database Technology (pp. 467–483). Springer.
  7. A dataset and benchmarks for segmentation and recognition of gestures in robotic surgery. IEEE Transactions on Biomedical Engineering, 64, 2025–2041.
  8. Action understanding as inverse planning. Cognition, 113, 329–349.
  9. Workflow mining for visualization and analysis of surgeries. International journal of computer assisted radiology and surgery, 3, 379–386.
  10. A decision-theoretic approach to task assistance for persons with dementia. In IJCAI (pp. 1293–1299). Citeseer.
  11. A smart home agent for plan recognition of cognitively-impaired patients. JCP, 1, 53–62.
  12. On the role of fitness, precision, generalization and simplicity in process discovery. In OTM Confederated International Conferences" On the Move to Meaningful Internet Systems" (pp. 305–322). Springer.
  13. An ontology-based approach to conflict resolution in home and building automation systems. Expert Systems with Applications, 41, 6161–6173.
  14. Task and motion analyses in endoscopic surgery. In Proceedings ASME Dynamic Systems and Control Division (pp. 583–590). Citeseer.
  15. Models and methods in social network analysis volume 28. Cambridge university press.
  16. Caruana, R. (1997). Multitask learning. Machine learning, 28, 41–75.
  17. Sensor-based activity recognition. IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews), 42, 790–808.
  18. A logical framework for behaviour reasoning and assistance in a smart home. International Journal of Assistive Robotics and Mechatronics, 9, 20–34.
  19. A knowledge-driven approach to activity recognition in smart homes. IEEE Transactions on Knowledge and Data Engineering, 24, 961–974.
  20. Cross-position activity recognition with stratified transfer learning. Pervasive and Mobile Computing, 57, 1–13.
  21. Formalizing workflows using the event calculus. In International Conference on Database and Expert Systems Applications (pp. 222–231). Springer.
  22. Transfer learning for activity recognition: A survey. Knowledge and information systems, 36, 537–556.
  23. Tracking systems for multiple smart home residents. Human Behavior Recognition Technologies: Intelligent Applications for Monitoring and Security, (pp. 111–129).
  24. Group interaction analysis in dynamic context. IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 38, 275–282.
  25. Empirical study and improvement on deep transfer learning for human activity recognition. Sensors, 19, 57.
  26. One-shot imitation learning. In Advances in neural information processing systems (pp. 1087–1098).
  27. Efficient duration and hierarchical modeling for human activity recognition. Artificial intelligence, 173, 830–856.
  28. Ericsson, K. A. (2009). Development of professional expertise: Toward measurement of expert performance and design of optimal learning environments. Cambridge University Press.
  29. One-shot visual imitation learning via meta-learning. In Conference on Robot Learning (pp. 357–368).
  30. Fürnkranz, J. (1999). Separate-and-conquer rule learning. Artificial Intelligence Review, 13, 3–54.
  31. Jhu-isi gesture and skill assessment working set (jigsaws): A surgical activity dataset for human motion modeling. In MICCAI Workshop: M2CAI (p. 3). volume 3.
  32. Interestingness measures for data mining: A survey. ACM Computing Surveys (CSUR), 38, 9.
  33. Fuzzy mining–adaptive process simplification based on multi-perspective metrics. In International conference on business process management (pp. 328–343). Springer.
  34. Automated handwashing assistance for persons with dementia using video and a partially observable markov decision process. Computer Vision and Image Understanding, 114, 503–519.
  35. Context-aware systems: A literature review and classification. Expert Systems with applications, 36, 8509–8522.
  36. Imitation learning: A survey of learning methods. ACM Computing Surveys (CSUR), 50, 21.
  37. Using a live-in laboratory for ubiquitous computing research. In International Conference on Pervasive Computing (pp. 349–365). Springer.
  38. Detection of daily living activities using a two-stage markov model. Journal of Ambient Intelligence and Smart Environments, 5, 273–285.
  39. Svas: Surveillance video analysis system. Expert Systems with Applications, 89, 343–361.
  40. Human activity recognition from wireless sensor network data: Benchmark and software. In Activity recognition in pervasive intelligent environments (pp. 165–186). Springer.
  41. Care: Context awareness in residences for elderly. In International Conference of the International Society for Gerontechnology, Pisa, Tuscany, Italy (pp. 101–105).
  42. Computational state space models for activity and intention recognition. a feasibility study. PLoS One, 9.
  43. Action2activity: recognizing complex activities from sensor data. In Twenty-fourth international joint conference on artificial intelligence.
  44. Application of process mining in healthcare–a case study in a dutch hospital. In International joint conference on biomedical engineering systems and technologies (pp. 425–438). Springer.
  45. Process mining: Extending the alpha-algorithm to mine short loops. University of Technology, Eindhoven, 113, 145–180.
  46. Mueller, E. T. (2014). Commonsense reasoning: an event calculus based approach. Morgan Kaufmann.
  47. “kognichef”: A cognitive cooking assistant. KI-Künstliche Intelligenz, 31, 273–281.
  48. Probabilistic plan recognition for proactive assistant agents. Plan, activity, and intent recognition. Elsevier, Amsterdam, The Netherlands, 10, 23.
  49. Ontology-based learning framework for activity assistance in an adaptive smart home. In Activity Recognition in Pervasive Intelligent Environments (pp. 237–263). Springer.
  50. Web graph similarity for anomaly detection. Journal of Internet Services and Applications, 1, 19–30.
  51. Fine-grained activity recognition by aggregating abstract object usage. In Wearable Computers, 2005. Proceedings. Ninth IEEE International Symposium on (pp. 44–51). IEEE.
  52. Aroma: A deep multi-task learning based simple and complex human activity recognition method using wearable sensors. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 2, 1–16.
  53. Raedt, L. D. (2010). Logic of generality. Encyclopedia of machine learning, (pp. 624–631).
  54. A database for fine grained activity detection of cooking activities. In Computer Vision and Pattern Recognition (CVPR), 2012 IEEE Conference on (pp. 1194–1201). IEEE.
  55. Task decomposition of laparoscopic surgery for objective evaluation of surgical residents’ learning curve using hidden markov model. Computer Aided Surgery, 7, 49–61.
  56. Location-based reasoning about complex multi-agent behavior. Journal of Artificial Intelligence Research, 43, 87–133.
  57. Activity recognition for the smart hospital. IEEE intelligent systems, 23.
  58. Evolving cloud-based system for the recognition of drivers’ actions. Expert Systems with Applications, 99, 231–238.
  59. Temporal segmentation and activity classification from first-person sensing. In 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (pp. 17–24). IEEE.
  60. Combining embedded accelerometers with computer vision for recognizing food preparation activities. In Proceedings of the 2013 ACM international joint conference on Pervasive and ubiquitous computing (pp. 729–738). ACM.
  61. Plan, activity, and intent recognition: Theory and practice. Newnes.
  62. Large-scale personalized human activity recognition using online multitask learning. IEEE Transactions on Knowledge and Data Engineering, 25, 2551–2563.
  63. The sphere challenge. arXiv preprint arXiv:1603.00797, .
  64. Transferring knowledge of activity recognition across sensor networks. In International Conference on Pervasive Computing (pp. 283–300). Springer.
  65. A threefold dataset for activity and workflow recognition in complex industrial environments. IEEE MultiMedia, (pp. 42–52).
  66. Minimum message length and kolmogorov complexity. The Computer Journal, 42, 270–283.
  67. Neural task programming: Learning to generalize across hierarchical tasks. In 2018 IEEE International Conference on Robotics and Automation (ICRA) (pp. 1–8). IEEE.
  68. Mining closed relational graphs with connectivity constraints. In Proceedings of the eleventh ACM SIGKDD international conference on Knowledge discovery in data mining (pp. 324–333). ACM.
  69. Medical workflow modeling using alignment-guided state-splitting hmm. In Healthcare Informatics (ICHI), 2017 IEEE International Conference on (pp. 144–153). IEEE.
  70. Usmart: An unsupervised semantic mining activity recognition technique. ACM Transactions on Interactive Intelligent Systems (TiiS), 4, 16.
  71. What’s cooking and why? behaviour recognition during unscripted cooking tasks for health monitoring. In Pervasive Computing and Communications Workshops (PerCom Workshops), 2017 IEEE International Conference on (pp. 18–21). IEEE.
Citations (2)

Summary

We haven't generated a summary for this paper yet.