Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
169 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Simulation-aided Learning from Demonstration for Robotic LEGO Construction (2309.11010v2)

Published 20 Sep 2023 in cs.RO

Abstract: Recent advancements in manufacturing have a growing demand for fast, automatic prototyping (i.e. assembly and disassembly) capabilities to meet users' needs. This paper studies automatic rapid LEGO prototyping, which is devoted to constructing target LEGO objects that satisfy individual customization needs and allow users to freely construct their novel designs. A construction plan is needed in order to automatically construct the user-specified LEGO design. However, a freely designed LEGO object might not have an existing construction plan, and generating such a LEGO construction plan requires a non-trivial effort since it requires accounting for numerous constraints (e.g. object shape, colors, stability, etc.). In addition, programming the prototyping skill for the robot requires the users to have expert programming skills, which makes the task beyond the reach of the general public. To address the challenges, this paper presents a simulation-aided learning from demonstration (SaLfD) framework for easily deploying LEGO prototyping capability to robots. In particular, the user demonstrates constructing the customized novel LEGO object. The robot extracts the task information by observing the human operation and generates the construction plan. A simulation is developed to verify the correctness of the learned construction plan and the resulting LEGO prototype. The proposed system is deployed to a FANUC LR-mate 200id/7L robot. Experiments demonstrate that the proposed SaLfD framework can effectively correct and learn the prototyping (i.e. assembly and disassembly) tasks from human demonstrations. And the learned prototyping tasks are realized by the FANUC robot.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (38)
  1. “Virtual reality for assembly methods prototyping: A review”. Virtual Real., 15(1), mar, p. 5–20.
  2. “Rapid prototyping for assembly training and validation”. IFAC-PapersOnLine, 48(3), pp. 412–417. 15th IFAC Symposium onInformation Control Problems inManufacturing.
  3. “Virtual reality as a tool for verification of assembly and maintenance processes”. Computers & Graphics, 23(3), pp. 389–403.
  4. “Design and automated assembly of planetary lego brick for lunar in-situ construction”. Automation in Construction, 118, p. 103282.
  5. “A lightweight and transferable design for robust lego manipulation”. arXiv preprint arXiv:2309.02354.
  6. “Survey on automated lego assembly construction”.
  7. “Lego: Automated model construction”.
  8. “Automated brick sculpture construction”. PhD thesis, Stellenbosch: Stellenbosch University.
  9. “Solving lego brick layout problem using evolutionary algorithms”. In Proceedings to Norwegian Conference on Computer Science, Citeseer.
  10. “Using assembly representations to enable evolutionary design of lego structures”. Ai Edam, 17(2), pp. 155–168.
  11. “Lego builder: Automatic generation of lego assembly manual from 3d polygon model”. ITE Transactions on Media Technology and Applications, 1, 10, pp. 354–360.
  12. Automatic generation of constructable brick sculptures. Tech. rep.
  13. “Legolization: Optimizing lego designs”. ACM Trans. Graph., 34(6), nov.
  14. “Split-and-merge-based genetic algorithm (sm-ga) for lego brick sculpture optimization”. IEEE Access, 6, pp. 40429–40438.
  15. “Models and algorithms for optimising two-dimensional lego constructions”. European Journal of Operational Research, 289(1), pp. 270–284.
  16. “A legorization method based on 3d color printing trajectory”. Proceedings of the Institution of Mechanical Engineers, Part B: Journal of Engineering Manufacture, 236(6-7), pp. 844–867.
  17. “Automatic Generation of Vivid LEGO Architectural Sculptures”. Computer Graphics Forum.
  18. “Building lego using deep generative models of graphs”. Machine Learning for Engineering Modeling, Simulation, and Design Workshop at Neural Information Processing Systems.
  19. “Image2lego: Customized lego set generation from images”. arXiv preprint arXiv:2108.08477.
  20. “Brick-by-Brick: Combinatorial construction with deep reinforcement learning”. In Advances in Neural Information Processing Systems (NeurIPS), Vol. 34.
  21. “Combinatorial 3D shape generation via sequential assembly”. arXiv preprint arXiv:2004.07414.
  22. “Sequential brick assembly with efficient constraint satisfaction”. arXiv preprint arXiv:2210.01021.
  23. “Break and make: Interactive structural understanding using lego bricks”. In Computer Vision – ECCV 2022, S. Avidan, G. Brostow, M. Cissé, G. M. Farinella, and T. Hassner, eds., Springer Nature Switzerland, pp. 90–107.
  24. “Translating a visual lego manual to a machine-executable plan”. In European Conference on Computer Vision.
  25. “Recent advances in robot learning from demonstration”. Annual Review of Control, Robotics, and Autonomous Systems, 3(1), pp. 297–330.
  26. “A survey of robot learning from demonstration”. Robot. Auton. Syst., 57(5), may, p. 469–483.
  27. “A comprehensive study on robot learning from demonstration”. In 2020 2nd International Conference on Innovative Mechanisms for Industry Applications (ICIMIA), pp. 291–299.
  28. “A system for learning continuous human-robot interactions from human-human demonstrations”. In 2017 IEEE International Conference on Robotics and Automation (ICRA), pp. 2882–2889.
  29. “Learning from physical human feedback: An object-centric one-shot adaptation method”. In 2023 IEEE International Conference on Robotics and Automation (ICRA), pp. 9910–9916.
  30. “Robot learning from demonstration in robotic assembly: A survey”. Robotics, 7(2).
  31. “A comparison of types of robot control for programming by demonstration”. In 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI), pp. 213–220.
  32. “From demonstrations to skills for high-level programming of industrial robots”. In AAAI Fall Symposia.
  33. “Industrial robot programming by demonstration”. In 2016 International Conference on Advanced Robotics and Mechatronics (ICARM), pp. 300–305.
  34. “Robotic lego assembly and disassembly from human demonstration”. arXiv preprint arXiv:2305.15667.
  35. “Gradient-based learning applied to document recognition”. Proceedings of the IEEE, 86(11), pp. 2278–2324.
  36. “Design and use paradigms for gazebo, an open-source multi-robot simulator”. In 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566), Vol. 3, pp. 2149–2154 vol.3.
  37. “Jerk-bounded position controller with real-time task modification for interactive industrial robots”. In 2022 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM), pp. 1771–1778.
  38. “Safe interactive industrial robots using jerk-based safe set algorithm”. arXiv preprint arXiv:2204.03038.
Citations (4)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now
Youtube Logo Streamline Icon: https://streamlinehq.com

YouTube