Corporation de l'École Polytechnique de Montréal

Published purpose

Interactive cyber-physical systems provide a suitable automation solution for certain machining processes, giving the operator a role in supervising operations and controlling product quality. The interactivity between the operator and the cyber-physical system must be well thought out. The overall project is aimed at developing tools that will ultimately allow the operator to use a collaborative robot cell to communicate with the cyber-physical system, through both full-body and hand gestures, in relation to its 3D environment. This will require the development of 3D pose estimation and motion recognition algorithms that are robust enough to withstand the challenges posed by the machining environment such as visual occlusions or situations where humans are carrying/handling an object/tool in their hands.