User stories

Video processing and motor control

Situation: Using edge processing and general purpose IOI, linked via an OpenIO controller.

Challenge: A plant biologist wants to 3D image growing plants so that an instruments can follow the upward tract and reimage the same spot multiple times over days. This needs to be done on several plants in parallel.

Solution: An edge processing IOI, interfaced to two video cameras, gathers 3D information which is processed at the IOI to reduce network load. The resulting model is sent to the controller that then calculates a new position for the instruments and sends commands via a general-purpose IOI to the robotic arm holding the instrument package.