Described herein is an inventory management system, and corresponding methods, in which robotic units are configured to execute at least a portion of a set of instructions in an automated manner. During execution of the set of instructions, robotic units may encounter tasks that they are unable to complete in an automated manner. The robotic units, upon encountering these tasks, may submit a request for manual operation to a control unit. In some embodiments, the request may be assigned to an available operator, which may take over control of the robotic unit using a remote manipulation device, to complete the task manually. Once the task has been completed manually, automated execution of the instructions may be resumed. In embodiments of the disclosed system, an operator may work assigned requests as those requests are received, which may eliminate downtime for the operator.