Open Hardware and Free Software Camera for for Long- Range 3D perception enhanced by Neural Network
2018-12-30, 13:15–13:20, Borg

We present a Neural Network friendly Open Hardware camera rig solution.

Inspired by the partitioning of the human visual perception system between the eyes and the cerebral cortex, we present TPNET, which offloads universal and application-specific CNN from the bulk processing of the high resolution pixel data and performs the translation-variant image correction while delegating all non-linear decision making to the network.
Our MVS camera with seven FPGA-based system boards is capable of at least 10 Hz TP pre-processing for 5MPix or 2.5 Hz for 18 MPix quad images.

See also: updated slides