Perception Through Image Processing Applications for Situation Awareness

Abstract

This paper introduces a concept for the perception level of situation awareness through image processing applications. The perception of the information from the environment is lacking to achieve highly autonomous vehicles. This approach mainly focuses on collecting information from the environment using camera sensors. The frames from the camera are processed using multiple image processing algorithms, outputs converted into CAN message, and sent to the expert system. CE-Box custom hardware that consists of a Raspberry Pi 3b model counted with PiCAN 2 used to implement and evaluate this approach. The goal of this paper is to provide a conceptual method to make decisions based on the extracted information from the environment using image processing algorithms.