In this supplementary material of our work, we provide additional experimental evaluation of the proposed Reinforcement Learning (RL) framework. For this purpose, a simple virtual environment of a four-walled room is exploited.