I finally figured out how to remove the annoying 'EN' icon from the top right of the screen when you have the virtual keyboard open.
Goto:
Option --> Language
At the bottom, change the option "Language ID" from 'Automatic' to 'HIDE'.
You will NEVER see the annoying EN icon ever again!!!
I had even tried wiping and upgrading my OS, and it still showed up, but I found this option to get rid of it
Here is a screenshot to show you.