If you pick English keyboard and any of these languages keyboard (Tibetan, Telugu, Tamil, Marathi, Hebrew, Gujarati, Cherokee, Bengali, Chinese simple, Chinese traditional, Japanese, Korean, Arabic, Urdu, Thai) the Caps Lock key will automatically act like a switch between languages selected instead of capitalizing the letter. To fix this issue follow the following steps.
Go to: Settings->General->Keyboards->Hardware Keyboard->Caps Lock Switch to/from Latin
Turn off (Caps Lock Switch to/from Latin)
General Screen
Keyboards 
Hardware Keyboard
This will turn off the Caps Lock acting like a language switch.