When you have an app highlighted in the floating switcher, press the Up or Down arrow key.
You can also jump to a particular window of an open app from the app switcher. Instantly, the window will be foreground. When you find the open app that you want to switch to, simply release the Command and Tab keys.