In Contacts, you can bring up the letter chooser by hoding Up or Down for a period of time.  Once it is showing, Up and Down will increment the letter one at a time.  You can use Left or Right to increment or decrement 5 letters at a time.

<< Add screenshot here >>