Pressing just the delete key works fine for me. However, you have to have highlighted the item with the arrow keys, not the mouse. What I mean is, when you type something in the address bar and the item you want to delete appears, you need to press the down arrow key on your keyboard to navigate down to it and then press delete. You can't simply hover over the item with your mouse cursor.

Hope this helps.