we just updated the greek symbol editor to keep the keyboard focus inside the control. It should work as you expect now with delete and backspace and allow you to type characters after greek symbols without having to click back in the legend field.
The backspace key is a problem with all web applications. If you are not in a text field, then backspace means "go to the previous page.". It's a drag.