Add the following to /etc/X11/Xresources and restart X / [gkx]dm

xterm*VT100.Translations: #override
BackSpace: string(0x7F)n
Delete:    string("
Home:      string("
End:       string("
*ttyModes: erase ^?

Tested on RHEL3.

Thanks to Justin for this