You will need to call phone support to delete your account. You can call them at 1-888-829-8608 (Monday to Friday, 9 AM to 6 PM ET).
When you close your account all your tax returns are deleted and can't be recovered. This is the reason why there is no easy way to do it.