Have you closed and re-opened outlook since you deleted the folder? When you say it is still on the left hand tool bar, do you mean in the calendar view, or on the folder list itself? Did you deelete the calendar out of the deleted items also? You could try running some Outlook switches as well.
REGISTER or login: