Have you tried to delete them in safe mode?
To start outlook in safe mode go to start -> Run, then type: outlook /safe
As it happens I JUST had this exact same issue with someone yesterday. However the person I was working with had an exchange account and I could delete the items using mfcmapi. That was the only thing that worked. Have you done a repair of your pst? scanpst is one option.