A couple of things you can try:
1. Open a dos prompt and try and delete it from there.
2. Boot into safe mode with command prompt and try it from there. (or recovery console – that works too)
3. if you are on a network – go to the admin share from from another computer (\computerc$) and try to delete it from there.
Usually one of the 3 always works for me.