Yes, You can delete a quiz attempt.

Here is the video on it. Click here!

Click Open on your quiz: 

Click all attempts: 

Pick your student that needs the attempt deleted and then delete the attempt: