Spoon accepts the slap, not rolling with it so that the full force of it hits him. That means 'You have every right to be mad at me'. He keeps his grip on the hand that she let him have, and sighs softly because he'd really, really, really like to be able to apologize better.