Peter doesn't hear the question, as Nathan ponders aloud. He's just stood up to follow his brother outside.

When he catches up, however, "This isn't Central Park, Nathan," is the first thing he points out.