Paul’s behavior in this scene is a little self-destructive. Considering that the country has strict “antisabotage” laws, it’s unwise to let anyone into the Ilium Works, even if that person is a trusted friend—after all, people like Kroner wouldn’t approve of this, regardless of how close Paul and Finnerty are. This is why Shepherd gleefully confirms that Paul is authorizing him to let Finnerty keep walking through the grounds: he knows this is a grave mistake, and he's excited to get Paul in trouble for it. Paul, however, doesn’t care, perhaps wanting—on some subconscious level—to make a mistake big enough to get himself fired.