Jackson has the freedom to leave—he’s done so before, he’s not a Blue, and as a man he can protect himself and find work. Cussy Mary doesn’t feel like she has the same freedom as Jackson or even Queenie, who’s making a life in Philadelphia. The mention of Queenie—whose departure left Cussy Mary the only non-white-skinned person in the area—reminds Jackson of his last argument with Cussy Mary, and he apologizes, showing both kindness and humility. He didn’t consider how her skin color might have made her life difficult, because he didn’t pay attention to it. He only saw who Cussy is as a human being, and one whom he respects and likes.