It's not the most flirty date ever, for sure, but at least, the conversation is interesting. It's not empty, 'where are you from's' and 'what do your parents do'. It's a real conversation, and Baby is invested, now, feels like there are stakes and that this is important. Not only for him, but also for Lydia, because it's obvious she has a lot she wants to let out.

"I don't know the story, and I'm not going to assume I do. But Allison, she made her own choices, right?"

What he's trying to say is that it's not on Lydia, if she made the decision to go, even having been warned. It's just... some people's ways. Heroes.