I just went to an earlier save and approached the Drunk again. Same dialogue choices, same clean brawl and this time ended up with a guard and a citizen interested in me once the brawl was over.
Both kept their distance but stayed facing me. The citizen cowered when approached too closely.
It looks like the brawl is not shutting down cleanly when over.