Now this is just a feeling, not a fact.

When I watch British talk shows, I have way less of a problem understanding i. e. Scottish accents than the American guests.
I think, foreign language learners of English might be better at understanding different accents, because they’re not locked into one. Or maybe I’m a special little boy idk