This article considers the convivial turn in migration and diversity studies, and some of its silences. Conviviality has been conceptualised by some as the ability to be at ease in the presence of diversity. However, insufficient attention has been paid to considering who is affectively at ease with whose differences or, more particularly, what the work of conviviality requires of those marked as other vis-a-vis European white normativity. Drawing on in-depth qualitative interviews with British Bangladeshi Muslims in London, Luton and Birmingham, we argue that a focus on ‘ease in the presence of diversity’ obscures the ‘burden of conviviality’ carried by some, but not others. We discuss three key types of burden that emerged from our data: the work of education and explanation, the work of understanding racism, and quite simply the work of ‘appearing unremarkable’.