When you are dining with a group of people and some are bilingual...?

Does it bother you if they carry on a conversation at the table in their other language; one that you and others don't understand?