I feel like there's no "perfect" way to do it. Unless you know what the conversations were about, then you have no idea if he's done anything wrong or not. But if you are set on talking to him about it, the best way is just to be honest and voice your concerns. I'm sure he won't be happy that you were checking out his phone, but maybe he can set your mind at ease.