To privately chat with Audience members, you will need to Enable private chat in the settings options. See below.*
Once activated, you will see the user under Speakers in the Conversations panel, and you can simply click on their name to chat directly to them.