Does this persist if the account you're inviting to the channel isn't a member of the team?
If so, then I suspect that the local member permissions for that channel / folder are overwriting the team's set permissions, which if I remember correctly is an intended feature. I'll need to check to be sure.
