No dought that the first association regarding the term "Behind Closed Doors" in a negative one. However, I just got on the train, and that means that in a second, the train will start moving and I will be on my way home... and that is a super positive thing.
Almost always the situation derives its meaning from Timing, Context, and Intent.