Character is in trouble situation on a planet and danger is closing in. He is in a good mood and he is speaking over a com with his mates, quoting: "Houston, we got a problem." But in this universe for example Earth does not exist.
I'm going to edge away from the opinion part and try to focus on the when and why it may be appropriate. As with so many things in writing, this is from personal observation more than it is a decree.
Who is your target audience? Is your story intended to be light reading? Use out-of-universe colloquialisms as you see fit, if you feel they help make a point. Are you writing something more involved, where the expectation is that your audience memorize or visualize your setting? Stick to your setting; it might be disingenuous to your audience otherwise.
What is the focus of your story? Is it a period piece, a walk-of-life in a specific setting? Out-of-universe is not your friend: a slip-up may be forgiven, or it may ruin the experience for your readers. Is the actual setting a story aid, a backdrop more than it is the point of the story, then a brief out-of-universe reference might do the trick.
Out-of-universe references can be a useful tool because they may connect more directly with your audience (1). Used sparingly, they can bring a point across succinctly or effectively. But use them too often, and you're telling the audience that, yeah, this story might have been better in a different setting.
(1) Emphasis on "may" because cultural references, by their nature, require knowledge of the culture in question. "Shall we play a game?" may instill a sense of foreboding in some, and be non-sensical to others.