Science fiction (hard sci-fi) often delves into asides about fictional science and technology just to have fun with the concept. While you should ideally keep up a pace that makes sure the plot is always going, a good book that isn't set in our world should adequately explore the setting so the reader at the very least understands the context, and at best have takentakes an interest in the world for its own sake.
A good writer knows how to weave plot and setting nuggets together without impeding the pace of the novel. Knowing the balance is part of the skill of a writer.