All the Baalei Mussar make a big deal about learning "B'Retzifus" meaning without interruption. Not because of the few moments of batala when you take your break and indulge in idle chatter and the like, but rather because it makes all the difference in your learning when you resume. We can explain this with a Mashal.
When a person needs to get somewhere and he walks there, every time he stops for a moment it delays his arrival by the amount of time he stopped. But imagine blasting off in rocket ship to get to the moon. Once you stop the engines you will fall back to earth. You can't just turn them back on and resume your journey.
To borrow a vort from Rav Shimshon Pincus the gemara says that in one pasuk it says that Adam HaRishon's height was from one end of the earth to the other. Another pasuk says that his height was from earth all the way to heaven. The gemara answers that these two distance s are the same. Rav Pincus says that this gemara means that person can use his intellect to climd to shamayim and reach all the way to the Kisei HaKavod. Or he can use his intellect to involve himself in earthly matters knowing what's going on all over the planet.
Similarly there are two kinds of learning. One learning is to know the material to be knowledgeable for whatever reason. From this perspective it your Torah is just worldly knowledge for worldly gains. Taking a break will only delay your progress momentarily until you resume your "studies". Another kind of learning, torah lishma, real learning, is to be close to Hashem. To study His torah, the torah He calls His "toy" His "joy". It is the vehicle with which a human can connect to his creator. With every word we learn we climb higher and get closer to Hashem. When this kind of learning is disrupted to discuss an earthly matter, we are right back down where we started from whether ten minutes ago, half hour or tow hours ago. We can't just resume, we need to start our ascent all over again from ground zero.
Whether you are a Ba'al HaBayis who is Kovei'a Itim or a Yeshiva Bochur in the Bais Medrash, when taking an otherworldly trip through the galaxies of Torah don't come back every second. Keep on going further and further and don't stop until you arrive, or else you never will.