Avoid irrelevant information
Don't bother considering information that's unnecessary, marginally useful, or overly time-consuming to collect—even if it strikes you as interesting. Focus your information-gathering efforts on data that will help you move forward to a resolution.
For example, with the question of expedited delivery service, you might find yourself wondering how late deliveries are affecting your customers. But having this information won't help you determine whether to introduce a new service. You already know that late deliveries are bad for business. To address the issue, you need to analyze the issue from a broad perspective and understand the impact that your proposed actions might have on others.
In addition, when your information yields marginal results, try not to overanalyze small discrepancies.
For example, suppose you're exploring product defects created by a piece of manufacturing equipment. In one week, the machine might generate 150 defective products. In another week, the machine might generate 160 flawed products. In all likelihood, it's not worth your time to investigate why one week's defective products are slightly higher than the previous week's. If, however, the discrepancy is greater—say 150 defective products in one week versus 450 in another—then you probably should explore the matter further.
The question to continually ask is: "Would gathering more information fundamentally change the answer that you already have?" If the answer is no, then you need to move on. If it's yes, then you need to collect more information.