The limits on broadband connectivity are much more constrained than CPU speeds. For example, you won’t be seeing any increases in the speed of analog modems. They have reached the theoretical limit of the physical medium. Part of the reason Moore’s law works is because they are replacing everything that limits the speed with each generation.
For DSL the limits are constrained by the quality of medium and length.
For cable, the issue is how much of the bandwidth are they willing to devote to data, (as opposed to TV channels), and how many users are on the same cable.
If the providers invest in a new medium like optical fiber to the home then you will see a massive increase in bandwidth. Given the costs of replacing the existing infrastructure, I expect this to be gradual.
Does this answer your question?