The problem comes when we introduce coercion. Power is the ability of A to control B, of B to control A, of C to control G, ad infinitum. C only has the right to control A in order to stop A from coercing C.
The a problem arises when the concept of freedom is expanded beyond liberty and into power. Many seek to extend A's freedom into power over B.
We see this taking place in the Net Neutrality argument, with many arguing A should be allowed to censor the content that B, S, Q, F, and L are exposed to. It also takes place when the concept of "reproductive freedom" is extended to the right of M to avoid the consequences of her mistakes by inflicting violence upon D.