Mark Levin refers to the bureaucratic state as the 4th branch of government. He's right about that. The regulatory bureaucracy is more of a threat to liberty than any of the official branches. There's no real accountability, and they even have the nerve to claim that they're not political hirelings, but "civil servants". They issue regulations with the full force of law, but there's no check and balances there. They have a perfunctory public comment period, and aren't bound to abide any of it anyway.
We have to return to first principles: the Congress cannot give away power that it does not itself possess. A lot of what they have theoretically authorized the bureaucracy to do was not theirs to delegate in the first place.
The bureaucracy is definitely the most dangerous element of government. What real accountability is there? They're not elected, and even if you sue them all they do is bring to bear the virtually unlimited legal resources that your taxes paid for. If they lose in court, awards likewise come from your taxes. No skin off their noses.