Most governments have an Executive agency, a Health agency, an Education agency, and a Military agency; various governments have many other agencies depending on the type of government.
No
To name a relatively tame on, the Environmental Protection Agency which is independent and not attached to any one department.
"agency", "authority", "bureau", "federal agency" and "office"
In the UK it is the Department for Transport. (DfT)