Hi Demetrius,
What version of ArcGIS Pro are you using?
Do you turn the layers on/off from the layout view or the map view?
I think this is working as expected - the layouts are looking at the same map, changes you make to the map will be reflected in the layout. An alternative approach might be to use just 1 layout, and alternate your layer visibility.
Otherwise you'd have to create 4 versions of the maps for each layout.
What end goal do you have in mind? This might help us advise further.
Carmel