You can add an entire service or just a single layer. If you add a service with multiple layers it treats it sort of like a group, but unfortunately doing this limits some of the functionality on the individual layers (ie no selecting features, symbology filters etc. You can only do popups). It would be a nice feature if it handled groups and had full functionality on individual layers in groups or services.