Hi Jake, yes our referenced feature layers are services from ArcGIS Server, and all are externally accessible. This appears to be a recent issue for us. I had added a feature and an image service to our agol orgs open data group. That referenced feature layer and image service continues to be visible. My server environment is at 10.4.1.