I suspect you didn't share the items referenced as public as well.
For example, if you publish a web application that references a web map (they all do), that in turn references a hosted service, all of these have to be shared with everyone. Otherwise, you'll get challenged to log in.
We're working to alert you to this fact when you share your web application.
Thanks,
Mike