There's a quirk to how this functionality was first implemented. You also need to check the step in front of the step you want to run automatically with Automatic Execute. This 'alerts' the system that the next step will be running automatically.
It is unfortunately not intuitive but we can't change it or it would break everyone's workflows.
Thanks,
Michael