Removing user's admin rights makes notification + search disappear

Following flow:

1. Update XWiki (from 10.4 to 11.4) with AdminUser1
2. Remove AdminUser1's admin rights with AdminUser2
3. Notifications and Search in top panel disappear for all users
4. Add AdminUser1 back do admin group
5. See how Search and Notifications are shown again

I already tried to reinstall Notifications Application with AdminUser2, however, that did not work.