never show all fields search in top bar

Is there a setting to never show the all fields search text box & button in the top bar?
Or do you have to remove it in designer page by page?

Or should it not show if no fields in the whole project are selected for inclusion in all fields search?

Sorry if I missed something in the manual & thanks.