Yeah, I actually agree with you there. I don't like an extreme form of technocracy where some individuals dictate who is qualified to rule.
In practice, what I'm thinking of is socially delegating the requirements. Have various organizations dictate their own standards, and let them nominate the candidates.
Sure, one could just make their own jank Tariff Society and nominate their own pro-tariff candidates for economic policy, but the people would see that and vote accordingly. The reputation of the organization would be self-regulating in a decentralized way without the extremely centralized power issues you mentioned. I highly doubt a candidate nominated by the Tariff Society would stand a chance against a candidate nominated by the American Economics Association, for example.
I agree experts can be wrong and have been wrong many times throughout history.
I can also see the concerns for maintaining the status quo.
What I'm thinking of is a less extreme variant of technocracy, where academic organizations, think tanks, etc. nominate candidates according to their own criteria. That way the overall bar is raised while leaving the decision on who is 'qualified' decentralized among the public.
My issue isn't that goldbug economists are promoting harmful policies during a depression. Some issues are complex, and people are fallible.
My issue is that tariffs are widely agreed to be harmful, yet we have tariffs wrecking the economy now. Tariffs arguably constrain people's rights by reducing their freedom to purchase what they want at fair market prices.
Like, at the very least, we should be avoiding blatant mistakes that most experts agree on. The fact that we did, in fact, make a glaring mistake against the advice of basic economics means that something is broken with the system.