This is a black hole when the question is broken, and causes the query to ‘run forever’. There is no way to stop it, and no way to fix it, because it cannot be edited until it stops, which is doesn’t. “Doing Science” is no consolation …
Please post “Diagnostic Info” from Admin > Troubleshooting.
And a little more context would be helpful. Yes, questions runs automatically when opened. Perhaps you’re looking for another tool than Metabase, where you have a lot more configuration control.