To clarify what I mean, the setting is “Always include this question when showing a random selection of questions on this page”. If this is turned on for a question that is disabled, your page that is randomly showing so many questions will still always “show” this question, but since it’s disabled it just won’t appear on the page.
Easy enough to fix if you run into this, just turn that setting off on any disabled questions!
This should be fixed now, everyone! Let us know if you see any issues!