Can I disable the high priority feature?

No, but you can set the limit of high priority questions to 0.

By setting the question limit of high priority questions to 0, Question Submitters will not able to submit new questions with high priority.
Be aware that you will need to set first a (high) question limit of which 0 are high priority. See example screen below.