You can disable this under Setup > Project Preferences, in the Business Case section. In addition, you could edit the Layout Template that is assigned to these users, and hide the business case there.
Additionally, the Scorecard area of the Business Case does not display unless a scorecard is created by a System Admin.
I hope that was helpful! Please let us know if you have any additional questions.