Yes, you are correct that the scorecard criteria is the same in each project. I can understand how this could potentially cause issues with differing types of projects/services.
It would be worth submitting this as an enhancement request to allow scorecard criteria to be chosen by project type. To do this, visit our Client Portal Home page and select the "Request a feature" button. Then, fill and submit the request form.