You can disable the rule, add the disabled rule in the development environment and push it through the staging environment. The rule won't work in the staging environment.
In other words, you will need to add a disabled rule to an environment to remove it from the upstream resources.