Quantitative methods for evaluating how changes to a manifest file impact response?

The manifest basically defines the api including authentication and location of the specification itself. The main logic is in the specification which is a swagger spec, Either yaml or json.