Main Content

Review Editor

Validate Modelscape models and submit reviews

Since R2023a

expand all in page

Description

Use the Review Editor app to validate and add reviews to Modelscape™ models.

After a model developer in your organization develops a model, that model can be proposed to be deployed for production. However, you must validate the model version first. You can validate the model version using the Review Editor app. Use the app to explore data and analyze the model version. You can record anomalies or observations related to models, make an appropriate closure measure, and export the findings to a PDF file. Use the app to perform any of these tasks:

  • Open, view, and run models.

  • Attach supporting documents.

  • Make a review decision.

Review Editor app

Open the Review Editor App

  • To launch the Review Editor app, open the Modelscape Home page. To host Modelscape for your organization, contact MathWorks Consulting Services. On the Home page, click Models on the navigation bar and open the version of the model you want to review. Open the Review Editor app to review a specific model version by clicking Open Review next to the model version.

Examples

expand all

Create a new live script by clicking the New Script button on the menu.

Use the live scripts to explore data and analyze the model versions. For instance, you can perform what-if analyses, which include changing the model parameters, using different fitting methods, and observing changes in the model performance.

To perform these analyses, you can use the suite of metrics in Modelscape. For more details, see Fairness Metrics in Modelscape. You can use these metrics to analyze the bias in your models.

You can also write scripts to implement model validation suites. For an example that shows how to validate a probability-of-default model, see Credit Scorecard Validation Metrics. This example shows how to use the techniques in the BCBS Working Paper 14.

If your model version uses a programming language other than MATLAB®, you can still use the validation tools from Modelscape. For more information, see Validation of External Models.

For an example that shows how to validate credit models using the European Central Bank template, see Validation of Credit Models in ECB Templates.

After you perform your analyses, save your work by clicking New Revision and describing your changes.

To attach documents, click Explore on the menu, and upload file attachments using the Upload button. You can attach recommendations for improvement, evidence of model performance reports you generate outside the app, detailed model validation documents, and supporting scripts.

By default, the Review Editor attaches files to the model repository. The location to which you save documents is customizable at an organizational level. See Extensibility for more details.

Finish your review by using the submit button and sign-off your form in the app. You can customize the Submit Review dropdown and sign-off forms based on the needs of your organization. For more details, see Extensibility.

By default, the Review Editor app provides a full review form and a reduced review form. Use the reduced review form to approve the model if the changes are trivial. If the changes are not trivial and have a significant material impact, for example on the value of trade, use the full review form.

You can choose to approve or reject the model version. The next stages depend on the model lifecycle. If you do not approve the model version, it could be sent back to the developer. If you approve the model version, it could be sent to production and deployment.

Related Examples

Version History

Introduced in R2023a

See Also

Topics