Introduction

After conducting stress testing, users may uncover various scenarios where models fail, posing significant business continuity risks. Additionally, each business typically has specific guidelines they wish to enforce on models. In AryaXAI, these guidelines are defined as 'Policies'.

Policies serve as rules or guidelines that can override model predictions. The framework implements these policies on the models, adhering to the instructions provided by the user.

Create Policies

To create a new policy in AryaXAI: 

• Navigate to 'Policies' in the main menu on the left and select 'Create New Policy'.
• Define the policy and specify the feature (data point) to which the policy applies. Choose the conditional operators (e.g., not equal to, equal to, greater than, less than) and set the current expression.
• Add the policy statement, select the decision input, specify the desired decision value for the final prediction, and click 'Save'.

Manage Policies

All created policies are showcased on the Policy dashboard, where you can easily Activate/Deactivate, edit, or delete them.

When viewing cases, access the 'Policies' tab (ML Explainability > View cases > 'view' under the Options column) to review the policy details for the particular case. 

Here, ‘Model Prediction’ is the original model prediction and ‘Final prediction’ is the overridden prediction based on the custom rules defined.

Policy trail

The ‘Policy Trail’ operates similarly to the ‘Observations Trail’ but is tailored specifically for policies. It logs events such as policy creation, modifications, updates, and other relevant actions within the policy management system.

This feature facilitates tracking the evolution of policies, comprehending the sequence of modifications, and identifying the individuals responsible for specific changes and their timing. It proves valuable for compliance, auditing, troubleshooting, and ensuring transparency and accountability within the system.