Model Compare
Working with Model Compare
To start working with Model Compare, follow the steps given below.
- Go to the Home page and create a new workbook or open an existing workbook.
- Drag and drop the required dataset on the workbook canvas.
- In the Properties pane, select the Data Fields from the dataset.
- Select the classification or regression algorithm that you want to compare and connect it to the dataset node.
- Select the algorithm node and select its respective Properties displayed in the Properties pane.
Here, we have selected the Dependent and Independent variables, and Advanced Properties of MLP Neural Network algorithm.
- Click the algorithm and then click Run.
Repeat steps 4 to 6 for all the algorithms that you want to compare.
Here we have selected Decision Tree.
Note:
Make sure you select either the Classification models or Regression models to compare. You cannot compare a Classification model to another Regression model.
- Drag and Drop Model Compare on the workbook.
- Connect the selected algorithms to Model Compare.
Select the Comparison Metrices for Model Compare.
Note:
For Regression models, the Comparison Metrices are –
- RMSE
- Adjusted R Square
- R square
- MSE
- MAE
- MAPE
- AIC
- BIC
For Classification models, the Comparison Metrices are –
- Accuracy
- Specificity
- Sensitivity / Recall
- F-Score
- Precision
- AUC
If cross validation is added as a predecessor to any of the algorithms, the comparison metrices are Mean accuracy and Standard Deviation accuracy.
If Train Test Split is used as a predecessor to the algorithms, then the algorithms are compared based on Test data.
- Select the Model Compare node, then click Run.
The node execution starts and after completion, a confirmation is displayed. - After the Model Compare node execution is complete, Click Explore.
The result page is displayed.
The result page displays the metrices of both the models sorted on the Performance Metrices.
As seen in the above figure, in this example, the recommended model is Decision Tree.
