To reproduce results given in the paper, follow the below steps:
-
Generate Models: Run any of the
.shfiles in this directory to create model and data dumps for a data setting. The files have been namedrun_D_mMnN.shwhereMis the manifold dimension andNis the embedding dimension, andDis an identifier for the dataset type (cs: Concentric Spheres,sw: Intertwined Swiss Rolls,ws: Separated Spheres). -
Decision Region & Heatmap Plots: Navigate to
ppr_decreg_and_heatmaps.py. Provide the path to the distance learner and standard classifier dumps, and an identifier for the plot file names and run the script. -
Out-of-domain Confidence Plot: Navigate to
ppr_confidence.py. Provide the path to the distance learner and standard classifier dumps, and an identifier for the plot file names and run the script. -
Adversarial Robustness Plot: Make sure you have run
run_cs_m50n500.shandrun_cs_m25n500.sh. Navigate toadv_robustness.py. Provide a path to the locations of adversarial performance dumps (.jsonfiles created when you run the bash scripts), and run the script.