I've trained it on the custom dataset of 6800 training images and 761 validation images. All the unknown region pixel takes the value of 255 eventually. I've checked with a batch size of 1,8, &16 and with multiple learning rates. @foamliu do you have any idea what can be a plausible reason for it?