The deform-conv layers reduce the detection accuracy

[BearManlc]

I trained your deform-conv on the origin data. It gets 70% on origin test and 89% on scaled data, while the the normal CNN model trained on origin data gets 99% on origin test and 64% on scaled data. The deform-conv may not work.
So I try to delete two of the deform-conv, keep one left. It gets 93% on origin test and 97% on scaled data.
Your deform-conv may not work. I think you should check it.