ENH: Add support for displacement fields of different sizes and in different world coordinate systems