The Xilinx clocking-wizard IP can be used in a static-config mode where the hardware is pre-programmed at boot and no dynamic register access is required. In that case the driver should skip ioremap, ...