The u-boot port was never tried on a device and was only added to get the image building. Remove now that we have barebox support