I don't know which D compiler you are using, but Debian builds gdc from GCC 5 for the 3 ARM platforms so it will probably work on Ubuntu Phone.

https://packages.debian.org/search?keywords=gdc-5