The prohibition of orlah includes any benefit derived from the fruit, be it in the usual manner (consuming it) or otherwise. This includes looking at orlah fruits and deriving pleasure from viewing ornamental fruit trees, such as dwarf trees. There is a machlokes among poskim regarding fruit trees whose main purpose is to eat the fruit, not to enjoy its beauty. It’s best to follow the more stringent opinion of those who hold it’s forbidden to derive benefit from the fruit’s beauty, and to remove (and discard) the fruits once they start growing.
Mishpetei Aretz, § Orlah, 10:7, footnotes 25-27