As long as it is safely behind a firewall with no Internet exposed ports, I agree. If someone opens access to the web ui through their firewall, then depending on how the web interface is scripted, it may be possible to cause "issues". Essentially, anything from changing your music to accessing files shared on your internal network is possible.
For me, I like to just patch it and not worry.