Yes, the remote access is fantastic, I don't know how I could live without it anymore. But, sadly, access to the Remote Desktop function does require IE because of the aforementioned ActiveX control.
To what Zx2Slow was saying, yes, I agree, WHS does not a good HTPC make. However, it does make a fantastic file/backup/remote access server, which it sounds like what digr is using it for, not necessarily trying to use it to make recordings from live TV as an HTPC would do.
Digr, I think I'm one of the biggest advocates of using WHS around here. I was lucky enough to get accepted to the beta back in the day and I can't wait until the next release is available to sign up for the beta. It should have a lot of really neat things going on since it will be Windows Server 2008 R2 based (and 64-bit!).