It may break the installer in some ways though, such as a next release not finding your moved folder for the default install path.
One thing I CAN say for sure: Never move the uninstaller by itself! This may cause severe problems, to the point of it deleting files it shouldn't. This is a "feature" in NSIS that I didn't know about back then. Future uninstallers will autodetect such scenarios.