It's really cool to see your project come together like you planned, a few reconsiderations along the way is unavoidable.
The power button stays recessed when you turn it on. It's barely noticeable from a distance. The other option is to use the momentary push-button variant, but then you'd need to make a separate circuit to keep the power on.
It definitely seems like you have a ground loop somewhere. It's difficult to see why. I would make sure none of the connectors are actually connected to the chassis.
I wouldn't worry, except for the ground loop issue, about the amperage of your PSU. I'm using a 3.5A, and it is more than sufficient to give all the power I need and then some. Under normal use, you will rarely come close to the rated wattage of the amp.