I use 2-sided tape for a "permanent" set up. The two sided foam tape, not the thin clear one used in gift wrapping.

Use 2 or 3 pieces to make sure the solder contacts on the back side you are taping is covered. You do not want it shorting out against the metal casing. The HD Casing would be a great place for it.