Will the adhesive backing harm my bag?

No.  The bagnetique glue has been especially developed and tested to be removable without leaving any residue or mess.  If the lining fabric of your bag is especially delicate (very rare -- it needs to be tough to be effective in a bag!), it could stretch the fabric when you pull it off.  Better then to use it with the clip on method.