What will stick to glass votive holders?

Try some sort of super glue. I glued lace to my unity candle with hot glue and it worked fine.

I will try it with the hot glue gun on one of them and see the last thing I want is for them to be falling apart on the table at the reception

Mod Podge is the best!

That will stick to glass?

You could try a spray adhesive. I know Michael's sells a few different brands.

I glued lace to votives and they burned for about 6 hours total, no issues.

We used a sheer ribbon that we super-glued to the glass. Then wrapped the rhinestone around and used double back tape to attach it to the ribbon. Did a test and it stayed.

Glue Stick! Everybody thinks I'm crazy, but it holds! And, it's invisible!

I've done a couple of them with glue gun and it seems to really being sticking good!!

We used a tape runner on our votive holders. We didn't want to use hot glue because it's thicker and can be messy if you have open space in what you're attaching. The tape runner is flat, is far less messy, and takes a lot less time. We burned a few candles in our finished glass and haven't had any issues with the tape melting.

Aileen's (not sure I spelled that right, but it's purple packaging at Michael's) makes all different types of adhesive, spray, paint, double sided tape...and I think it's one of the most durable brands I've worked with.