You could.

I would experiment. Minute flaws in the surfaces of these blown glass
bottles may very well lead to a rapid and catastrophic flaw detection.

(In short, your bottles will explode)

You can buy an 18 gallon tub from Target for 3.99, buy some electrosol
dish washer detergent (powder) for 2.99, fill said tub 3/4 with hot
water and add your bottles. Soak for 1 hour or so (put the lid on so
it stays warm) and your labels and debris will all come off- with the
bonus they'll dry streak free!

If you're really worried after that cleaning, stuff them in the
dishwasher for a pot/pan cycle with a high temp dry. That'll do the
ticket.

And finally, if this doesn't dissuade.you from putting your bottles in
the oven, make sure that you go thru a very gentle warm up and a very
very long cool down- you might cycle the oven back on to heat it back
up so it receives 2 cycles. Even tho glass is an amorphous substance
you can still get preferential expansion.