Can infrared instruments look through glass windows?

Yes, the window has to be transparent for the wavelength of instrument you are using. For 1 to 2.6 microns we suggest quartz, for 3.4 to 5.4 microns we suggest Calcium Fluoride.