I recall using some gray foam strips (not weatherstripping, because that would have made it impossible to open the windows) and just shoved it in the gaps. Made a big difference. Forget where the foam ...