The important thing is how is the conservatory fixed to the walls?
If it is fixed correctly to withstand the expected exposure to the elements, depending on where you live and at what hight above sea level -then filling the gaps with foam will do the trick.