As said, a conservatory is a temporary building it's not an extension and as such must be separated from the main house with external doors and windows.

Your surveyor missed a trick if they never mentioned it when purchasing the property.
It wouldn't be missed now with the HIP's required when selling.

Not only does it keep you main house warmer it's also more secure.

Vipes