You could do this but there are disadvantages: ventilation and watering. For ventilation, unless you are there every day, you need to leave some openings for air and hope it is not too windy. For moisture, it ijust takes extra time, after raising and then lowering the sides.
Also the summer crops you mention will easily fill all the space and may push up the top or out of the sides.
However these are the downsides and you may succeed with lovely summer fruits so I don’t want to discourage you!