Yes it is simple physics, less tension means the neck relief will drop and you'll fret out. So yes it is common and highly likely to happen in your circumstances. The truss rod setting is the issue but you'll need to do more than just tweak the rod.
You need to run a full setup routine. Check the nut for proper string seating, then set relief, then action, then intonation. In that order.
'73-4 Ampeg V4B, Ampeg PF350,PF115HE, PF115LF, 115 Traynor, 1962 Fender Jazz, 75 Gibson G3, '10 Squier VM Jazz, Squier CV 60's P Sonic, Squier CV 50's P blonde, Epiphone Thunderbird IV