Help!

I recently purchased a Samsung GX-1L and I am very happy with it apart from one wee thing.......

When I take a photo in portrait style I can look at the LCD and rotate the photo. However when I upload the photos to my PC is defaults back to landscape and will not allow me to rotate it. I get a message that "rotation is not allowed as file is in use elsewhere". I have tried copying the files to the hard disk of my PC and I still get this message. I have tried another SD card and this happens again. I have tried both SD cards in anohter compact digital camera and I can rotate the photos fine from the SD card or my PC.

Anyone any ideas?