Off side door mirror won't retract

[Leslie]

When I lock the car the off side door mirror won't retract back against the window.
I have adjusted it by hand a couple of times . It works once each time but then reverts back to staying open again.
Any ideas how this can be fixed please?