To edit one of your accepted preprints, you can update the DOI entry with a newer version of the article manuscript via your account.
You might also be able to simply add the peer-reviewed article DOI to the current version of the preprint.
– how to do that on OSF: help.osf.io/hc/en-us/articles/360019930573-Edit-Your-Preprint<