Before removing World ID App from the old phone, add at least one login method in your profile's Settings > Account.
On the new phone, select Log in rather than I am a new user, then use a login method already linked to the account. When changing platforms, make sure the saved method is supported on the new device.
Full details: How do I move my account to a new phone?