Description
The default project folder is an integral part of an ArcGIS Pro project, and cannot be deleted regardless of whether it is used or not.
Solution
If you want to use another folder as your project's home folder, right-click that folder and select Make Default.