You cannot delete a data sync collection once it has been saved and/or submitted.
As long as you do not submit a file, the collection will not be processed and will remain stagnant in the system.
About data sync collections in Collection Manager
The step-by-step workflow for data sync collections