Asynchronous Deletions - Allow Immediate Delete

[anagperal]

📌 References

• Issue: Closes #8697e5cpk Asynchronous Deletions - Allow Immediate Delete

⚠️ METADATA CHANGE:

• new async-deletions format in datastore. Run next script first when deployed:
  npx ts-node -r dotenv/config src/scripts/async_deletions_migrate_new_datastore.ts
• maxNumberOfRowsToSyncDeletion added to every module in https://dev.eyeseetea.com/who-dev-238/dhis-web-datastore/index.html#/edit/glass/modules
• added to https://dev.eyeseetea.com/who-dev-238/dhis-web-datastore/index.html#/edit/glass/general the key maxAttemptsForAsyncDeletions

📝 Implementation

• Mark deletions that are under delete to "DELETING" status to allow a second run of the script while the first might be processing. The second script run will get deletions under "PENDING" status
• Schedule the async deletions every hour --> sys admin when deployed
• If Deletion fails, re-try upto 3 times(store in datastore https://dev.eyeseetea.com/who-dev-238/dhis-web-datastore/index.html#/edit/glass/general) and after display an error message saying Admin needs to look into it (save in upload the errorAsyncDeleting key to true)
• Apply logic to start delete of file (synchronously) for small size files. File size should be stored in the datastore to allow configuration of the same without code changes (configured in every module in https://dev.eyeseetea.com/who-dev-238/dhis-web-datastore/index.html#/edit/glass/modules)
• Crete a script to migrate async-deletions to new format. Run next script first when deployed:
  npx ts-node -r dotenv/config src/scripts/async_deletions_migrate_new_datastore.ts

📹 Screenshots/Screen capture

AMR - agg:

🔥 Testing

[ifoche]

Task linked: CU-8697e5cpk Asynchronous Deletions - Allow Immediate Delete

[9sneha-n]

Looks good, thanks @anagperal