Description
I want to delete older debug and working data, so that I can save my disk space.
Preconditions
How to do it:
- Admin may specify that he wants to delete all pipeline execution data older than X days.
- Admin may click on "Delete" button
- As a result, system starts deleting on background pipeline execution data 1) - 4) (specified below)
- Admin may work with the GUI as needed while the data is being deleted.
- Admin may observe the result of the delete or information that delete is still running.
Requirements
When pipeline execution is deleted, it is necessary to:
1) delete all information related to the execution from DB from exec_* tables
| exec_context_dpu |
| exec_context_pipeline |
| exec_dataunit_info |
| exec_pipeline |
| exec_record |
2) delete all information related to the execution from general.workingdir, which removes temporary files, configurations etc. related to pipeline executions
3) delete logs - table logging in DB
4) delete debug data from working rdf store (Virtuoso/Sesame) - for local RDF this does not bring any extra effort as the working data are removed in 2)
Note: Logs which are logged to frontend/backend.log or frontend_error/backend_error can be managed by setting up how long they should be kept in config.propertes (backend.log.keepDays).
Notes
94