My disk is getting full. I see below in the Skyline DataMiner Backups folder every day. I assume that's a backup from Elastic because I see 'indices'? Is this never cleaned up? Am I allowed to delete this manually?
Hello Jochen,
This is indeed not getting cleaned up. I would also like to note that snapshots are sequential, which means that snapshot 2 will use snapshot 1 to build on. So deleting snapshots might not have a lot of impact, since it will not delete anything that is in use by another snapshot.
However to delete a snapshot, please refer to:
https://www.elastic.co/guide/en/elasticsearch/reference/current/delete-snapshots.html
Kind regards,
Thomas, can we not add update the SLM policy to add the retention configuration rather than recommending the manual operation? https://www.elastic.co/guide/en/elasticsearch/reference/master/getting-started-snapshot-lifecycle-management.html
Hello Srikanth, unfortunatly, this feature is locked behind xpack, which means it’s a paid feature. Secondly, this was introduced in Elastic 7.6, which we don’t support at the moment.
However, I’m thinking of changing the behavior and make Elastic take a full backup everytime. We could then, in the backup procedure, delete all previous X backups. (basically the same thing we do with dataminer backups). This would be more inline with Dataminer backups in my opinion.
Thomas, that would certainly give the better user experience to manage the Elasticsearch data using the DataMiner as long as there are no performance side effects. Thanks.
Just one side note, You might lose some historical information. If snapshot 1 contains information not present in snapshot 2, it will get deleted (as Thomas said).