Who can do it (User role)

Data Consumer

Description

I want to maintain an up to date copy of file dump of public dataset published in public catalog in a simple and effective way so that the selected file dump(s) can be periodically synchronized from the ODN instance to any target file system.

Preconditions

  • at least one publicly available dataset containing a resource published as file dump exists

How to do it:

  • executes an rsync command with the following syntax to replicate file dump(s) from ODN instance:
      • options: -va
      • source:
        • rsync://<<public catalog URL of ODN instance>>/dumps/ for all file dumps from certain ODN instance
        • or
        • rsync://<<public catalog URL of ODN instance>>/dumps/<<name of file dump>>/ for one particular file dump from certain ODN instance
      • destination: /<<destination path>>/<<destination directory>>/
  • all file dumps from source ODN instance are replicated to destination according to following rules:
    • check for each file dump to be replicated:
      • if there is no file dump with the same name in the destination before replication, file dump is replicated
      • if there is a file dump with the same name in the destination before replication, file dump is overwritten in the destination if the modification time of both files differs
    • no files in source can be modified or deleted using rsync command
    • there is no need for authentication when using rsync command

Notes

88