Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Who can do this (User role)

Data Publisher


Description

I want to define a pipeline that downloads the data from a remote server and publishes it as resource in ODN so that I can periodically republish data from a remote location and also use this dataset in other pipelines without downloading same data again from a remote location

Preconditions

  • at least one catalog record is created in internal catalog
  • non associated pipeline with name "Mirror" exists 

How to do it:

  • clicks on dataset 'Name' in the list of internal catalog records

  • clicks 'Manage' button
  • selects 'Pipelines' tab
    • list of all pipelines associated with the dataset is displayed
  • clicks '+' button
  • clicks 'Create a modified copy of existing pipeline' radio button
  • clicks 'Next' button
    • list of all existing pipelines is displayed
  • selects and clicks pipeline with name 'Mirror' in the list  
    • pipeline description is displayed when pipeline is selected
  • clicks 'Create a copy' button
  • fills in the name of a new pipeline
  • fills in the description of a new pipeline
  • clicks 'Next' button
    • empty pipeline is created in ODN/UV with provided name and description
    • created pipeline is stored and associated with the dataset
  • clicks 'Edit' button
    • enters ODN/UV canvas pipeline editor
    • structure of the pipeline containing interconected extractor and loader DPUs is displayed and available for configuration
    • configures the building blocks of the pipeline
  • clicks 'Save' button when satisfied 
    • pipeline is stored in ODN/UV

Notes

related MUST requirements for 71

73