Description
I want to define a pipeline that downloads the data from a remote server and publishes it as resource in ODN so that I can periodically republish data from a remote location and also use this dataset in other pipelines without downloading same data again from a remote location
Preconditions
- at least one catalog record is created in internal catalog
- non associated pipeline with name "Mirror" exists
How to do it:
clicks on dataset 'Name' in the list of internal catalog records
- clicks 'Manage' button
- selects 'Pipelines' tab
- list of all pipelines associated with the dataset is displayed
- clicks '+' button
- clicks 'Create a modified copy of existing pipeline' radio button
- clicks 'Next' button
- list of all existing pipelines is displayed
- selects and clicks pipeline with name 'Mirror' in the list
- pipeline description is displayed when pipeline is selected
- clicks 'Create a copy' button
- fills in the name of a new pipeline
- fills in the description of a new pipeline
- clicks 'Next' button
- empty pipeline is created in ODN/UV with provided name and description
- created pipeline is stored and associated with the dataset
- clicks 'Edit' button
- enters ODN/UV canvas pipeline editor
- structure of the pipeline containing interconected extractor and loader DPUs is displayed and available for configuration
- configures the building blocks of the pipeline
- clicks 'Save' button when satisfied
- pipeline is stored in ODN/UV
Requirements
TODONotes
related MUST req. requirements for 71
73