Reader

Reader


  1. The Reader in Rubiscape Pipelines is a component used to ingest data from various sources into a pipeline.
  2. It acts as the entry point of the pipeline, enabling users to read structured, semi-structured from files, databases, APIs, cloud storage, or streaming sources.
  3. The Reader ensures smooth data flow into downstream pipeline steps for processing, transformation, analysis, or model execution.

1.  Overview

    The Reader node is responsible for:

    • Connecting to a data source
    • Fetching data in supported formats
    • Converting incoming data to a pipeline-ready dataset
    • Passing the data to the next pipeline component

    Readers are essential because every pipeline starts with a data ingestion step.


2.  Types of Readers in Rubiscape Pipelines

    Rubiscape supports multiple types of readers:

          • File Reader 

          • Database Reader 
          • API Reader 
          • Cloud Storage Reader 
          • File Server Reader
          • Streaming / Queue Reader 

3. Steps to Configure a Reader

  1. Open Rubiscape → Pipelines
  2. Create or edit a pipeline
  3. Drag the Reader node from the Task panel onto the canvas (TaskPane >> Connect >> Reader )
  4. The properties pane on right hand side show below details for reader configuration:

  1. The labels in above screenshot are labelled as below:
1 : Task Name - To update the task name/Reader Name
2 : Data Fields - Option to configure the columns of a Reader
3 : Metadata Refresh - Option to refresh metadata (Column Name Changes/Column Configuration changes)
4 : Filter Condition - Option to configure filtering condition based on logical expression

Note that,
The configured columns as from the Reader will get passed to the successor nodes with same column names and column data type/variable type.

    • Related Articles

    • Reader-level Validation

      The reader-level validation error is displayed when the Reader in the workbook or workflow canvas is not configured. The error occurs for any of the following: No data fields are selected in the Reader in a workbook or workflow. If the dataset is ...

    • Reader-level Validation

      The reader-level validation error is displayed when the Reader in the workbook or workflow canvas is not configured. The error occurs for any of the following: No data fields are selected in the Reader in a workbook or workflow. If the dataset is ...

    • Image dataset as a reader in workbook and workflow

      You can read an added and imported image dataset into the workbook and the workflow. To add and import an image dataset, refer to Adding a Dataset or Importing a Dataset. Reading an image dataset shows you the Name of the image, the Image file path, ...

    • Mapping Variables

      In Rubiscape, you can create, train, test, and publish models for further use in workbooks or workflows. For this, we configure a model using a dataset. When you publish a trained model, it appears in the model section under Model Studio or Machine ...

    • Mapping Variables

      In Rubiscape, you can create, train, test, and publish models for further use in workbooks or workflows. For this, we configure a model using a dataset. When you publish a trained model, it appears in the model section under Model Studio or Machine ...