File Management | |||
Description | File management allows you to manage files in different types of storage like GCP, Azure, S3, MinIO and File Server. You are allowed to perform various operations like create, copy & paste, zip, Rename, Delete, cut & paste, wait, and unzip using file management. | ||
Why to use |
| ||
When to use |
| When not to use | When source files are not on a cloud server. |
Prerequisites | You should know the required credentials to connect to the server. | ||
Input | File and File action | Output | Action performed on the file. |
Statistical Methods used | - | Limitations | - |
File Management is located in the left task pane under Model Studio in Data Preparation. Use the drag-and-drop method to use the algorithm in the canvas.
The table below describes different fields present in the properties of File Management.
Field | Description | Remark |
---|---|---|
Task Name | It is the name of the task selected on the workbook canvas. |
|
Cloud Storage | It allows you to select cloud storage like GCP, Azure, S3, MinIO and File Server. |
|
Cloud connection | It allows you to enter the user credentials. These details are used to connect to the cloud storage. | You can enter the credentials depending on cloud storage. Following are various options depending upon the cloud storage.
|
File Operation | Different file operations are displayed in the list. | You need to select either one of the operations
|
Configure | It allows you to configure the different parameters for the action | Different parameters for the action are explained in detail in Configure section |
Node Configuration | It allows you to select the instance of the AWS server to provide control over the execution of a task in a workbook or workflow. | For more details, refer to Worker Node Configuration. |
As the name suggests, this action copies a file from one location to another. The following is the list of the configuration parameters for this action. You need to specify the following.
As the name suggests, this action cuts a file from one location and copies it to another location. The following is the list of the configuration parameters for this action. You need to specify the following.
The default section is Fail the task
The Suffix, Prefix dropdown appears next to the Textbox. If you add select Suffix then the text will be added after the existing file name else it will be added before. The default option is Suffix.
This action creates an empty file in the specified location.
The following is the list of the configuration parameters for this action. You need to specify the following.
This action deletes the specified file.
The following is the list of the configuration parameters for this action. You need to specify the following.
This action zips a file or folder. The following is the list of the configuration parameters for this action. You need to specify the following.
The Suffix, Prefix dropdown appears next to the Textbox. If you add select Suffix then the text will be added after the existing file name else it will be added before. The default option is Suffix.
The default selection is Fail
The default selection is Do Nothing
The following figure displays the configuration parameters for this action.
This action Unzip the zip file.
The following is the list of the configuration parameters for this action. You need to specify the following.
The Suffix, Prefix dropdown appears next to the Textbox. If you add select Suffix then the text will be added after the existing file name else it will be added before. The default option is Suffix.
The default selection is Do Nothing
The following figure displays the configuration parameters for this action.
This action waits for a file for a specified time at a specified location. The system sends success once the file is located at the specified location. The following is the list of the configuration parameters for this action. You need to specify the following.
The default option is to Fail the task providing failure output
The following figure displays the configuration parameters for this action.
Rename
This action Renames the file. The following is the list of the configuration parameters for this action. You need to specify the following.
The Suffix, Prefix dropdown appears next to the Textbox. If you add select Suffix then the text will be added after the existing file name else it will be added before. The default option is Suffix.
The system sends a Success when it is successful to rename the file else it sends a Fail message.
The following figure displays the configuration parameters for this action.
Note: | In the source file name, you can access all the files using '{*}'. For example, using *.xlsx, you can match all the datasets with this extension. Hence, all of these datasets will be verified. |