Settings
Name | Type | Description |
---|---|---|
recursive | boolean | Determines whether sub-folders should be scanned recursively for content. |
pattern_matching | enum wildcard regex | The type of pattern matching to use. default: wildcard |
wildcard | string | The wildcard value to search for. For example *.mov will only copy mov files. default: * |
regex | string | The regular expression to be used for pattern matching. |
files_per_job | integer | The maximum number of files to be copied in each job. The default is 1 file per job. minimum: 1 maximum: 100 |
Example settings
{
"uid": "folder_enum_task",
"kind": "folder_enum",
"payload": {
"source": {
"storage_provider": "s3",
"url": "s3://my_source_bucket/my_source_folder"
},
"settings": {
"pattern_matching": "wildcard",
"wildcard": "*.mov",
"recursive": false
}
}
}