Batch Processing

UCloud batch processing applications are designed to run based on available resources without requiring end-user interaction. Users should select the relevant set of mandatory and/or optional parameters as if the executable program were initiated in a terminal window. For instance, consider the following command line:

$ fastqc --outdir FastQ-output-dir --extract --svg FastQ-input-dir

The same command can be executed as an instance of the FastQC application, which is available in the UCloud apps catalog. The program options for this specific case can be configured manually from the job submission page or imported via a JSON file, such as the one provided below:

{
    "siteVersion": 3,
    "request": {
        "application": {
            "name": "fastqc",
            "version": "0.12.1"
        },
        "product": {
            "id": "u1-standard-2",
            "category": "u1-standard-h",
            "provider": "ucloud"
        },
        "name": "test",
        "replicas": 1,
        "parameters": {
            "inputdir_var": {
                "type": "file",
                "path": "/45931/FastQC-input-dir",
                "readOnly": false
            },
            "o_var": {
                "type": "file",
                "path": "/45931/FastQ-output-dir",
                "readOnly": false
            },
            "extract_flag": {
                "type": "boolean",
                "value": true
            },
            "svg_flag": {
                "type": "boolean",
                "value": true
            }
        },
        "resources": [
        ],
        "timeAllocation": {
            "hours": 1,
            "minutes": 0,
            "seconds": 0
        },
        "resolvedProduct": null,
        "resolvedApplication": null,
        "resolvedSupport": null,
        "allowDuplicateJob": true,
        "sshEnabled": false
    },
    "resolvedResources": {
        "ingress": {
        }
    },
    "machineType": {
        "cpu": 2,
        "memoryInGigs": 12
    }
}

In this example, the input directory FastQ-output-dir is located within a project workspace on UCloud. The results will be available in the job output folder after the execution is completed.

Note

Batch jobs complete as soon as the executable program ends, provided that the overall execution time is less than the job duration and that sufficient resources are available for the entire runtime.