Submit a Job¶
To initiate a job submission on UCloud, users need to select the application card and configure the required job parameters.
By clicking on the app card, users will be redirected to the job submission page. Here, they will find a brief description of the application along with several parameter fields for job configuration and identification. An example is shown below.
In this page users can also:
Select the application flavor from the menu located on the right side of the app name, when multiple choices are available. This selection might pertain to variations such as different implementations for various providers, optimizations for various programming languages, or the inclusion of different tools.
Choose the version from the drop-down menu located directly beneath the app name. By default, the latest available version of the selected application is automatically selected, if applicable.
Bookmark a particular app by clicking on the star icon below its name. Starred applications can be accessed under Applications in the navigation menu.
Access the application documentation page, by clicking on the
button.
Load parameter values from previous jobs.
Opt to receive email notifications regarding the status of the run.
After filling in the mandatory fields, users can initiate the job by clicking on the
button.
General Settings¶
On the job submission page, users can assign a name to the job, set a time limit, specify a machine type, and configure other parameters/settings specific to each application.
Job lifetime¶
At the top of the application fields, users should indicate the expected time required to complete the run in hours. Providing an accurate estimate of the program execution time is crucial for efficient job scheduling and timely completion.
Note
The time allocation can be extended while the job is in progress.
Machine type¶
Before submitting a job, users must select a machine type, which corresponds to resources on a single node. The selection is made from the available products within the active project and on the chosen provider.
Distributed computing across multiple cluster nodes is only enabled for a few supported applications running on the DeiC Interactive HPC (SDU) provider. For practical use cases, refer to the Spark Cluster and the Terminal Ubuntu apps. In such cases, users must also specify the number of nodes.
After selecting the machine type, both the estimated cost of the run and the current balance are displayed on the right side of the page. If the current balance in the active project is enough to cover the estimated cost of the run, users can proceed with the job submission. However, if the available funds are insufficient, a warning message is displayed along with a button to apply for additional resources.
Note
Choosing a machine with a high number of resources could lead to longer job scheduling times.
Select a folder¶
Users can attach a folder as a data volume inside the application container by utilizing the
button. A dialog box like the one shown below enables users to search through their drives and project spaces.
In addition, several options are available at the top of the box, including the ability to create a new folder or filter Favorites.
The data volumes are mounted within the /work
directory inside the application container, which also serves as the default working tree on UCloud.
Additionally, the same data volumes can be mounted across multiple apps running simultaneously.
Important
Only files and folders located in the default working tree are saved after job completion.
Mandatory parameters¶
Every app is typically configured to run with a given set of options. Mandatory parameters, which are always marked with a *, must be provided before initiating the job.
Optional parameters¶
Optional parameters can be specified by clicking on the
button located on the right side of the Optional Parameters field. The available options depend on the specific app. Some common ones are:
Initialization: Enables users to include a script (
.sh
,.yml
or.txt
file) that runs during the job startup. The initialization can be utilized, for example, to install additional libraries or load conda environments.Batch mode: Allows for batch processing instead of interactive processing. Users must select a script to be executed in batch mode. The script will run automatically when the job starts, without any further interaction required from the user, and will cease execution upon completion of the script.
Modules path: Facilitates automatic loading of environment modules, enabling dynamic modification of the computing environment within the job. Environments modules stored in the selected
Modules path
will automatically be loaded when the job starts.Select a license server: Required for apps that necessitate a software license. To utilize the license, users need to apply for the corresponding resource, see here. Active licenses can be viewed by selecting Licenses under the Resources section of the navigation menu.
Configuration¶
In addition to mandatory and optional parameters, users can customize the app configuration to automatically load parameter values and control access to other apps/services. Some scenarios are discussed below.
Load parameter values¶
App settings can also be configured by loading parameters from a previous run. Clicking the button
will display a window, similar to the one below.
The parameters from the selected run can be imported by clicking on
Alternatively, users can search for a specific run name using the search button: .
Upon clicking on a list item, several options appear at the top of the window.
The options include the possibility of running the application again with the same parameters or importing parameter values using one of previous job's JobParameters.json
file.
This file can either be uploaded from the user's computer or selected directly from a directory on UCloud.
Clicking on Properties instead redirects the user to the progress view page, which summarizes information about the job status, allocated resources etc. The progress view page is also accessible from the Runs section of the navigation menu by clicking on the job name.
Configure SSH access¶
Some applications initiate an SSH server to encrypt and secure data transfer from a remote host, provided that a valid SSH public key is imported on UCloud. The SSH key can be configured using the corresponding panel under the Resources section of the navigation menu.
After the application is launched, a new panel appears in the job progress view displaying the SSH login command. This functionality is only available to the DeiC interactive HPC (SDU) provider.
Configure custom links¶
This feature enables the creation of public URLs to provide external access to applications through a web interface. It is exclusively available for interactive apps. This functionality can be utilized, for instance, to share dashboard apps hosted on UCloud. Multiple public URLs can be established within the same job session.
To create a new link, click on the
button and select a product, as shown below:
The same actions can be performed by selecting Links from the Resources section of the navigation menu. On this page, the status of the link and the associated job number are highlighted on the right side of the link name.
Note
The public URL will remain accessible as long as the job is running.
Attach public IP addresses¶
This option is used to attach a static IP address to an app deployed on UCloud, enabling access to the app via an external client. Public IPs may be used to deploy server applications.
To register a new IP address, users should click the button
and choose a product.
The IP address is unique: It is not possible to select the same IP for multiple job sessions running at the same time.
After the IP address is allocated, users can configure the protocol (TCP/UDP) and the corresponding port number by clicking on the address or selecting Properties from the address navigation menu. The protocol can also be configured from the Resources section of the navigation menu.
This functionality is only available to the DeiC interactive HPC (SDU) provider.
Important
Enabling this feature allows anyone with the IP to access the application. Measures must be implemented to ensure that the application is adequately protected.
Connect to other jobs¶
This feature enables the utilization of services from other jobs, including networking and shared application file systems. By clicking on the
button, users can can choose the ID of a running job and set a hostname parameter, which assigns an IP address to the node where the selected job is executed.
Contents