12. Manage Settings

System Settings consist of CLI, System events, User management, Email notifications, Preferences, Cloud Regions and System logs tabs.
To open System Settings click the gear icon on the main menu in the left side of the Cloud Pipeline application:

CP_ManageSettings

CLI tab

"CLI" tab generates two types of CLI installation and configuration commands to set CLI for the Cloud Pipeline - Pipe CLI and Git CLI. You can select each of them by click the corresponding option in the "CLI" tab menu.

Pipe CLI

CP_ManageSettings

Control Description
Operation system Choose an operation system from drop-down list and the instruction how to install the Cloud Pipeline CLI will appear in the window below.
Generate access key Generates access token to be used by CLI.
Valid till A date access key expires.

For more details see 14.1. Install and setup CLI.

Git CLI

CP_ManageSettings

Here you can see instructions how to configure your Git client to work with the Cloud Pipeline.


System events

This tab is visible only for users with the ROLE_ADMIN role.

System events tab represents system events notifications. Here you can create, edit, delete system events notifications.
System events notifications are organized into a table. It represents the body of the notification, its severity status ("info", "warning" or "critical") and date of creation, activity status.
Note: Variants of activity status:

  • Blocking event emerges in the middle of the window and requires confirmation from the user to disappear.
  • Active notifications will be shown for all users of the Cloud Pipeline until admin sets them inactive.

Administrator can edit and delete notifications via corresponding buttons.
CP_ManageSettings

System events controls

Controls are at the top right of the table.

Control Description
1 Expand/Collapse This button shows/hides the body of the event.
2 Refresh To refresh a list of notifications.
3 + ADD To create a new notification.
4 Edit To open the edit form for the event.
5 Delete To delete an event.

For more detais see 12.1. Add a new system event.


User management

This tab is visible only for users with the ROLE_ADMIN role or the ROLE_USER_READER role.

The User management tab helps to manage user groups and system roles.

To grant or refuse permissions to a specific group of users (e.g. project team members), you can just create a user group and grant or refuse permissions to the specific set of objects to the whole group.
System roles is one of the principal tool for managing security access to the objects. Even if you have WRITE permission for a folder object, you might be not able to create a pipeline there, if you don't have the ROLE_PIPELINE_MANAGER role.
Note: About permissions, you can read more here.

User management consists of the following subtabs: Users, Groups, Roles, Usage report.

Users

This table view displays a list of users and their additional information:

  • Name - an authenticated domain account (SAML/OAuth/OpenID), e.g. e-mail.
  • Groups - a set of groups assigned to a user. It could be whether CP's user's groups and groups, given to each user automatically by SSO authentication system.
    Note: automatically created groups based on SSO authentication system are light-grey colored.
  • Roles - a set of system roles assigned to a user.

Additionally, near the name user's state is shown. Possible states:

  • Online - for users who are logged in and use the Platform in the moment
    CP_ManageSettings
  • Offline - for users who are not logged in at the moment/do not use the Platform for some time
    CP_ManageSettings

By hover over the Offline icons - the tooltip will be shown that contains the info when the specific user has utilized the Platform the last time, e.g.:
CP_ManageSettings

Please note, that users' states are visible only for user with the ROLE_ADMIN role.

Users tab controls

CP_ManageSettings

Control Description
1 Search field Field to search a particular user from a list of users.
2 Show users This control allows to filter which users to show in the list:
CP_ManageSettings
  • all (by default)
  • only blocked users. More details about blocking/unblocking see here
  • only online users - i.e. users that are working at the Platform in the current moment
  • only users that exceeded any spending quota
3 + Create user By click this button, the "Create user" form will be opened - to create a new user. More details see here.
4 Import users Allows to import users from the list in .csv format.
5 Export users Allows to export all users with selected set of attributes. More details see below.
6 Edit Allows to change a list of roles/groups assigned to a user. More details see here.

Export users

The Export users button allows administrator to export user list in .csv format.
CP_ManageSettings

There are 2 export options:

  1. Default configuration
    In this case, the file with all users and full list of their properties (ID, username, attributes (first and last name, email), registration date, first login date, list of groups, list of roles, blocked/unblocked state, default data storage) will be downloaded to the local workstation.
    To export full user list with default configuration:
    • click the Export users button in the right upper corner of the Users tab in the User management dashboard
      CP_ManageSettings
      or
    • hover the v button next to the Export users button and click the Default configuration item in the appeared drop-down menu
      CP_ManageSettings
  2. Custom configuration
    Custom configuration allows admins to select which user properties should be downloaded:
    • hover the v button next to the Export users button and click the Custom configuration item in the appeared drop-down menu
      CP_ManageSettings
    • the modal window with the list of available user properties to export will appear, e.g.:
      CP_ManageSettings
      User can select any set of attributes by marking/unmarking corresponding checkboxes. At least 1 checkbox should be marked to export user list.
      "Fields" section contains the list of all users' attributes (by default, all attributes are selected).
      "Metadata" section contains the list of all users' metadata attributes (by default, all attributes are deselected).
      Note: enabled Header checkbox adds the headers row into the exporting file.
    • to download the result file with full user list and custom set of their properties click the Download CSV button.

Note: not all user's metadata have to be exported. Some of them may contains the sensitive data. To restrict the list of the metadata to export the following system preference should be used - misc.metadata.sensitive.keys. In this preference, all metadata keys that shouldn't be exported are being specified (i.e. if these metadata keys are specified in the preference, they will not be displayed at the export pop-up for selection).

Example of that configured preference:
CP_ManageSettings

Groups

The "Groups" subtab shows a set of user groups created in CP. Here you can grant or refuse users in a group membership.
Note that this tab displays groups created in CP only, not given by SSO authentication system.

CP_ManageSettings

Groups tab controls

Control Description
1 Search field To search a particular group from a list of groups.
2 + Create group To create a new group. More details see here.
3 Edit This control allows to change a list of users owning this group. More details see here.
4 Delete Delete a group. More details see here.

Roles

The "Roles" subtab shows a set of predefined system roles that couldn't be extended or reduced. Here you can grant or refuse users in a role.
CP_ManageSettings

There is a list of Cloud Pipeline system roles:

Role Description
ROLE_ADMIN User gets Read/Write/Execute/Owner permissions to all objects in the Platform.
Note: The owner of the object can manage its Access Control List. OWNER property is assigned to a user has created an object by default.
ROLE_USER Basic user.
ROLE_ADVANCED_USER Allows to use friendly URLs for runs.
ROLE_ALLOW_ALL_POLICY By default, users can connect from own run to any other own run.
This role allows users to connect from own run to any run of that user or other users (in case of corresponding permissions on such runs).
ROLE_ANONYMOUS_USER Specific role for the ability of sharing interactive runs endpoints to the anonymous users.
Note:anonymous users - users, who have successfully passed the IdP authentication but are not registered in the Cloud Pipeline Platform.
ROLE_BILLING_MANAGER Users who are granted this role are able to view the whole Billing reports info of the platform (as if they were admins).
ROLE_CONFIGURATION_MANAGER Allows to create/delete Cluster Configurations (given to each user by default).
ROLE_DTS_MANAGER Allows to manage data transfer service.
ROLE_ENTITIES_MANAGER  Allows to create/delete Entities.
ROLE_FOLDER_MANAGER Allows to create/delete Folders (given to each user by default).
ROLE_PIPELINE_MANAGER Allows to create/delete Pipelines (given to each user by default).
ROLE_SERVICE_ACCOUNT Adds no extra permissions. But accounts with this role are not being blocked by LDAP.
ROLE_STORAGE_ADMIN User gets Read/Write/Owner permissions to all data storages in the Platform.
ROLE_STORAGE_ARCHIVE_MANAGER Allows to manage storages lifecycle processes.
ROLE_STORAGE_ARCHIVE_READER Allows read-only access to storages lifecycle info.
ROLE_STORAGE_MANAGER Allows to create/delete Data Storages.
ROLE_STORAGE_TAG_MANAGER Allows to manage storage attributes.
ROLE_TOOL_GROUP_MANAGER Allows to create/delete Tool groups.
ROLE_VERSIONED_STORAGE_MANAGER Allows to create/delete Versioned Storages.
ROLE_USER_READER Allows read-only access to the users, groups, roles information and export users feature.
ROLE_USER_METADATA_READER Allows read-only access to the users metadata. Additional to the role ROLE_USER_READER.

Set of user's roles combined with permission settings defines allowed actions for the user and therefore the layout of GUI buttons. A user sees GUI options in appliance with his rights.
Note: roles 6-12 are being checked if a user has WRITE permission for the parent object.

Roles tab controls

Control Description
Search field To search particular group from a list of roles, start to enter the role name (see the picture above, 1).
Edit Allows changing a list of users assigned the role (see the picture above, 2). More details see here.

Usage report

The "Usage report" subtab shows the Platform's statistics of users activity.
At this subtab, the summary info about total count of Platform users that were online at different time moments during the certain period is displayed in a chart form:
CP_ManageSettings

Usage report tab controls

Control Description
1 Calendar control To select a specific day/month from the calendar.
2 Period selector To select the type of period of view - day (by default) or month.
3 User filter To restrict the displayed data by specific user(s) or user group(s)/role(s). Multiselect is supported
Day period

By default, the day report is generated for the today (see example on the picture above).
You can select another day to view statistics by the Calendar control.

Report contains the chart with the average count of the Platform users that were online in the selected day - by hours division.

By click any point - info tooltip appears including the time moment and the full list of users that were online in this moment, e.g.:
CP_ManageSettings

Month period

By default, the month report is generated for the current month.
You can select another month to view statistics by the Calendar control.

There are 2 possible views for the month period:

  • Average (default) - chart shows the number of the Platform online users by days division in the selected month.
    For each day, the count of online users is being calculated as median value between all hourly values:
    CP_ManageSettings
  • Unique - chart shows the summary number of the unique Platform online users by days division during the selected month.
    For each day, the count of users is being calculated as summary accumulative count of the unique Platform online users at the end of the day:
    CP_ManageSettings
    By click any point - info tooltip appears including the date and the full list of unique users that were online in this day, e.g.:
    CP_ManageSettings

Email notifications

This tab is visible only for users with the ROLE_ADMIN role.

The email notifications helps to keep track of what's happening in the Cloud Pipeline. On the left you can see a list of the email notification templates.

CP_ManageSettings

Email notifications tab controls

Control Descriptions
Enabled checkbox If set, email distribution of the selected type will be enabled.
Keep admins informed checkbox If set, all emails with such type will be sent to all users with ROLE_ADMIN role.
Keep owners informed checkbox If set, all emails with such type will be sent to the OWNERS of the corresponding Cloud Pipeline objects.
Informed users text field Select users that will get such email types.
Threshold text field Amount of seconds that is required for the process to generate email.
Resend delay text field Amount of seconds that is required for the process to generate a repeat email notification on that subject.
Subject text field Email notification subject.
Body text field Body of the email notification.
Revert button Return an email settings to the previous unsaved state.
Save button Saves current email notification settings.

CP_ManageSettings

Also you can switch from the Edit to the Preview mode to see how the Subject and the Body of the email notification will actually look:
CP_ManageSettings

Templates

Note: this is the current list of notification templates. It might be extended in the future.

Notification type Description
BILLING_QUOTA_EXCEEDING tells that billing quota is higher than a threshold value
DATASTORAGE_LIFECYCLE_ACTION tells that datastorage lifecycle event (data transition) is approaching or has happened
DATASTORAGE_LIFECYCLE_RESTORE_ACTION tells that datastorage lifecycle event (data restoring) has happened
FULL_NODE_POOL tells that all nodes of some node pool(s) are already in use
HIGH_CONSUMED_RESOURCES tells that memory or disk consuming is higher than a threshold value for a specific period of time
IDLE_RUN tells that the job is idle for a long time
IDLE_RUN_PAUSED tells that the job was paused because it was idle for a long time
IDLE_RUN_STOPPED tells that the job was stopped because it was idle for a long time
INACTIVE_USERS tells that some users are not active for a long period of time
LDAP_BLOCKED_USERS tells that specific users were blocked in the Platform due to their blocking in LDAP
LONG_INIT tells that the job is initializing for a long time
LONG_PAUSED tells that the job has been paused for a long time
LONG_PAUSED_STOPPED tells that the job, that has been paused for a long time, is stopped at the moment
LONG_RUNNING tells that the job is running for a long time
LONG_STATUS tells that the job is been waiting in a certain status for a long time
NEW_ISSUE notifies about new issue
NEW_ISSUE_COMMENT tells that an issue was commented
PIPELINE_RUN_STATUS notifies about current pipeline status
STORAGE_QUOTA_EXCEEDING tells that a storage has reached volume consumption threshold

Preferences

This tab is visible only for users with the ROLE_ADMIN role.

The Preferences tab contains different global settings for the Cloud Pipeline. These settings determine default behavior of the Cloud Pipeline.
On the left you can see a set of sections. Each section contains a list of global settings. See more information here.

CP_ManageSettings


Cloud Regions

This tab is visible only for users with the ROLE_ADMIN role.

The Cloud Regions tab contains different settings for the specific Cloud Regions and Cloud Providers.
You could manage regions, add or remove them from the Cloud Pipeline.

CP_ManageSettings


System dictionaries

This tab is visible only for users with the ROLE_ADMIN role.

The System dictionaries tab contains the list of predefined "dictionaries" - sets of "key-value(s)" that could be used by admins when configuring Cloud Pipeline objects attributes (metadata).

For example, admins have to set attributes (metadata) for "general" users manually. In case, when such metadata keys aren't different for each user and has certain amount of values, it is convenient to select these values from the predefined values list, not to specify them manually each time.

Each dictionary is the categorical attribute. I.e. it is attribute which values are predefined. Each dictionary has its name and values:
CP_ManageSettings
If the dictionary exists in the system, then admin can use it when specifying attributes for any Platform object (Pipeline, Folder, Storage, Project, Tool), and also for User, Group or Role. In this case, it is enough to specify only the dictionary name as the attribute key, the list of dictionary values will appear automatically in the value field:
CP_ManageSettings

Also, the different dictionaries may be connected (linked). I.e. admins can create two dictionaries, which values are mapped 1-1 or 1-many, e.g.:
CP_ManageSettings
CP_ManageSettings
CP_ManageSettings

In the GUI, such connection is being handled in the following way:

  1. Admin specifies the links between the dictionaries items (e.g. for the example above ProjectID:BRCA1 -> DataStorage:<path>).
  2. Links have the "autofill" attribute. If the admin selects the source key (ProjectID:BRCA1) as attribute key for any object - the destination key will be specified automatically (DataStorage will be added with the <path> selection):
    CP_ManageSettings
    CP_ManageSettings

For more details see here.

Note: all functionality described above is available only for admins. "General" users can't view/edit System Dictionaries. If non-admin user tries to specify any existing dictionary as the attribute "Key" - it will be displayed as plain text attribute. No dictionary values will be loaded/displayed.


System management

This tab is visible only for users with the ROLE_ADMIN role.

The System management tab includes several possibilities to configure/observe the Platform deployment in general.

System logs

The System logs subtab contains the following audit trail events:

  • users' authentication attempts
  • users' profiles modifications
  • platform objects' permissions management
  • access to interactive applications from pipeline runs
  • access to the data stored in the object storages
  • management of the transition rules for storages lifecycle
  • other platform functionality features

CP_ManageSettings

For more details see here.

NAT gateway

The NAT gateway subtab allows to configure network routes.
This is nessasary when the Cloud Pipeline Platform is deployed in some private subnet and the admin needs to expose a network endpoint for some service.
Via this form, admins can create/remove network routes from private subnet(s) to the external network resources.

The NAT gateway subtab contains:

  • the list of existing routes (port forwarding map). Each route record contains:
    • info about external resources
    • info about corresponding internal config (mapping details)
    • comment
  • controls to manage the routes list (add/remove/save etc.)

CP_ManageSettings

For more details see here.


My profile

The My profile tab allows:

  • to view main info about the current user
  • to configure the view of the Platform pages (for the current user)

Profile

The Profile subtab allows to view the following info for the current loginned user:

  • registration user info (username, name, last name, etc.)
  • roles assigned to the user
  • user attributes (metadata)

CP_ManageSettings

Appearance

The Appearance subtab allows to select the UI theme(s) - to configure the view of the Platform pages for the current user.

User can select a single theme that will always shown:
CP_ManageSettings

Or configure synchronization with system preferences and automatically switch between day and night themes:
CP_ManageSettings