Cloud Pipeline - Manual
- 1. Quick start
- 2. Getting started
- 3. Overview
- 4. Manage Folder
- 5. Manage Metadata
- 6. Manage Pipeline
- 7. Manage Detached configuration
- 8. Manage Data Storage
- 9. Manage Cluster nodes
- 10. Manage Tools
- 11. Manage Runs
- 12. Manage Settings
- 12.1. Add a new system event
- 12.2. Edit a system event
- 12.3. Create a new user
- 12.4. Edit/delete a user
- 12.5. Create a group
- 12.6. Edit a group/role
- 12.7. Delete a group
- 12.8. Change a set of roles/groups for a user
- 12.9. Change email notification
- 12.10. Manage system-level settings
- 12.11. Advanced features
- 12.12. System logs
- 13. Permissions
- 14. Command-line interface (CLI)
- 15. Interactive services
- 16. Issues
- 17. CP objects tagging by additional attributes
- 18. Home page
- Appendix A. Instance and Docker container lifecycles
- Appendix B. Working with a Project
- Appendix C. Working with autoscaled cluster runs
- Appendix D. Costs management
- Appendix E. Pipeline objects concept
- Appendix F. Сomparison of using different FS storage types
1. Quick start
This chapter will give you a basic knowledge of pipeline running procedure.
2. Getting started
Find Thesaurus, list of supported browsers and authentication details.
Get familiar with a Cloud Pipeline Graphical User Interface (GUI).
4. Manage Folder
Learn how you can create your own hierarchical structured space.
5. Manage Metadata
Learn how you can create a complex analysis environment using custom data entities.
6. Manage Pipeline
Get details on pipeline creation, configuration, and launching. Get descriptions of "Launch pipeline" page. There is also a description of graphical "Pipeline builder" for WDL pipelines.
7. Manage Detached configuration
Learn how to run a cluster of differently configurated instances. "Launch cluster" box vs LaunchofClusterconfiguration.
8. Manage Data Storage
Create a new storage and learn how to manage it: download and upload, copy, move data, delete and unregister storages.
9. Manage Cluster Nodes
Learn about active nodes, how to terminate and refresh them. Get familiar with a related dashboard.
10. Manage Tools
Add and edit Docker registry. Learn how to add, modify and launch Tools.
11. Manage Runs
Learn about Runs space and what information you can get from it.
12. Manage Settings
Here you can find information about: how to install CLI, add a new system event, managing roles.
Learn how to manage permissions for Cloud Pipeline objects.
14. Command-line interface (CLI)
Get familiar with a Cloud Pipeline Command Line Interface (CLI).
15. Interactive services
Learn how to setup non-batch application in a cloud infrastructure and access it via a web interface.
Learn how to share results with other users or get feedback.
17. CP objects tagging by additional attributes
Learn how to manage custom sets of "key-values" attributes for data storage and files.
18. Home page
Get details about homepage widgets, how to configure homepage view.
Appendix A. Instance and Docker container lifecycles
Learn basics about instance and Docker container lifecycle.
Appendix B. Working with a Project
Learn basics about working with a Project.
Appendix C. Working with autoscaled cluster runs
Learn basics about working with autoscaled cluster runs.
Appendix D. Costs management
Get details about costs management concept.
Appendix E. Pipeline objects concept
Get details about the Pipeline objects concept in Cloud Pipeline environment.
Appendix F. Сomparison of using different FS storage types
Get details about the comparison of using different FS storage types (FSx for
Lustre / EFS in
AWS / BTRFS on
EBS / LizardFS on
EBS) in Cloud Pipeline environment.