{"id":11516,"date":"2024-07-16T10:18:37","date_gmt":"2024-07-16T10:18:37","guid":{"rendered":"https:\/\/hri.bigzero.co.in\/?page_id=11516"},"modified":"2024-10-29T13:28:15","modified_gmt":"2024-10-29T13:28:15","slug":"hri-hpc-documentation","status":"publish","type":"page","link":"https:\/\/harish.bigzero.co.in\/hi\/hri-hpc-documentation\/","title":{"rendered":"HRI-HPC Documentation"},"content":{"rendered":"
\n\t\t\t\t
\n\t\t
\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t

HRI-HPC Documentation<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t
\n\t\t\t\n\t\t\t\t\t\t<\/span>\n\t\t<\/div>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t
\n\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t

Documentation section contains information about the resources that make up HPC, as well as details about HPC\u00b4s operating system and special packages\/software that have been used on HPC resources. This section also focuses on jobs computation on HPC, and also provides information on storage. All that information will be needed to create and run compute jobs on HPC-Cluster, as well as using NAS storage\/space,and Licensed\/Open source software that can be used only on HPC resources.

Topics covered in the Documentation section include:<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

\n\t\t\t\t
\n\t\t\t\t\t

Operating System used in respective Clusters<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t
\n\t\t\t\n\t\t\t\t\t\t<\/span>\n\t\t<\/div>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t

We are using ROCKS 6.0 based on a customized distribution of Community Enterprise Operating System (CentOS). CentOS 6.0 Update 2 is a high-quality Linux distribution that gives HPC complete control of its open-source software packages and is fully customized to suit HPC research needs, without the need for license fees.

CentOS is modified for minor bug fixes and desired localized behavior. Many desktop and clustering-related packages were also added to our CentOS installation.<\/p>

Getting Help<\/b><\/p>

A number of white papers, tutorials, FAQs and other documentation on CentOS can be found on the\u00a0official CentOS website.<\/a><\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

\n\t\t\t\t
\n\t\t\t\t\t

Useful OS commands<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t
\n\t\t\t\n\t\t\t\t\t\t<\/span>\n\t\t<\/div>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t
\n\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t
  • ls<\/span>: list information about the Files<\/li><\/ul>

    Option<\/span><\/p>

    • -l<\/span>: list information about the Files<\/li>
    • -t<\/span>: sort by modification time.<\/li>
    • -h<\/span>: print sizes in human readable format.<\/li>
    • -a<\/span>: list hidden files.<\/li>
    • du<\/span>: estimates file space usage.<\/li>
    • df<\/span>: report filesystem disk space usage.<\/li>
    • top<\/span>: display Linux tasks.<\/li>
    • ps<\/span>: report a snapshot of the current processes.<\/li><\/ul>

      Option<\/span><\/p>

      • -e<\/span>: all processes.<\/li>
      • -f<\/span>: full.<\/li>
      • tail<\/span>: outputs the last part of files. (Used when Library linking issues arise. explained in troubleshooting page)<\/li>
      • ssh[node name]<\/span>: outputs the last part of files. (Used when Library linking issues arise. explained in troubleshooting page)<\/li><\/ul>

        Option<\/span><\/p>

        • X<\/span>: for X forwarding.<\/li><\/ul>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
          \n\t\t\t\t
          \n\t\t\t\t\t

          Shell Environment<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
          \n\t\t\t\t
          \n\t\t\t\t\t\t\t
          \n\t\t\t\n\t\t\t\t\t\t<\/span>\n\t\t<\/div>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
          \n\t\t\t\t
          \n\t\t\t\t\t\t\t\t\t

          All the programs that run under Linux are called as processes. Processes run continuously in Linux and you can kill or suspend different processes using various commands. When you start a program a new process is created. This process runs within what is called an environment. This particular environment would be having some characteristics which the program\/process may interact with. Every program runs in its own environment. You can set parameters in this environment so that the running program can find desired values when it runs.<\/p>

          Setting a particular parameter is as simple as typing\u00a0VARIABLE=value<\/code><\/span>. This would set a parameter by the name\u00a0VARIABLE<\/span><\/code>\u00a0with the value that you provide.<\/p>

          PATH<\/code><\/span>\u00a0is an environmental variable in Linux and other Unix-like operating systems that tells the shell which directories to search for executable files (i.e., ready-to-run programs) in response to commands issued by a user. It increases both the convenience and the safety of such operating systems and is widely considered to be the single most important environmental variable.<\/p>

          To see a list of the environment variables that are already set on your machine, type the following<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

          \n\t\t\t\t
          \n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\"HRI-HPC\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
          \n\t\t\t\t
          \n\t\t\t\t\t\t\t\t\t

          This would produce a long list. Linux by default sets many environment variables for you. You can modify the values of most of these variables. A few of the variables that are set are\u00a0env | grep PATH<\/code><\/span>.<\/p>

          Another way to view the contents of just\u00a0PATH<\/code>\u00a0alone is by using the echo command with\u00a0$PATH<\/span>\u00a0<\/code>as an argument:<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

          \n\t\t\t\t
          \n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\"HRI-HPC\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
          \n\t\t\t\t
          \n\t\t\t\t\t\t\t\t\t

          Each user on a system can have a different\u00a0PATH<\/span>\u00a0<\/code>variable.\u00a0PATH<\/code><\/span>\u00a0variables can be changed relatively easily. They can be changed just for the current login session, or they can be changed permanently (i.e., so that the changes will persist through future sessions).<\/p>

          It is a simple matter to add a directory to a user’s\u00a0PATH<\/span>\u00a0<\/code>variable (and thereby add it to the user’s default search path). It can be accomplished for the current session by using the following command, in which directory is the full path of the directory to be entered:<\/p>

          Another way to view the contents of just\u00a0PATH<\/code>\u00a0alone is by using the echo command with\u00a0$PATH\u00a0<\/code>as an argument:<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

          \n\t\t\t\t
          \n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\"HRI-HPC\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
          \n\t\t\t\t
          \n\t\t\t\t\t\t\t\t\t

          For example, to add the directory\u00a0\/usr\/bin<\/code><\/span>, the following would be used:<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

          \n\t\t\t\t
          \n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\"HRI-HPC\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
          \n\t\t\t\t
          \n\t\t\t\t\t\t\t\t\t

          An alternative is to employ the export command, which is used to change aspects of the environment. Thus, the above absolute path could be added with the following two commands in sequence<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

          \n\t\t\t\t
          \n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\"HRI-HPC\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
          \n\t\t\t\t
          \n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\"HRI-HPC\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
          \n\t\t\t\t
          \n\t\t\t\t\t\t\t\t\t

          or its single-line equivalent.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

          \n\t\t\t\t
          \n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\"HRI-HPC\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
          \n\t\t\t\t
          \n\t\t\t\t\t\t\t\t\t

          That the directory has been added can be easily confirmed by again using the echo command with\u00a0$PATH<\/span>\u00a0<\/code>as its argument.<\/p>

          An addition to a user’s PATH variable can be made permanent by adding it to that user’s\u00a0.bash_profile<\/code><\/span>\u00a0file.\u00a0.bash_profile<\/code><\/span>\u00a0is a hidden file in each user’s home directory that defines any specific environmental variables and startup programs for that user. Thus, for example, to add a directory named \/usr\/test to a user’s\u00a0PATH<\/span><\/code>\u00a0variable, it should be appended with a text editor to the line that begins with\u00a0PATH<\/code><\/span>\u00a0so that the line reads something like\u00a0PATH=$PATH:$HOME\/bin:\/usr\/test<\/code><\/span>. It is important that each absolute path be directly (i.e., with no intervening spaces) preceded by a colon.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

          \n\t\t\t\t
          \n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\"HRI-HPC\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
          \n\t\t\t\t
          \n\t\t\t\t\t\t\t\t\t

          would set the home directory to\u00a0\/home\/clusterhri<\/code><\/span>. This is perfect in case your login name is\u00a0amit<\/code><\/span>\u00a0and you have been given a directory named\u00a0\/home\/amit<\/code><\/span>\u00a0. In case you don’t want this to be your home directory but some other one you could indicate so by typing the new directory name. The HOME directory is always the directory that you are put in when you login.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

          \n\t\t\t\t
          \n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\"HRI-HPC\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
          \n\t\t\t\t
          \n\t\t\t\t\t\t\t\t\t

          or<\/strong><\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

          \n\t\t\t\t
          \n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\"HRI-HPC\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
          \n\t\t\t\t
          \n\t\t\t\t\t\t\t\t\t

          There are many advantages of using the\u00a0\u0918\u0930<\/span><\/code>\u00a0<\/span>variable. You can always reach your home directory by only typing cd at the prompt, irrespective of which directory you are presently within. This would immediately transfer you to your HOME directory. Besides in case you write scripts that have\u00a0$HOME<\/span><\/code>\u00a0present in them to refer to the current HOME directory, these scripts can be used by other users as well since\u00a0$HOME<\/code><\/span>\u00a0in their case would refer to their home directories.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

          \n\t\t\t\t
          \n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\"HRI-HPC\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
          \n\t\t\t\t
          \n\t\t\t\t\t\t\t\t\t

          This is a very important environment variable. This sets the path that the shell would be looking at when it has to execute any program. It would search in all the directories that are present in the above line. Remember that entries are separated by a\u00a0:<\/code>. You can add any number of directories to this list. The above 3 directories entered is just an example.<\/p>

          Note :<\/b>The last entry in the PATH command is a\u00a0.\u00a0<\/code>(period). This is an important addition that you could make in case it is not present on your system. The period indicates the current directory in Linux. That means whenever you type a command, Linux would search for that program in all the directories that are in its PATH. Since there is a period in the\u00a0PATH<\/code><\/span>, Linux would also look in the current directory for program by the name (the directory from where you execute a command). Thus whenever you execute a program which is present in the current directory (maybe some scripts you have written on your own) you don’t have to type a\u00a0.\/programname<\/code>.<\/span> You can only type\u00a0programname<\/span>\u00a0<\/code>since the current directory is already in your\u00a0PATH<\/code>.<\/span><\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

          \n\t\t\t\t
          \n\t\t\t\t\t

          Storage available with NAS<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
          \n\t\t\t\t
          \n\t\t\t\t\t\t\t
          \n\t\t\t\n\t\t\t\t\t\t<\/span>\n\t\t<\/div>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
          \n\t\t\t\t
          \n\t\t\t\t\t\t\t\t\t

          100TB of disk storage using a high-performance parallel file system, which is tuned for both large volume storage and fast access in a secure computing environment. The system supports large-scale and rapid data analytics.
          The disk system is backed by a tape archive and hierarchical storage management (HSM) system that adds an additional 100TB of storage capacity for long-term data preservation and backup.<\/p>

          You can check available locations from\u00a0clpc00<\/code>,\u00a0cluster1<\/code><\/span>\u00a0and master nodes of clusters using\u00a0df -h<\/code>.<\/span>
          \/scratch6<\/code>,\u00a0\/c7scratch<\/code>,\u00a0\/c8scratch<\/code>\u00a0and\u00a0\/c9scratch<\/code><\/span>\u00a0has been set up as scratch drive for submitting jobs to the respective clusters.\u00a0\/data9<\/code>,\/data10<\/code>,\/data11<\/code>,\u00a0\/data12<\/code>,\u00a0\/data13<\/code><\/span>\u00a0are NAS storages of secondary backup.

          Please notice that \/c5scratch \/c5scratch1 \/c6scratch & \/c6scratch1 and \/data3, \/data4, \/data5, \/data6, \/data7, \/data8 had been removed and data were copied to\u00a0\/data14<\/span><\/code>.<\/span>

          \/c$scratch<\/span>\u00a0<\/code>is mounted in all the compute nodes of their respective Cluster, as well as\u00a0\/data$<\/span><\/code>\u00a0is mounted in all master nodes along with\u00a0clpc00\u00a0<\/span><\/code>and\u00a0cluster1<\/code><\/span>.
          Note:<\/b>\u00a0Users are requested to not use\u00a0\/data14<\/span>\u00a0<\/code>for storage uses as it is being used as backup storage.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

          \n\t\t\t\t
          \n\t\t\t\t\t

          How to Login in cluster<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
          \n\t\t\t\t
          \n\t\t\t\t\t\t\t\t\t

          how to login, submit jobs and which application installed in<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

          \n\t\t\t\t
          \n\t\t\t\t\t

          Using the C7-cluster<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
          \n\t\t\t\t
          \n\t\t\t\t\t\t\t\t\t

          First login to\u00a0clpc00<\/span><\/code><\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

          \n\t\t\t\t
          \n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\"HRI-HPC\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
          \n\t\t\t\t
          \n\t\t\t\t\t\t\t\t\t

          if you need X (GUI : Graphical User Interface) then using.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

          \n\t\t\t\t
          \n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\"HRI-HPC\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
          \n\t\t\t\t
          \n\t\t\t\t\t\t\t\t\t

          login to c7-cluster\u00a0c7pc00<\/code><\/span><\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

          \n\t\t\t\t
          \n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\"HRI-HPC\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
          \n\t\t\t\t
          \n\t\t\t\t\t\t\t\t\t

          if you need GUI then using.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

          \n\t\t\t\t
          \n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\"HRI-HPC\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
          \n\t\t\t\t
          \n\t\t\t\t\t\t\t\t\t

          Head node Name of the cluster is\u00a0c7pc00.clusternet<\/code><\/span><\/p>

          Head node IP of the cluster is 192.168.1.207
          (C7 cluster is a 80 nodes sequential cluster. Naming convention of compute nodes starts from\u00a0compute-0-0<\/code>\u00a0to\u00a0compute-0-79<\/code><\/span>. In which 50 are currently operational).<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

          \n\t\t\t\t
          \n\t\t\t\t\t

          Which area to work in:<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
          \n\t\t\t\t
          \n\t\t\t\t\t\t\t\t\t

          For C7-cluster work area is\u00a0\/c7scratch<\/span><\/code>. \/c7scratch is mounted on\u00a0clpc00<\/code>,\u00a0cluster1<\/code><\/span>\u00a0and head nodes of all clusters and all the compute nodes of c7-cluster.<\/p>

          If a directory for you does not exist on \/c7scratch then you can create one for you.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

          \n\t\t\t\t
          \n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\"HRI-HPC\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
          \n\t\t\t\t
          \n\t\t\t\t\t\t\t\t\t

          NAME can be replace by the name of your choice.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

          \n\t\t\t\t
          \n\t\t\t\t\t

          Batch Queue System<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
          \n\t\t\t\t
          \n\t\t\t\t\t\t\t
          \n\t\t\t\n\t\t\t\t\t\t<\/span>\n\t\t<\/div>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
          \n\t\t\t\t
          \n\t\t\t\t\t\t\t\t\t

          In this cluster currently only a single queue (default) is specified; users need to submit job to this queue only.<\/p>

          This queue is having 50 nodes configured; each node is having 8 cores cpu and 24GB memory.<\/p>

          Intel Cluster Studio Version 2012.0.032 is installed in this cluster.<\/p>

          Use below command in your .profile or .bash_profile to set path of Intel Cluster Studio permanently.<\/p>

          • source \/export\/apps\/ics_2012.0.032\/SetIntelPath.sh intel64 (For 64 Bit code)<\/li>
          • source \/export\/apps\/ics_2012.0.032\/SetIntelPath.sh ia32 (For 32 Bit code)<\/li>
          • Users submitting serial jobs need to set below variable in\u00a0.profile<\/span><\/code>\u00a0or\u00a0.bash_profile<\/span> file<\/code>.<\/li>
          • export OMP_NUM_THREADS=1<\/li><\/ul>

            All users are requested to submit jobs through the batch queue. Any user submitting jobs directly on any cluster would invite action against it.<\/p>

            Users are suggested to create one job submission script per job type like below example. (eg. submit.sh)<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

            \n\t\t\t\t
            \n\t\t\t\t\t\t\t\t\t

            [clusterhri@c7pc00 ~]$<\/code>\u00a0cat submit.sh<\/span>#!\/bin\/bash
            #PBS -l nodes=2:ppn=8 \/\/
            #PBS -N job name \/\/
            #PBS -e error file \/\/
            #PBS -o output file \/\/
            mpirun -f $PBS_NODEFILE ?np 16 .\/a.out<\/code><\/span><\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

            \n\t\t\t\t
            \n\t\t\t\t\t

            c7-cluster script file<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
            \n\t\t\t\t
            \n\t\t\t\t\t\t\t
            \n\t\t\t\n\t\t\t\t\t\t<\/span>\n\t\t<\/div>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
            \n\t\t\t\t
            \n\t\t\t\t\t\t\t\t\t
            • To submit the job run below command.<\/li><\/ul>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
              \n\t\t\t\t
              \n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\"HRI-HPC\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
              \n\t\t\t\t
              \n\t\t\t\t\t\t\t\t\t
              • You can see running or queued job list by running below command.<\/li><\/ul>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
                \n\t\t\t\t
                \n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\"HRI-HPC\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
                \n\t\t\t\t
                \n\t\t\t\t\t\t\t\t\t
                • Node Status can be seen using\u00a0pbsnodes<\/code>\u00a0command as mentioned below. If\u00a0state=free<\/code>\u00a0then it means node is ready to accept the job. If it is showing\u00a0state=job-exclusive<\/code>\u00a0that means node is busy with job. If is showing\u00a0state=down<\/code>\u00a0or\u00a0state=offline<\/code>\u00a0or\u00a0state=unkown\u00a0<\/code>that means node is not ready to accept the job due to some problem.<\/li><\/ul>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
                  \n\t\t\t\t
                  \n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\"HRI-HPC\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
                  \n\t\t\t\t
                  \n\t\t\t\t\t\t\t\t\t

                  or<\/strong><\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

                  \n\t\t\t\t
                  \n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\"HRI-HPC\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
                  \n\t\t\t\t
                  \n\t\t\t\t\t\t\t\t\t
                  • User can\u00a0ssh<\/span><\/code>\u00a0respective node and use\u00a0top<\/span>\u00a0<\/code>for more appropriate output<\/li><\/ul>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
                    \n\t\t\t\t
                    \n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\"HRI-HPC\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
                    \n\t\t\t\t
                    \n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\"HRI-HPC\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
                    \n\t\t\t\t
                    \n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\"HRI-HPC\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
                    \n\t\t\t\t
                    \n\t\t\t\t\t\t\t\t\t
                    • Users can see queue status by running below command: (E represents that queue is enable and R represents that queue is running.<\/li><\/ul>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
                      \n\t\t\t\t
                      \n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\"HRI-HPC\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
                      \n\t\t\t\t
                      \n\t\t\t\t\t\t\t\t\t
                      • Users can delete an unwanted job using below command and job id.<\/li><\/ul>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
                        \n\t\t\t\t
                        \n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\"HRI-HPC\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
                        \n\t\t\t\t
                        \n\t\t\t\t\t\t\t\t\t

                        or<\/strong><\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

                        \n\t\t\t\t
                        \n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\"HRI-HPC\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
                        \n\t\t\t\t
                        \n\t\t\t\t\t\t\t\t\t

                        If a user face problem in submitting the job he can try to find possible reason using below command.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

                        \n\t\t\t\t
                        \n\t\t\t\t\t\t\t\t\t

                        [clusterhri@c7pc00 ~]$ checkjob 1566<\/span><\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

                        \n\t\t\t\t
                        \n\t\t\t\t\t\t\t\t\t

                        or<\/strong><\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

                        \n\t\t\t\t
                        \n\t\t\t\t\t\t\t\t\t

                        [clusterhri@c7pc00 ~]$ tracejob 1566<\/span><\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

                        \n\t\t\t\t
                        \n\t\t\t\t\t\t\t\t\t

                        or<\/strong><\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

                        \n\t\t\t\t
                        \n\t\t\t\t\t\t\t\t\t

                        [clusterhri@c7pc00 ~]$ qstat -f 1566<\/span><\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

                        \n\t\t\t\t
                        \n\t\t\t\t\t

                        Application installed in C7 Cluster<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
                        \n\t\t\t\t
                        \n\t\t\t\t\t\t\t\t\t
                        • armadillo-devel, atlas,octave, blas, boost, compat-gcc, pvm, topdrawer, gnuplot_grace<\/li><\/ul>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
                          \n\t\t\t\t
                          \n\t\t\t\t\t

                          Using the C8-Cluster<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
                          \n\t\t\t\t
                          \n\t\t\t\t\t\t\t\t\t

                          First login to\u00a0clpc00<\/span><\/code>.<\/span><\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

                          \n\t\t\t\t
                          \n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\"HRI-HPC\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
                          \n\t\t\t\t
                          \n\t\t\t\t\t\t\t\t\t

                          if you need X (GUI : Graphical User Interface) then using.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

                          \n\t\t\t\t
                          \n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\"HRI-HPC\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
                          \n\t\t\t\t
                          \n\t\t\t\t\t\t\t\t\t

                          login to c8-cluster\u00a0c8pc00<\/code><\/span><\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

                          \n\t\t\t\t
                          \n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\"HRI-HPC\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
                          \n\t\t\t\t
                          \n\t\t\t\t\t\t\t\t\t

                          if you need GUI then using.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

                          \n\t\t\t\t
                          \n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\"HRI-HPC\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
                          \n\t\t\t\t
                          \n\t\t\t\t\t\t\t\t\t

                          Head node Name of the cluster is\u00a0c8pc00.clusternet<\/code><\/span><\/p>

                          Head node IP of the cluster is 192.168.1.208
                          (C8 cluster is a 48 nodes sequential cluster. Naming convention of compute nodes starts from\u00a0compute-0-0<\/code><\/span>\u00a0to\u00a0compute-0-47<\/code><\/span>.)<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

                          \n\t\t\t\t
                          \n\t\t\t\t\t

                          Which area to work in:<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
                          \n\t\t\t\t
                          \n\t\t\t\t\t\t\t\t\t

                          For C8-cluster work area is\u00a0\/c8scratch<\/span><\/code>. \/c8scratch is mounted on\u00a0clpc00<\/code>,<\/span>\u00a0cluster1<\/span><\/code>\u00a0and head nodes of all clusters and all the compute nodes of c8-cluster.<\/p>

                          If a directory for you does not exist on \/c8scratch then you can create one for you.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

                          \n\t\t\t\t
                          \n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\"HRI-HPC\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
                          \n\t\t\t\t
                          \n\t\t\t\t\t\t\t\t\t

                          USER can be replace by the name of your choice.<\/strong><\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

                          \n\t\t\t\t
                          \n\t\t\t\t\t

                          Batch Queue System<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
                          \n\t\t\t\t
                          \n\t\t\t\t\t\t\t\t\t

                          In this cluster currently only a single queue (default) is specified; users need to submit job to this queue only.<\/p>

                          This queue is having 48 nodes configured; each node is having 12 cores cpu and 48GB memory.<\/p>

                          Intel Cluster Studio Version 2012.0.032 is installed in this cluster.<\/p>

                          Use below command in your\u00a0.profile<\/code>\u00a0or\u00a0.bash_profile<\/code>\u00a0to set path of Intel Cluster Studio permanently.<\/p>

                          • source \/export\/apps\/ics_2012.0.032\/SetIntelPath.sh intel64 (For 64 Bit code)<\/li><\/ul>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
                            \n\t\t\t\t
                            \n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\"HRI-HPC\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
                            \n\t\t\t\t
                            \n\t\t\t\t\t\t\t\t\t
                            • source \/export\/apps\/ics_2012.0.032\/SetIntelPath.sh ia32 (For 32 Bit code)<\/li><\/ul>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
                              \n\t\t\t\t
                              \n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\"HRI-HPC\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
                              \n\t\t\t\t
                              \n\t\t\t\t\t\t\t\t\t
                              • Users submitting serial jobs need to set below variable in\u00a0.profile<\/code>\u00a0or\u00a0.bash_profile file<\/code>.<\/li><\/ul>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
                                \n\t\t\t\t
                                \n\t\t\t\t\t\t\t\t\t
                                • export OMP_NUM_THREADS=1<\/li><\/ul>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
                                  \n\t\t\t\t
                                  \n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\"HRI-HPC\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
                                  \n\t\t\t\t
                                  \n\t\t\t\t\t\t\t\t\t

                                  All users are requested to submit jobs through the batch queue. Any user submitting jobs directly on any cluster would invite action against it.<\/p>

                                  Users are suggested to create one job submission script per job type like below example. (eg. submit.sh)<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

                                  \n\t\t\t\t
                                  \n\t\t\t\t\t\t\t\t\t

                                  [clusterhri@c8pc00 ~]$<\/span><\/code>\u00a0cat submit.sh<\/p>

                                  #!\/bin\/bash<\/span>
                                  #PBS -l nodes=2:ppn=12 \/\/<\/span>
                                  #PBS -N job name \/\/<\/span>
                                  #PBS -e error file \/\/<\/span>
                                  #PBS -o output file \/\/<\/span>
                                  mpirun -f $PBS_NODEFILE ?np 16 .\/a.out<\/span><\/code><\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

                                  \n\t\t\t\t
                                  \n\t\t\t\t\t

                                  c8-cluster script file<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
                                  \n\t\t\t\t
                                  \n\t\t\t\t\t\t\t\t\t
                                  • To submit the job run below command.<\/li><\/ul>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
                                    \n\t\t\t\t
                                    \n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\"HRI-HPC\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
                                    \n\t\t\t\t
                                    \n\t\t\t\t\t\t\t\t\t
                                    • You can see running or queued job list by running below command.<\/li><\/ul>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
                                      \n\t\t\t\t
                                      \n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\"HRI-HPC\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
                                      \n\t\t\t\t
                                      \n\t\t\t\t\t\t\t\t\t
                                      • Node Status can be seen using\u00a0pbsnodes<\/span><\/code>\u00a0<\/span>command as mentioned below. If\u00a0state=free<\/code><\/span>\u00a0then it means node is ready to accept the job. If it is showing\u00a0state=job-exclusive<\/code><\/span>\u00a0that means node is busy with job. If is showing\u00a0state=down<\/code><\/span>\u00a0or\u00a0state=offline<\/code><\/span>\u00a0or\u00a0state=unkown\u00a0<\/span><\/code>that means node is not ready to accept the job due to some problem.<\/li><\/ul>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
                                        \n\t\t\t\t
                                        \n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\"HRI-HPC\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
                                        \n\t\t\t\t
                                        \n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\"HRI-HPC\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
                                        \n\t\t\t\t
                                        \n\t\t\t\t\t\t\t\t\t
                                        • User can\u00a0ssh<\/code><\/span>\u00a0respective node and use\u00a0top<\/span>\u00a0<\/code>for more appropriate output.<\/li><\/ul>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
                                          \n\t\t\t\t
                                          \n\t\t\t\t\t\t\t\t\t

                                          [clusterhri@c8pc00 ~]$ ssh compute-0-0<\/span><\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

                                          \n\t\t\t\t
                                          \n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\"HRI-HPC\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
                                          \n\t\t\t\t
                                          \n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\"HRI-HPC\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
                                          \n\t\t\t\t
                                          \n\t\t\t\t\t\t\t\t\t
                                          • Users can see queue status by running below command:(E represents that queue is enable and R represents that queue is running)<\/li><\/ul>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
                                            \n\t\t\t\t
                                            \n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\"HRI-HPC\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
                                            \n\t\t\t\t
                                            \n\t\t\t\t\t\t\t\t\t
                                            • Users can delete an unwanted job using below command and job id.<\/li><\/ul>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
                                              \n\t\t\t\t
                                              \n\t\t\t\t\t\t\t\t\t

                                              [clusterhri@c8pc00 ~]$ qdel 1343<\/span><\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

                                              \n\t\t\t\t
                                              \n\t\t\t\t\t\t\t\t\t

                                              or<\/strong><\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

                                              \n\t\t\t\t
                                              \n\t\t\t\t\t\t\t\t\t

                                              [clusterhri@c8pc00 ~]$ canceljob 1343<\/span><\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

                                              \n\t\t\t\t
                                              \n\t\t\t\t\t\t\t\t\t

                                              If a user face problem in submitting the job he can try to find possible reason using below command.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

                                              \n\t\t\t\t
                                              \n\t\t\t\t\t\t\t\t\t

                                              [clusterhri@c8pc00 ~]$ checkjob 1343<\/span><\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

                                              \n\t\t\t\t
                                              \n\t\t\t\t\t\t\t\t\t

                                              or<\/strong><\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

                                              \n\t\t\t\t
                                              \n\t\t\t\t\t\t\t\t\t[clusterhri@c8pc00 ~]$ tracejob 1343<\/span>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
                                              \n\t\t\t\t
                                              \n\t\t\t\t\t\t\t\t\t

                                              or<\/strong><\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

                                              \n\t\t\t\t
                                              \n\t\t\t\t\t\t\t\t\t[clusterhri@c8pc00 ~]$ qstat -f 1343<\/span>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
                                              \n\t\t\t\t
                                              \n\t\t\t\t\t

                                              Application installed in C8 Cluster<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
                                              \n\t\t\t\t
                                              \n\t\t\t\t\t\t\t\t\t
                                              • gsl, atlas, octave , blas ,boost ,compat-gcc, pvm, topdrawer, gnuplot_grace, NAG<\/li><\/ul>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
                                                \n\t\t\t\t
                                                \n\t\t\t\t\t

                                                Using the C9-Cluster<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
                                                \n\t\t\t\t
                                                \n\t\t\t\t\t\t\t\t\t

                                                Using the c9-cluster<\/span><\/p>

                                                First login to\u00a0clpc00.<\/code><\/span><\/p>

                                                login to\u00a0c9pc00<\/span><\/code><\/p>

                                                Head node Name of the cluster is\u00a0c9pc00.clusternet<\/span><\/code><\/p>

                                                Head node IP of the cluster is\u00a0192.168.1.209<\/span><\/code>\u00a0(C9-cluster is a 48 nodes parallel cluster. Naming convention of compute nodes starts from\u00a0compute-0-0 to compute-0-47<\/span>.<\/code><\/p>

                                                Note:<\/strong>\u00a0Submitting serial job in C9 is deprecated.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

                                                \n\t\t\t\t
                                                \n\t\t\t\t\t

                                                Which area to work in:<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
                                                \n\t\t\t\t
                                                \n\t\t\t\t\t\t\t\t\t

                                                For C9-cluster work area is\u00a0\/c9scratch<\/span><\/code>.\u00a0<\/span>\/c9scratch<\/span>\u00a0<\/code>is mounted on\u00a0clpc00<\/span><\/code>,<\/span>\u00a0cluster1<\/span><\/code>\u00a0and head nodes of all clusters and all the compute nodes of c9-cluster.<\/p>

                                                If a directory for you does not exist on \/c9scratch then you can create one for you.<\/p>

                                                [clusterhri@c9pc00 ~]$ cd \/c9scratch\/NAME\/<\/code><\/span><\/p>

                                                NAME can be replace by the name of your choice.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

                                                \n\t\t\t\t
                                                \n\t\t\t\t\t

                                                Batch Queue System<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
                                                \n\t\t\t\t
                                                \n\t\t\t\t\t\t\t\t\t

                                                In this cluster currently only a single queue (default) is specified; users need to submit job to this queue only.
                                                This queue is having 48 nodes configured; each node is having 16 cores and 128GB memory.
                                                Intel Cluster Studio Version 2013 is installed in this cluster.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

                                                \n\t\t\t\t
                                                \n\t\t\t\t\t

                                                MPI PATHS:<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
                                                \n\t\t\t\t
                                                \n\t\t\t\t\t\t\t\t\t

                                                Intel<\/strong><\/p>

                                                Installed Path:\/opt\/intel\/impi\/4.1.0.024\/bin64<\/code><\/span>
                                                Library Path :\/opt\/intel\/impi\/4.1.0.024\/lib64<\/code><\/span>
                                                icc :\u00a0\/opt\/intel\/bin\/icc<\/span><\/code>
                                                ifort :\u00a0\/opt\/intel\/bin\/ifort<\/code><\/span><\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

                                                \n\t\t\t\t
                                                \n\t\t\t\t\t

                                                Openmpi<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
                                                \n\t\t\t\t
                                                \n\t\t\t\t\t\t\t\t\t

                                                Installed Path :\u00a0\/opt\/openmpi-1.6<\/span><\/code>
                                                Libarary Path :\u00a0\/opt\/openmpi-1.6\/lib<\/span><\/code>
                                                mpicc :\u00a0\/opt\/openmpi-1.6\/bin\/mpicc<\/code><\/span>
                                                mpicxx :\u00a0\/opt\/openmpi-1.6\/bin\/mpicxx<\/span><\/code>
                                                mpif77 :\u00a0\/opt\/openmpi-1.6\/bin\/mpif77<\/span><\/code>
                                                mpif90 :\u00a0\/opt\/openmpi-1.6\/bin\/mpif90<\/span><\/code><\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

                                                \n\t\t\t\t
                                                \n\t\t\t\t\t\t\t\t\t

                                                Users are suggested to create one job submission script per job type like below example. (eg. submit.sh)<\/p>

                                                [clusterhri@c9pc00 ~]$ cat submit.sh<\/span><\/code>\u00a0#!\/bin\/bash<\/code><\/span>
                                                #PBS -l nodes=2:ppn=16<\/span><\/code><\/span>
                                                #PBS -N job_name<\/span><\/code><\/span>
                                                #PBS -e error_file<\/span><\/code><\/span>
                                                #PBS -o output_file<\/span><\/code><\/span>
                                                mpirun -f $PBS_NODEFILE ?np 32 .\/a.out<\/span><\/code><\/p>

                                                To submit the job run below command.<\/p>

                                                [clusterhri@c9pc00 ~]$ qsub Submit.sh<\/span><\/code><\/span><\/p>

                                                You can see running or queued job list by running below command.<\/p>

                                                [clusterhri@c9pc00 ~]$ qstat ?a<\/span><\/code><\/p>

                                                Node Status can be seen using pbsnodes command as mentioned below. If state=free then it means node is ready to accept the job. If it is showing state=job-exclusive that means node is busy with job. If is showing state=down or state=offline or state=unkown that means node is not ready to accept the job due to some problem.
                                                [clusterhri@c9pc00 ~]$ pbsnodes compute-0-0<\/span><\/code><\/p>

                                                User can ssh respective node and use top for more appropriate output.<\/p>

                                                [clusterhri@c9pc00 ~]$ ssh compute-0-0<\/span><\/code><\/p>

                                                [anura@compute-0-0 ~]$ top<\/code><\/span><\/p>

                                                Users can see queue status by running below command: (E represents that queue is enable and R represents that queue is running)<\/p>

                                                [clusterhri@c9pc00 ~]$ qstat -q<\/span><\/code><\/p>

                                                Users can delete an unwanted job using below command and job id.<\/p>

                                                [clusterhri@c9pc00 ~]$ qdel 1253<\/span><\/code><\/p>

                                                OR<\/p>

                                                [clusterhri@c9pc00 ~]$ canceljob 1253<\/span><\/code><\/p>

                                                If a user face problem in submitting the job he can try to find possible reason using below command.<\/p>

                                                [clusterhri@c9pc00 ~]$ checkjob 1253<\/span><\/code><\/span><\/p>

                                                OR<\/p>

                                                [clusterhri@c9pc00 ~]$ tracejob 1253<\/code><\/span><\/p>

                                                OR<\/p>

                                                [clusterhri@c9pc00 ~]$ qstat -f 1253<\/span><\/code><\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

                                                \n\t\t\t\t
                                                \n\t\t\t\t\t

                                                Useful Commands for C13-Cluster<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
                                                \n\t\t\t\t
                                                \n\t\t\t\t\t\t\t\t\t

                                                Users can see queue status by running below command: (E represents that queue is enable and R represents that queue is running)<\/p>

                                                [clusterhri@c13pc00 ~]$ qstat -a<\/code><\/span><\/p>

                                                Users can see their jobs running on which node status by running below command<\/p>

                                                [clusterhri@c13pc00 ~]$ qstat -n1<\/span><\/code><\/p>

                                                Users can see Node Status (free \/ busy) by running below command<\/p>

                                                [clusterhri@c13pc00 ~]$ pbsnodes -avS<\/code><\/span><\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t

                                                \n\t\t\t\t\t
                                                \n\t\t\t\t
                                                \n\t\t\t\t
                                                \n\t\t\t\t\t\t\t
                                                \n\t\t\t
                                                <\/div>\n\t\t<\/div>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>","protected":false},"excerpt":{"rendered":"

                                                HRI-HPC Documentation Documentation section contains information about the resources that make up HPC, as well as details about HPC\u00b4s operating system and special packages\/software that have been used on HPC resources. This section also focuses on jobs computation on HPC, and also provides information on storage. All that information will be needed to create and run compute jobs on HPC-Cluster, as well as using NAS storage\/space,and Licensed\/Open source software that can be used only on HPC resources. Topics covered in the Documentation section include: Operating System used in respective Clusters We are using ROCKS 6.0 based on a customized distribution of Community Enterprise Operating System (CentOS). CentOS 6.0 Update 2 is a high-quality Linux distribution that gives HPC complete control of its open-source software packages and is fully customized to suit HPC research needs, without the need for license fees. CentOS is modified for minor bug fixes and desired localized behavior. Many desktop and clustering-related packages were also added to our CentOS installation. Getting Help A number of white papers, tutorials, FAQs and other documentation on CentOS can be found on the\u00a0official CentOS website. Useful OS commands ls: list information about the Files Option -l: list information about the Files -t: sort by modification time. -h: print sizes in human readable format. -a: list hidden files. du: estimates file space usage. df: report filesystem disk space usage. top: display Linux tasks. ps: report a snapshot of the current processes. Option -e: all processes. -f: full. tail: outputs the last part of files. (Used when Library linking issues arise. explained in troubleshooting page) ssh[node name]: outputs the last part of files. (Used when Library linking issues arise. explained in troubleshooting page) Option X: for X forwarding. Shell Environment All the programs that run under Linux are called as processes. Processes run continuously in Linux and you can kill or suspend different processes using various commands. When you start a program a new process is created. This process runs within what is called an environment. This particular environment would be having some characteristics which the program\/process may interact with. Every program runs in its own environment. You can set parameters in this environment so that the running program can find desired values when it runs. Setting a particular parameter is as simple as typing\u00a0VARIABLE=value. This would set a parameter by the name\u00a0VARIABLE\u00a0with the value that you provide. PATH\u00a0is an environmental variable in Linux and other Unix-like operating systems that tells the shell which directories to search for executable files (i.e., ready-to-run programs) in response to commands issued by a user. It increases both the convenience and the safety of such operating systems and is widely considered to be the single most important environmental variable. To see a list of the environment variables that are already set on your machine, type the following This would produce a long list. Linux by default sets many environment variables for you. You can modify the values of most of these variables. A few of the variables that are set are\u00a0env | grep PATH. Another way to view the contents of just\u00a0PATH\u00a0alone is by using the echo command with\u00a0$PATH\u00a0as an argument: Each user on a system can have a different\u00a0PATH\u00a0variable.\u00a0PATH\u00a0variables can be changed relatively easily. They can be changed just for the current login session, or they can be changed permanently (i.e., so that the changes will persist through future sessions). It is a simple matter to add a directory to a user’s\u00a0PATH\u00a0variable (and thereby add it to the user’s default search path). It can be accomplished for the current session by using the following command, in which directory is the full path of the directory to be entered: Another way to view the contents of just\u00a0PATH\u00a0alone is by using the echo command with\u00a0$PATH\u00a0as an argument: For example, to add the directory\u00a0\/usr\/bin, the following would be used: An alternative is to employ the export command, which is used to change aspects of the environment. Thus, the above absolute path could be added with the following two commands in sequence or its single-line equivalent. That the directory has been added can be easily confirmed by again using the echo command with\u00a0$PATH\u00a0as its argument. An addition to a user’s PATH variable can be made permanent by adding it to that user’s\u00a0.bash_profile\u00a0file.\u00a0.bash_profile\u00a0is a hidden file in each user’s home directory that defines any specific environmental variables and startup programs for that user. Thus, for example, to add a directory named \/usr\/test to a user’s\u00a0PATH\u00a0variable, it should be appended with a text editor to the line that begins with\u00a0PATH\u00a0so that the line reads something like\u00a0PATH=$PATH:$HOME\/bin:\/usr\/test. It is important that each absolute path be directly (i.e., with no intervening spaces) preceded by a colon. would set the home directory to\u00a0\/home\/clusterhri. This is perfect in case your login name is\u00a0amit\u00a0and you have been given a directory named\u00a0\/home\/amit\u00a0. In case you don’t want this to be your home directory but some other one you could indicate so by typing the new directory name. The HOME directory is always the directory that you are put in when you login. or There are many advantages of using the\u00a0HOME\u00a0variable. You can always reach your home directory by only typing cd at the prompt, irrespective of which directory you are presently within. This would immediately transfer you to your HOME directory. Besides in case you write scripts that have\u00a0$HOME\u00a0present in them to refer to the current HOME directory, these scripts can be used by other users as well since\u00a0$HOME\u00a0in their case would refer to their home directories. This is a very important environment variable. This sets the path that the shell would be looking at when it has to execute any program. It would search in all the directories that are present in the above line. Remember that entries are separated by a\u00a0:. You can add any number of directories to this list. The above 3 directories entered is just an example. Note :The last entry in the PATH command is a\u00a0.\u00a0(period). This is an important addition<\/p>","protected":false},"author":1,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"elementor_header_footer","meta":{"_acf_changed":false,"_lmt_disableupdate":"","_lmt_disable":"","footnotes":""},"class_list":["post-11516","page","type-page","status-publish","hentry"],"acf":[],"aioseo_notices":[],"_links":{"self":[{"href":"https:\/\/harish.bigzero.co.in\/hi\/wp-json\/wp\/v2\/pages\/11516","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/harish.bigzero.co.in\/hi\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/harish.bigzero.co.in\/hi\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/harish.bigzero.co.in\/hi\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/harish.bigzero.co.in\/hi\/wp-json\/wp\/v2\/comments?post=11516"}],"version-history":[{"count":283,"href":"https:\/\/harish.bigzero.co.in\/hi\/wp-json\/wp\/v2\/pages\/11516\/revisions"}],"predecessor-version":[{"id":19731,"href":"https:\/\/harish.bigzero.co.in\/hi\/wp-json\/wp\/v2\/pages\/11516\/revisions\/19731"}],"wp:attachment":[{"href":"https:\/\/harish.bigzero.co.in\/hi\/wp-json\/wp\/v2\/media?parent=11516"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}