Data Server

From FSU Fox's Lab Wiki
Revision as of 16:31, 8 July 2022 by Rtang (talk | contribs) (→‎UPS)
Jump to navigation Jump to search
Notice Notice :   for requesting a user account, see Common Users Account
Photo of the rack of the data server. The data server is on the top. The achieve data server is in the middle. The UPS is at the bottom.

The data server is built for storing all experimental raw data and for analysis. The primary data storage /mnt/data0 (72 TB, RAID 5 array from 6 16 TB disks), should be and only be for raw data storage. Frequent read-write data should be avoided at all costs because it will reduce the disk lifetime. Analysis source code and output should be stored in user's home directory. All necessary analysis codes/programs are provided and maintained by the system admin. Users can also request any programs to be installed or installed in their local.

Network IP and Alias

IP network alias Speed functions
128.186.111.42 pauli.physics.fsu.edu 1 Gb/s for user login
128.186.111.43 pauli-data.physics.fsu.edu 10 Gb/s for data transfer

Spec.

  • Dell PowerEdge R540 Rack server
  • CPU : Intel Xeon Gold, 36 cores
  • RAM : 32 GB
  • Storage :
    • 1.9TB SSD for OS and /home/ at the rear slot-1
    • 1TB for data (temporary) /mnt/data_1TB at the rear slot-2
    • 6x16TB for data /mnt/data0 at the front slot-1,2,3,4,5,6
  • OS : Ubuntu 20.04
Power of the DataServer.png

Detail Spec.

Here are the detail spec.

Software

Software/Code Info.
CERN ROOT 6.26/02
docker
python3-pip pip or pip3 are the command, avalible packages
PtolemyGUI GUI for DWBA calculation using Ptolemy, it will create a file call DWBA.
/opt/Ptolemy/Cleopatra/Isotope.h a C++ Class (Isotope) for mass20.txt
(TBD) twoBodyReaction.h a C++ Class for A+a→b+B reaction kinematics.
(TBD) Radware
gnuscope (via docker) Only able to run at local, for user Tandem
Globus personal connect

Storage and Disks

Disk Capacity Speed Type Slot Command
/ 1.9 TB 533 MB/s SSD rear-1 OS disk
/mnt/data_1TB 1 TB 108 MB/s HDD rear-2 not recommended
/mnt/data0 80 TB 340 MB/s RAID-5 6x16TB HHD front-1,2,3,4,5,6 recommended

Common Users Account

tandem (fsuphysics888) is the general user account.

Anyone wish to have a personal account can be contact Ryan mailto:rtang@fsu.edu, and provides following information

  • full name
  • username (the name for login)

[ admin only ] Create an user account

there is a bash script in /usr/bin/createNewUser.sh. This script will create an account and set disk-quota limit.

User Quota

The default quota for user is 50GB soft limit and 100GB hard limit on their home directory. The quota can be increase on request. User can also use the /mnt/data_1TB. The user quota for raw data saving at /mnt/data0 are unlimited.

  • soft limit: user still can use more than 50G in the next 7 days, after that, this 50G is the hard limit.
  • hard limit: user can never use more than 100G.

Setup

install the quota program

Globus Personal Connect

Notice Notice :   Ryan already made an endpoint on the data server called FSU Fox's Lab Data Server Ryan's End Point

For more detail, please check https://docs.globus.org/how-to/globus-connect-personal-linux/

The program is stored in /opt/globusconnectpersonal/

to Run

~>/opt/globusconnectpersonal/globusconnect &

It will ask you to login, follow the steps and use your FSU credential.

enable access of data0

if you cannot access the data0, edit the file at you home ~/.globusonline/lta/config-path

~/,0,1
/mnt/,1,1

The 1st line is the access of your home directory, not-share, allow read/write.

The 2nd line is the access of the /mnt/ directory, share, allow read/write.

To clear the setting / remove credential

Simply remove the folder ~/.globusonline

Exp Folder format

Please use

YYYY_MM_beam_reaction_PI_extra
  • YYYY : year in 4 digits
  • MM : month is 4 digits
  • beam : e.g. 12C
  • reaction : e.g. dp
  • PI : name of PI
  • extra : some extra comments, can be skipped.

For example, Eli performed 12C(d,n)reaction on April, 2022.

2022_04_12C_dn_eli

Mount disk remotely

To mount the disk remotely, need the sshfs installed in the local machine. In Debian/Ubuntu

~>sudo apt install sshfs

Create a mount directory in the local machine (say /mnt/dataRemote)

~>sudo mkdir /mnt/dataRemote

Mounting

~>sudo sshfs -o allow_other YYY@pauli-data.physics.fsu.edu:XXX  /mnt/dataRemote/

where YYY is the user account where XXX is the disk location in the data server, e.g. /mnt/data0

To mount on startup

edit /etc/fstab

add line

ssh#YYY@pauli.physics.fsu.edu:XXX  /mnt/dataRemote/

Python3 packages

Here is the list of the python3 packages on May 6, 2022

Uninterruptible Power Supply

Warning Warning :   shutdown protection not tested


A uninterruptible Power Supply (UPS) is used for power the data server, the achieve data server, and the Ethernet switches on the rack.

a program for monitoring the UPS is installed from https://www.cyberpowersystems.com/product/software/power-panel-business/powerpanel-business-4-8-1-linux/

The program provide a web interface.

pauli.physics.fsu.edu:3052

for account and password, see elog

Others

Contact