Data Server: Difference between revisions
(→Spec.) |
|||
| (2 intermediate revisions by the same user not shown) | |||
| Line 17: | Line 17: | ||
= Spec. = | = Spec. = | ||
* Dell PowerEdge R540 Rack server | * Dell PowerEdge R540 Rack server | ||
* CPU : Intel Xeon Gold | * CPU : Intel(R) Xeon(R) Gold 5220 CPU @ 2.20GHz (18 core x 2 = 36 threads) | ||
* RAM : 4 X 32 GB (upgraded on May 20, 2024) | * RAM : 4 X 32 GB (upgraded on May 20, 2024) | ||
* Storage : | * Storage : | ||
| Line 154: | Line 154: | ||
|- | |- | ||
| /mnt/data0 || 80 TB || 340 MB/s || RAID-5 6x16TB HHD || front-1,2,3,4,5,6 || recommended | | /mnt/data0 || 80 TB || 340 MB/s || RAID-5 6x16TB HHD || front-1,2,3,4,5,6 || recommended | ||
|- | |||
| /mnt/data1 || 100 TB || 340 MB/s || RAID-5 6x20TB HHD || front-7,8,9,10,11,12 || installed on 2024-10-11 | |||
|} | |} | ||
| Line 221: | Line 223: | ||
An endpoint is created for people to access the data. | An endpoint is created for people to access the data. | ||
UUID : | UUID : 5ba06aee-87ff-11ef-8ebd-4177e580d0c6 | ||
Name : FSU Fox's Lab Data Server Ryan's End Point Shared | Name : FSU Fox's Lab Data Server Ryan's End Point Shared | ||
[the old end point with UUID : 99d0d880-2644-11ee-8193-195c41bc0be4 is deleted] | |||
= Globus Personal Connect = | = Globus Personal Connect = | ||
Latest revision as of 14:37, 11 October 2024
 Notice : | for requesting a user account, see Common Users Account |
The data server is built for storing all experimental raw data and for analysis. The primary data storage /mnt/data0 (72 TB, RAID 5 array from 6 16 TB disks), should be and only be for raw data storage. Frequent read-write data should be avoided at all costs because it will reduce the disk lifetime. Analysis source code and output should be stored in user's home directory. All necessary analysis codes/programs are provided and maintained by the system admin. Users can also request any programs to be installed or installed in their local.
Network IP and Alias
| IP | network alias | Speed | functions |
|---|---|---|---|
| 128.186.111.42 | pauli.physics.fsu.edu | 1 Gb/s | for user login |
| 128.186.111.43 | pauli-data.physics.fsu.edu | 10 Gb/s | for data transfer |
Spec.
- Dell PowerEdge R540 Rack server
- CPU : Intel(R) Xeon(R) Gold 5220 CPU @ 2.20GHz (18 core x 2 = 36 threads)
- RAM : 4 X 32 GB (upgraded on May 20, 2024)
- Storage :
- 1.9TB SSD for OS and /home/ at the rear slot-1
- 8TB for data (temporary) /mnt/data_8TB at the rear slot-2
- 6x16TB for data /mnt/data0 at the front slot-1,2,3,4,5,6
- OS : Ubuntu 20.04
Detail Spec.
Software
| Software/Code | Info. | Run Command |
|---|---|---|
| CERN ROOT 6.26/02 | if you don't know, probably you are at the wrong place. | root |
| KSHELL | Large-scale shell model calculation using multi-cores. | kshell_ui.py |
| PtolemyGUI | GUI for DWBA calculation using Ptolemy, it will create a file call DWBA. | PtolemyGUI |
| Jupyter notebook | ||
| docker | ||
| geany | a nice editor, in additional to emacs, vim, and nano | geany |
| GEANT4 11.0.2 | installed path /usr/local, cmake with -DGEANT4_INSTALL_DATA=ON -DGEANT4_USE_OPENGL_XLL=ON | |
| view3Dview | for VMRL vituallization | |
| python3-pip | pip or pip3 are the command, avalible packages | |
| /opt/Ptolemy/Cleopatra/Isotope.h | a C++ Class (Isotope) for mass20.txt | |
| (TBD) twoBodyReaction.h | a C++ Class for A+a→b+B reaction kinematics. | |
| (TBD) Radware | ||
| gnuscope (via docker) | Only able to run at local, for user Tandem | |
| Globus personal connect | globusconnect |
Storage and Disks
| Disk | Capacity | Speed | Type | Slot | Command |
|---|---|---|---|---|---|
| / | 1.9 TB | 533 MB/s | SSD | rear-1 | OS disk |
| /mnt/data_8TB | 8 TB | - MB/s | SSD | rear-2 | extra analysis storage |
| /mnt/data0 | 80 TB | 340 MB/s | RAID-5 6x16TB HHD | front-1,2,3,4,5,6 | recommended |
| /mnt/data1 | 100 TB | 340 MB/s | RAID-5 6x20TB HHD | front-7,8,9,10,11,12 | installed on 2024-10-11 |
Common Users Account
tandem is the general user account.
Anyone wish to have a personal account can be contact Ryan mailto:rtang@fsu.edu, and provides following information
- full name
- username (the name for login)
[ admin only ] Create an user account
there is a bash script in /usr/bin/createNewUser.sh. This script will create an account and set disk-quota limit.
User Quota
The default quota for user is 50GB soft limit and 100GB hard limit on their home directory. The quota can be increase on request. User can also use the /mnt/data_1TB. The user quota for raw data saving at /mnt/data0 are unlimited.
- soft limit: user still can use more than 50G in the next 7 days, after that, this 50G is the hard limit.
- hard limit: user can never use more than 100G.
Setup
Globus Endpoint
An endpoint is created for people to access the data.
UUID : 5ba06aee-87ff-11ef-8ebd-4177e580d0c6 Name : FSU Fox's Lab Data Server Ryan's End Point Shared
[the old end point with UUID : 99d0d880-2644-11ee-8193-195c41bc0be4 is deleted]
Globus Personal Connect
| Notice : | Ryan already made an endpoint on the data server called FSU Fox's Lab Data Server Ryan's End Point |
For more detail, please check https://docs.globus.org/how-to/globus-connect-personal-linux/
The program is stored in /opt/globusconnectpersonal/
to Run
~>/opt/globusconnectpersonal/globusconnect &
It will ask you to login, follow the steps and use your FSU credential.
enable access of data0
if you cannot access the data0, edit the file at you home ~/.globusonline/lta/config-path
~/,0,1 /mnt/,1,1
The 1st line is the access of your home directory, not-share, allow read/write.
The 2nd line is the access of the /mnt/ directory, share, allow read/write.
To clear the setting / remove credential
Simply remove the folder ~/.globusonline
To keep run in background
nohup /opt/globusconnectpersonal/globusconnect -start > output.log 2>&1 &
Exp Folder format
Please use
YYYY_MM_beam_reaction_PI_extra
- YYYY : year in 4 digits
- MM : month is 4 digits
- beam : e.g. 12C
- reaction : e.g. dp
- PI : name of PI
- extra : some extra comments, can be skipped.
For example, Eli performed 12C(d,n)reaction on April, 2022.
2022_04_12C_dn_eli
Mount disk remotely
To mount the disk remotely, need the sshfs installed in the local machine. In Debian/Ubuntu
~>sudo apt install sshfs
Create a mount directory in the local machine (say /mnt/dataRemote)
~>sudo mkdir /mnt/dataRemote
Mounting
~>sudo sshfs -o allow_other YYY@pauli-data.physics.fsu.edu:XXX /mnt/dataRemote/
where YYY is the user account where XXX is the disk location in the data server, e.g. /mnt/data0
To mount on startup
edit /etc/fstab
add line
ssh#YYY@pauli.physics.fsu.edu:XXX /mnt/dataRemote/
Python3 packages
Uninterruptible Power Supply
 Warning : | shutdown protection not tested |
A uninterruptible Power Supply (UPS) is used for power the data server, the Archive Data Server, and the Ethernet switches on the rack.
a program for monitoring the UPS is installed from https://www.cyberpowersystems.com/product/software/power-panel-business/powerpanel-business-4-8-1-linux/
The program provide a web interface.
pauli.physics.fsu.edu:3052
for account and password, see elog
System monitoring
I use Prometheus + node_exporter. Same in the FSUNUC setup.
Others
Contact
- Ryan Tang mailto:rtang@fsu.edu