Data Server

From FSU Fox's Lab Wiki
Jump to navigation Jump to search
Warning Warning :   No data redundancy in the server for the moment.

Network IP and Alias

IP network alias functions
128.186.111.42 pauli.physics.fsu.edu for user login
128.186.111.43 pauli-data.physics.fsu.edu for data transfer

Spec.

  • Dell PowerEdge R540 Rack server
  • CPU : Intel Xeon Gold, 36 cores
  • RAM : 32 GB
  • Storage :
    • 1.9TB SSD for OS and /home/ at the rear slot
    • 1TB for data (temporary) /mnt/data_1TB at the front slot-1
    • 3x16TB for data /mnt/data0 at the front slot-10,11,12
  • OS : Ubuntu 20.04
Power of the DataServer.png

Software

Software/Code Info.
CERN ROOT 6.26/02
docker
python3-pip pip or pip3 are the command
PtolemyGUI GUI for DWBA calculation using Ptolemy, it will create a file call DWBA.
/opt/Ptolemy/Cleopatra/Isotope.h a C++ Class (Isotope) for mass20.txt
(TBD) twoBodyReaction.h a C++ Class for A+a→b+B reaction kinematics.
(TBD) Radware
gnuscope (via docker) Only able to run at local, for user Tandem
Globus personal connect

Common Users Account

tandem (fsuphysics888) is the general user account.

Anyone wish to have a personal account can be contact Ryan mailto:rtang@fsu.edu, and provides following information

  • full name:
  • username:
  • email:

[ admin only ] Create an user account

there is a bash script in /usr/bin/createNewUser.sh. This script will create an account and set disk-quota limit.

User Quota

The default quota for user is 50GB soft limit and 100GB hard limit.

  • soft limit: user still can use more than 50G in the next 7 days, after that, this 50G is the hard limit.
  • hard limit: user can never use more than 100G.

Setup

install the quota program
sudo apt install quota

edit the /etc/fstab

from this

UUID=fc15d3a2-a49f-4974-8216-5949a740ef80 /   ext4    errors=remount-ro 0       1

to this:

UUID=fc15d3a2-a49f-4974-8216-5949a740ef80 /   ext4    errors=remount-ro,usrquota 0       1

remount

sudo mount -o remount /

check the new effect

cat /proc/mounts | grep ' / '
/dev/sdc2 / ext4 rw,relatime,quota,usrquota</spam>,errors=remount-ro,stripe=64 0 0

enable the quota

sudo quotacheck -ugm /

This will create /aquota.user

check

sudo quotaon -v /
/dev/sdc2 [/]: user quotas turned on

Set user quota

use the command 'setquota' to set user quota, in this example 50G is the soft limit, 100G is the hard limit.

sudo setquota -u <User> 50G 100G 0 0 /

quota report

sudo repquota -s /

Disks available

Disk Capacity Speed Type Slot Command
/ 1.9 TB 533 MB/s SSD rear-1 OS disk
/mnt/data_1TB 1 TB 108 MB/s HDD rear-2 not recommended
/mnt/data0 48 TB 419 MB/s RAID-0 3x16TB HHD front-1,2,3 recommended

Globus Personal Connect

For more detail, please check https://docs.globus.org/how-to/globus-connect-personal-linux/

The program is stored in /opt/globusconnectpersonal/

to Run

~>/opt/globusconnectpersonal/globusconnect &

It will ask you to login, follow the steps and use your FSU credential.

enable access of data0

if you cannot access the data0, edit the file at you home ~/.globusonline/lta/config-path

~/,0,1
/mnt/,1,1

The 1st line is the access of your home directory, not-share, allow read/write.

The 2nd line is the access of the /mnt/ directory, share, allow read/write.

To clear the setting / remove credential

Simply remove the folder ~/.globusonline

Exp Folder format

Please use

YYYY_MM_beam_reaction_PI_extra
  • YYYY : year in 4 digits
  • MM : month is 4 digits
  • beam : e.g. 12C
  • reaction : e.g. dp
  • PI : name of PI
  • extra : some extra comments, can be skipped.

For example, Eli perform 12C(d,n)reaction on April, 2022.

2022_04_12C_dn_eli

Mount disk remotely

To mount the disk remotely, need the sshfs installed in the local machine. In Debian/Ubuntu

~>sudo apt install sshfs

Create a mount directory in the local machine (say /mnt/data0)

~>sudo mkdir /mnt/data0

Mounting

~>sudo sshfs -o allow_other YYY@pauli-data.physics.fsu.edu:XXX  /mnt/data0/

where YYY is the user account where XXX is the disk location in the data server.

To mount on startup

edit /etc/fstab

add line

ssh#YYY@pauli.physics.fsu.edu:XXX  /mnt/data0/

Python3 packages

Here is the list of the python3 packages on May 6, 2022
  • apturl 0.5.2
  • bcrypt 3.1.7
  • blinker 1.4
  • Brlapi 0.7.0
  • certifi 2019.11.28
  • cffi 1.15.0
  • chardet 3.0.4
  • click 8.1.3
  • colorama 0.4.3
  • command-not-found 0.3
  • cryptography 36.0.2
  • cupshelpers 1.0
  • dbus-python 1.2.16
  • defer 1.0.6
  • distro 1.4.0
  • distro-info 0.23ubuntu1
  • duplicity 0.8.12.0
  • entrypoints 0.3
  • fasteners 0.14.1
  • future 0.18.2
  • globus-cli 3.5.0
  • globus-sdk 3.8.0
  • httplib2 0.14.0
  • idna 2.8
  • jmespath 0.10.0
  • keyring 18.0.1
  • language-selector 0.1
  • launchpadlib 1.10.13
  • lazr.restfulclient 0.14.2
  • lazr.uri 1.0.3
  • lockfile 0.12.2
  • louis 3.12.0
  • macaroonbakery 1.3.1
  • matplotlib 3.5.2
  • monotonic 1.5
  • netifaces 0.10.4
  • numpy 1.22.3
  • oauthlib 3.1.0
  • olefile 0.46
  • paramiko 2.6.0
  • pexpect 4.6.0
  • Pillow 7.0.0
  • pip 20.0.2
  • protobuf 3.6.1
  • pycairo 1.16.2
  • pycparser 2.21
  • pycups 1.9.73
  • PyGObject 3.36.0
  • PyJWT 2.3.0
  • pymacaroons 0.13.0
  • PyNaCl 1.3.0
  • pyRFC3339 1.1
  • PySimpleGUI 4.59.0
  • python-apt 2.0.0+ubuntu0.20.4.7
  • python-dateutil 2.7.3
  • python-debian 0.1.36ubuntu1
  • pytz 2019.3
  • pyxdg 0.26
  • PyYAML 5.3.1
  • reportlab 3.5.34
  • requests 2.22.0
  • requests-unixsocket 0.2.0
  • SecretStorage 2.3.1
  • setuptools 45.2.0
  • simplejson 3.16.0
  • six 1.14.0
  • ssh-import-id 5.10
  • systemd-python 234
  • typing-extensions 4.2.0
  • ubuntu-advantage-tools 27.7
  • ubuntu-drivers-common 0.0.0
  • ufw 0.36
  • unattended-upgrades 0.1
  • urllib3 1.25.8
  • usb-creator 0.3.7
  • wadllib 1.3.3
  • wheel 0.34.2
  • xkit 0.0.0

Others

Contact