Difference between revisions of "PVDB"
|Line 103:||Line 103:|
= Expert tools =
= Expert tools =
Revision as of 18:01, 17 July 2019
Parity Run Database (also called PVDB) stores run related information using mysql. DB is running on cdaqdb1 (alias of cdaqfs1) and mirrored over to hallcdb (read-only slave of the cdaqdb1 master). There are a-rcdb and c-rcdb for Hall A and Hall C, respectively. It utilizes existing rcdb framework that has been developed and used for Hall D. While we keep the same schema from the rcdb, we added some parity conditions such as helicity and spin rotator information. For questions, please contact email@example.com.
- Hall A rcdb home page: https://hallaweb.jlab.org/rcdb/ (accessible on-site and off-site)
- PVDB git repository: https://github.com/JeffersonLab/pvdb
- RCDB git repository: https://github.com/JeffersonLab/rcdb
Run information is filled at the Start/End of each run as well as after the prompt analysis.
A wrapper script is located at:
Instruction for users
One can access the DB copy from any jlab network computer as rcdb. No password required.
In your script, set a hard coded connection string, for example:
con_str="mysql://firstname.lastname@example.org:3306/a-rcdb" db = rcdb.RCDBProvider(con_str)
Or, from non adaq machine (aonl, farm, ..)
> setenv RCDB_CONNECTION mysql://email@example.com:3306/a-rcdb
- Note for connection from adaq machine:
RCDB_CONNECTION is set on adaq machines to the master DB by default in order to fill run conditions into the DB.
Please do NOT connect to the master DB. Editing the DB contents should be done through Sanghwa Park except for run QA conditions done by the WAC (see below for WAC DB Tools).
If one needs to access DB from adaq machines, set the connection string separately through a hard coded string in a script.
How to read from the DB
- using CLI:
To see available options:
PLEASE DO NOT USE "write" or "replace" without talking to Sanghwa
> rcnd -h
Print total number of runs and last run number as well as condition names
List condition names (with description)
> rcnd --list
Get a condition value for a given run:
> rcnd run# condition_name ex) > rcnd 2461 run_type
- Using python script
How to add/modify comments for the DB
on the adaq machines, type:
- Type Run Number and click "OK"
- Existing comment will appear on the box below. If there is nothing, it means there was no comment before.
- Add your comment and click "SAVE AND EXIT"
WAC DB TOOL
on the adaq machines, type:
- Type Run Number and click "Connect"
- Run type and Run flag currently stored in the DB will be shown. You may not see nothing for "Run flag" if this is the first time you are updating the condition.
- Select new "Run type" and "Run flag".
- Click "SAVE" to store the new conditions into the DB
Make a run list from DB
You can run it from any jlab subnet as far as environment variables are set properly. Things are set in aonl machines already.
- From aonl as apar:
1) log in
> ssh apar@aonl#
2) Copy the script to your working directory
> cp ~/pvdb/prex/example/make_run_list.py <your_directory>
3) How to use, available options
> python make_run_list --help
- Start from scratch (e.g. from ifarm):
1) clone the repository
> git clone https://github.com/JeffersonLab/pvdb > cd pvdb > git submodule init > git submodule update
2) set environment variables
> source environment.csh
3) test if everything is ok (if you see the list of condition types, you are good to go)
Update Run End Information
If a run did not end properly (e.g., coda crash, ..), one can update the run information using coda file and prompt analysis output. Please make sure you give some time for the prompt analysis to finish.
0) log in to adaq
> ssh apar@adaq#
1) Go to pvdb script directory
> cd ~pvdb/prex/scripts
2) run the following script
> python fixer_run_end.py run# > e.g) python fixer_run_end.py 3411
- May 2019:
- pvdb successfully tested with the parity DAQ. The wrapper scripts are integrated into halogRunStart_parity and halogRunEnd_parity.
- Modified login script to set the environment variables for the connection string and pvdb home on adaq machines.
- June 10, 2019
- After the transition from hcrcdb to cdaqdb1, we set up the database again. Now the database name is a-rcdb.
DB user ‘pvdb’ created with access granted from jlab subnet. Granted all privileges on a-rcdb:
> GRANT ALL PRIVILEGES ON `a-rcdb`.* TO ‘pvdb’@’%.jlab.org’; > SHOW GRANTS for pvdb@’%.jlab.org’;
- adaq user account already exists (apcoda - no pw, apar - pw required). Granted ALL privileges on a-rcdb.
- DB structure created:
1) Use get_started.py To create both default rcdb condition types and parity default types (defined in parity_rcdb) > python get_started.py Check with rcnd command: > rcnd (should print conditions)
2) To add new conditon types: Use add_condition_type.py Using CLI (rcnd): >rcnd --create my_value --type string --description "This is my value" ConditionType created with name='my_value', type='string', is_many_per_run='False
- Added condition type "experiment"
- June 11, 2019
- Added "sl_comment" condition and created gui script for WAC. Alias set as "slcomment" and available from any adaq machines.
- script: ~/scripts/guis/pvdblog.tcl (use edit_comment.py)
- June 13, 2019
- Added "good_charge" and "run_flag" conditions
- replace comment gui script with a new one: ~/scripts/gui/wac_comment.py
- connect to the master DB (recommended only for authorized ppl):
> mysql -h cdaqdb1 -u <user_name> -p
- use pvdb database for test and development. Do it by setting the connection string accordingly.
- a-rcdb accounts:
- pvdb (access from jlab subnet, pw required), granted all privileges on a-rcdb, pvdb
- apar (access from adaq subnet, pw required), granted all privileges on a-rcdb, pvdb
- apcoda (access from adaq subnet, no pw required), granted all privileges on a-rcdb, pvdb. Used to push run information from adaq.
- To modify rcdb_home:
First, set the primary group to harcdb
> sg harcdb
back to WAC