TWiki
>
Computing Web
>
LocalGridInternals
>
LocalGridDPM
(revision 5) (raw view)
Edit
Attach
---+ Athena Access to the SE %TOC% You can list files on the SE using either rfdir or dpns-ls: <verbatim> rfdir /dpm/ph.bham.ac.uk/home/atlas/atlasmcdisk/mc08/ dpns-ls -l /dpm/ph.bham.ac.uk/home/atlas/atlasmcdisk/mc08/ </verbatim> Athena ultimately requires a list of files, so perhaps a script to take a DQ2 dataset name, find it's location on the SE and then output filelist.py would suffice? ---++ Setup (User) RFIO relies on the library libshift.so, but Castor and DPM required two different versions, Castor being the default. To fix this, in the run directory: <verbatim> ln -s /home/lcgui/SL4/prod/lcg/lib/libdpm.so libshift.so.2.1 export LD_LIBRARY_PATH=`pwd`:$LD_LIBRARY_PATH </verbatim> This allows for (the very slow) access to the SE using RFIO. Users will also require a valid grid certificate. ---++ Finding Files The [[https://www.ep.ph.bham.ac.uk/twiki/bin/view/Computing/LocalGridDPM/sancho.sh][sancho.sh]] script may be used to locate files on the SE via their DQ2 label. It can be used to output a filelist in two formats - with and without Athena decorations. *Example 1:* <verbatim> source sancho.sh mc08.105502.AcerMC_tchan.recon.AOD.e352_s462_r541 #Prints a list of files suitable with one file per line (suitable for ganga) </verbatim> *Example 2:* <verbatim> source sancho.sh -a mc08.105502.AcerMC_tchan.recon.AOD.e352_s462_r541 #Prints a list of files with Athena decorations ("ServiceMgr...." etc) </verbatim> ---++ Testing 1 Where does data reside - se or sr? _(netstat | grep 5001)_ 1 How fast is transfer? No idea how to do this. Produce nice histogram plots! Base line local disk access for 1000 events on worker nodes. Compare with different RFIO buffers. -- Main.ChristopherCurtis - 29 May 2009 * [[%ATTACHURL%/sancho.sh][sancho.sh]]: sanch.sh - tool for finding files on the SE and printing filelists</verbatim>
Attachments
Attachments
Topic attachments
I
Attachment
History
Action
Size
Date
Who
Comment
sh
sancho.sh
r1
manage
3.2 K
10 Jun 2009 - 17:37
UnknownUser
sanch.sh - tool for finding files on the SE and printing filelists
Edit
|
Attach
|
Watch
|
P
rint version
|
H
istory
:
r10
|
r7
<
r6
<
r5
<
r4
|
B
acklinks
|
V
iew topic
|
Raw edit
|
More topic actions...
Topic revision: r5 - 11 Jun 2009
-
_47C_61UK_47O_61eScience_47OU_61Birmingham_47L_61ParticlePhysics_47CN_61christopher_32curtis
?
Computing
Log In
Computing Web
Create New Topic
Index
Search
Changes
Notifications
RSS Feed
Statistics
Preferences
Webs
ALICE
ATLAS
BILPA
CALICE
Computing
General
LHCb
LinearCollider
Main
NA62
Publish
Sandbox
TWiki
Welcome
Copyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki?
Send feedback