SRM from PDSF to BNL for STAR
From CEDPS
Contents |
Context
From discussion on 07-31-2008 with Alex Sim, Junmin Gu, Doug Olson, Keith Beattie, Dan Gunter. Posted by Dan Gunter.
SRM status and plans
SRM is used by STAR jobs to transfer data back from PDSF, where the job runs, to BNL (where it was submitted). The script that invokes SRM is called "sums_copy", by the way. The current and soon-to-be plans for SRM transfers is shown in this diagram:
Issues
This still sticks us with the problem that the GridFTP server logs are on BNL, not PDSF. We'd like to combine them with the TechX instrumentation and SGE logs to get a full picture. In addition, BNL does not want to forward their logs to PDSF.
To-do
- Doug will talk to BNL and see if we can get some sort of arrangement for sending over the GridFTP server logs. Also we will see if we can get the "right" version of GridFTP installed there so the logs can include details if necessary.
- Dan and Doug will work with PDSF (Iwona) to get the "right" GridFTP server installed there for other bulk data transfers
- Keith is going to continue working on the Bestman (SRM) log parser so we at least have SRM's view of the world. Junmin is his contact, as she's writing the code.
- Dan and Alex are going to keep in mind the student project that's doing pattern-matching on SRM logs -- once the parser is working, the student can mine the database and put back errors into the DB as well.
