Success Stories

From CEDPS

Here you'll find many examples of how CEDPS has helped research projects solve some important issues:

Troubleshooting Success Stories

• Workflow performance database for SCEC - To monitor and manage the results of their computation, the Southern California Earthquake Center (SCEC) CyberShake team is using CEDPS monitoring tools to normalize and ingest the results of their computations. Read more...
• Troubleshooting BeStMan performance for STAR - The CEDPS team worked with NERSC to measure the network with GridFTP and iperf tests to determine the optimal settings for BeStMan servers. Some of these measurements are [PDSF - BNL bandwidth measurements|hosted on the CEDPS wiki]. Read more...

Data Success Stories

• SSH GridFTP doubles data transfer rates for GFDL - SSH authenticated GridFTP developed by the CEDPS team allowed NOAA to quickly deploy it using the existing infrastructure. The data rates achieved with SSH authenticated globus-url-copy are roughly double (100MB/sec vs 50MB/sec) than what GFDL was achieving with other high speed data movement tools at a fraction of the system resource utilization. Read more...
• CEDPS work enables automated data movement within APS and improves the performance by a factor of 5 - The CEDPS team developed a *GridFTP server for Cygwin*, a Unix-like environment for Windows, which enables Advanced Photon Source (APS) to automate the data movement between its data acquisition machine (running on Windows) and its HPC cluster. CEDPS also developed a concurrency feature for GridFTP to speed up the transfer of data sets consisting of lots of small files. Read more...
• Internal and external data movement at ALCF - SSH- and HPSS-related functionalities developed by CEDPS are helping the internal and external data movement at Argonne Leadership Computing Facility (ALCF). Read more...
• Rapid data movement accelerates world-class science - GridFTP technology moves data from ASCR to DOE labs more than 20 times faster. Read more...
• CMS data movement: Checksum verification at FermiLab - The CEDPS team implemented a checksum verification capability in the dCache GridFTP server that has improved the reliability of CMS data transfers substantially and identified hardware issues to improve their infrastructure. Read more...
• NERSC and GridFTP - National Energy Research Scientific Computing Center (NERSC) uses high‐performance, striped GridFTP transfers with tunable buffer sizes for critical, time‐sensitive data transfers. Read more...
• DES Data Management effort relies on GridFTP for its data processing, data access, and archive systems - The Dark Energy Survey Data Management (DESDM) team relies on GridFTP as the underlying file transfer protocol for rapidly transferring large quantities of raw and reduced data between a collection of heterogeneous sites. Read more...
• CEDPS tools enable the Ultravis project to move data at 30-45x faster - A new SSH GridFTP server has Ultravis seeing 30-45x improvements in performance for transferring Gigabytes of data. Read more...

Scalable Services Success Stories

• CEDPS success with caBIG and APS beamline - CEDPS has designed and implemented several innovative technologies in the caBIG architecture and has developed a collaborative information network to enable interoperability among biomedial databases and analytical tools. Read more...
• Argonne Cloud Computing Helps CERN Scientists - The CEDPS-developed Nimbus system is helping CERN integrate their existing distributed computers into "science clouds". Read more...
• Nimbus and Cloud Computing Meet STAR Production Demands - working with technology developed by the Nimbus team, the STAR researchers (at Brookhaven National Laboratory's Relativistic Heavy-Ion Collider) were able to dynamically provision virtual clusters on commercial cloud computers and run additional computations needed for a presentation at the Quark Matter physics conference. Read more...
• APS Running Remote Applications More Easily - The CEDPS-funded Remote Application Virtualization Infrastructure (RAVi) project is working with the APS to allow them to run applications over the TeraGrid resources without the end user having to write a single line of code. Read more...