Sharing computational results via SeedMe platform
Presented at the SEA Software Engineering Conference 2015, Boulder, CO
Computational simulations have become an indispensable tool in a wide variety of science and engineering investigations. Nearly all scientific computation and analyses create important transient data and preliminary results. These transient data include information dumped while a job is running, such as coarse output and run statistics. Preliminary results include data output by a running or finished job that needs to be quickly processed to get a view of the job’s success or failure. These job output data provide vital guidance that helps scientists review a current job and adjust parameters for the next job to run. Quick and effective assessments of these data are necessary for efficient use of the computation resources, but this is complicated when a large collaborating team is geographically dispersed and/or some team members do not have direct access to the computation resource and output data. Current methods for sharing and assessing transient data and preliminary results are cumbersome, labor intensive, and largely unsupported by useful tools and procedures. Each research team is forced to create their own scripts and ad-hoc procedures to push data from system to system, and user to user, and to make quick plots, images, and videos to guide the next step in their research. These custom efforts often rely on email, ftp, and scp, despite the ubiquity of much more flexible dynamic web-based technologies and the impressive display and interaction abilities of today’s mobile devices.
This talk introduces SeedMe platform that provides web-based building blocks and cyberinfrastructure to enable easy sharing and streaming of transient data and preliminary results from computing resources to a variety of platforms, from mobile devices to workstations, and make it possible to quickly and conveniently view and assess results and provide an essential missing component in High Performance Computing (HPC) and cloud computing infrastructure The presentation will include a short demonstration of SeedMe platform and tools.