U.S. Department of Energy

Pacific Northwest National Laboratory

Towards Adaptive, Streaming Analysis of X-ray Tomography Data

Publish Date: 
Wednesday, April 1, 2015
Temporal and spatial resolution of chemical imaging methodologies such as x-ray tomography are rapidly increasing, leading to more complex experimental procedures and fast growing data volumes. Automated analysis pipelines and big data analytics are becoming essential to effectively evaluate the results of such experiments. Offering those data techniques in an adaptive, streaming environment can further substantially improve the scientific discovery process, by enabling experimental control and steering based on the evaluation of emerging phenomena as they are observed by the experiment. Pacific Northwest National Laboratory (PNNL)’ Chemical Imaging Initiative (CII - http://imaging.pnnl.gov/ ) has worked since 2011 towards developing a framework that allows users to rapidly compose and customize high throughput experimental analysis pipelines for multiple instrument types. The framework, named ‘Rapid Experimental Analysis’ (REXAN) Framework [1], is based on the idea of reusable component libraries and utilizes the PNNL developed collaborative data management and analysis environment ‘Velo’, to provide a user friendly analysis and data management environment for experimental facilities. This article will, discuss the capabilities established for X-Ray tomography, discuss lessons learned, and provide an overview of our more recent work in the Analysis in Motion Initiative (AIM - http://aim.pnnl.gov/ ) at PNNL to provide REXAN capabilities in a streaming environment.
Thomas M, K Kleese van Dam, MJ Marshall, AP Kuprat, JP Carson, CS Lansing, ZC Guillen, EA Miller, I Lanekoff, and J Laskin. 2015. "Towards adaptive, streaming analysis of x-ray tomography data." Synchrotron Radiation News 28(2):10-14.
| Pacific Northwest National Laboratory