NearData Project Meeting in Barcelona 

NearData Project Meeting in Barcelona 

The recent meeting of an international consortium working on the “NEARDATA: Extreme Near-Data Processing Platform” took place in the amenities of Barcelona Supercomputing Centre, one of the project participants, on 22-23 January 2024. During the meeting, the consortium planned the first releases of software, future publications, and preparations for the project review. 

Scientists from Sano, including Dr. Maciej Malawski, Dr. Sabina Lichołai, Piotr Kica, and Kamil Burkiewicz, successfully presented the Sano Use Case demo of the Transcriptomics Atlas Pipeline on HPC and AWS Cloud, and had many fruitful discussions with colleagues.  

Sano would like to thank colleagues from Rovira i Virgili University who gave insights about using Lithops and DataPlug on the pipeline developed by Sano. As well as colleagues from Dresden University of Technology (TUD) and Barcelona Supercomputing Centre for discussions on the use of SCONE secure computing framework for federated learning use case and running the pipelines on the MareNostrum supercomputer respectively.  

The NEARDATA project’s goal is to develop a novel data platform located between Object Storage technology and Analytics platforms including high performance data connectors for health datasets. Data connectors will explore a novel near-data process-then-compute paradigm that avoids moving huge volumes of data and thus boosting performance and scalability. 

More information about the project https://neardata.eu/