WP13: Data handling and distribution

This Work Package determines how the EISCAT_3D data system will be implemented on the e-infrastructure which currently exists in northern Scandinavia (or that which is planned for the near future). Carried out by Uppsala University (UU), hosting the Swedish National Infrastructure for Computing (SNIC) together with Umeå University, third party of UU, it will engage with the national providers of networking, storage and high performance computing to ensure that the requirements of the project can be optimally satisfied. SNIC will perform this work interacting with EISCAT Scientific Association, University of Oulu, STFC and National Instruments.

In the FP6 Design Study an extensive Work Package was devoted to the design of a two-tier data system, in which high volume data would be held close to the array before being optimally processed into lower-volume data products for transfer into a long-term data archive. It was shown that systems of the required capacity could be realised with existing technology. However, such systems are expensive and their operation is quite resource intensive for a small organization such as EISCAT.

In this Work Package the following activities will be performed:

  • Determining how to address the networking requirements, using existing fibre networks as far as possible.
  • Examination of any changes to the data-handling philosophy which might be required if the Software-Defined Radio philosophy is adopted for the signal processing and beam-forming.
  • Examination of the potential of existing resource providers to help address the storage and computing requirements for the EISCAT_3D system.

This Work Package will be carried out in close collaboration with WP2, WP3 and WP11, in order to ensure that the demands of the data system are consistent with the EISCAT_3D hardware and software, that they are matched to the availability of local infrastructure, and that the products available from the data system match the requirements of the future EISCAT_3D users, including those in areas such as applications and modelling.