Apercal - The Apertif calibration pipeline
Journal article, 2022
Apertif (APERture Tile In Focus) is one of the Square Kilometre Array (SKA) pathfinder facilities. The Apertif project is an upgrade to the 50-year-old Westerbork Synthesis Radio Telescope (WSRT) using phased-array feed technology. The new receivers create 40 individual beams on the sky, achieving an instantaneous sky coverage of 6.5 square degrees. The primary goal of the Apertif Imaging Survey is to perform a wide survey of 3500 square degrees (AWES) and a medium deep survey of 350 square degrees (AMES) of neutral atomic hydrogen (up to a redshift of 0.26), radio continuum emission and polarisation. Each survey pointing yields 4.6 TB of correlated data. The goal of Apercal is to process this data and fully automatically generate science ready data products for the astronomical community while keeping up with the survey observations. We make use of common astronomical software packages in combination with Python based routines and parallelisation. We use an object oriented module-based approach to ensure easy adaptation of the pipeline. A Jupyter notebook based framework allows user interaction and execution of individual modules as well as a full automatic processing of a complete survey observation. If nothing interrupts processing, we are able to reduce a single pointing survey observation on our five node cluster with 24 physical cores and 256 GB of memory each within 24 h keeping up with the speed of the surveys. The quality of the generated images is sufficient for scientific usage for 44% of the recorded data products with single images reaching dynamic ranges of several thousands. Future improvements will increase this percentage to over 80%. Our design allowed development of the pipeline in parallel to the commissioning of the Apertif system.
Pipelines
Data reduction
Image processing
Techniques
Surveys
Telescopes
Author
B. Adebahr
Netherlands Institute for Radio Astronomy (ASTRON)
Ruhr-Universität Bochum
R. Schulz
Netherlands Institute for Radio Astronomy (ASTRON)
T. J. Dijkema
Netherlands Institute for Radio Astronomy (ASTRON)
V. A. Moss
The University of Sydney
Commonwealth Scientific and Industrial Research Organisation (CSIRO)
Netherlands Institute for Radio Astronomy (ASTRON)
A. R. Offringa
University of Groningen
Netherlands Institute for Radio Astronomy (ASTRON)
A. M. Kutkin
Russian Academy of Sciences
Netherlands Institute for Radio Astronomy (ASTRON)
J. M. van der Hulst
University of Groningen
B. S. Frank
South African Radio Astronomy Observatory (SARAO)
University of Cape Town
University of the Western Cape
N. Vilchez
Netherlands Institute for Radio Astronomy (ASTRON)
J. Verstappen
University of Groningen
Netherlands Institute for Radio Astronomy (ASTRON)
E. K. Adams
University of Groningen
Netherlands Institute for Radio Astronomy (ASTRON)
W.J.G. de Blok
University of Cape Town
Netherlands Institute for Radio Astronomy (ASTRON)
University of Groningen
H. Dénes
Netherlands Institute for Radio Astronomy (ASTRON)
Kelley Michelle Hess
Spanish National Research Council (CSIC)
Netherlands Institute for Radio Astronomy (ASTRON)
University of Groningen
D. M. Lucero
Virginia Polytechnic Institute and State University
R. Morganti
Netherlands Institute for Radio Astronomy (ASTRON)
University of Groningen
T. Oosterloo
University of Groningen
Netherlands Institute for Radio Astronomy (ASTRON)
D. J. Pisano
West Virginia University
Marianna Ivashina
Chalmers, Electrical Engineering, Communication, Antennas and Optical Networks
W. van Cappellen
Netherlands Institute for Radio Astronomy (ASTRON)
L. Connor
Netherlands Institute for Radio Astronomy (ASTRON)
University of Amsterdam
A. H.W.M. Coolen
Netherlands Institute for Radio Astronomy (ASTRON)
Sieds Damstra
Netherlands Institute for Radio Astronomy (ASTRON)
G. M. Loose
Netherlands Institute for Radio Astronomy (ASTRON)
Y. Maan
Netherlands Institute for Radio Astronomy (ASTRON)
F. M. Maccagni
Istituto nazionale di astrofisica (INAF)
Mika
Netherlands Institute for Radio Astronomy (ASTRON)
H. Mulder
Netherlands Institute for Radio Astronomy (ASTRON)
L. C. Oostrum
University of Amsterdam
Netherlands eScience Center
Netherlands Institute for Radio Astronomy (ASTRON)
E. Orrú
Netherlands Institute for Radio Astronomy (ASTRON)
R. Smits
Netherlands Institute for Radio Astronomy (ASTRON)
D. Van Der Schuur
Netherlands Institute for Radio Astronomy (ASTRON)
J. van Leeuwen
University of Amsterdam
Netherlands Institute for Radio Astronomy (ASTRON)
D. Vohl
Netherlands Institute for Radio Astronomy (ASTRON)
S. J. Wijnholds
Netherlands Institute for Radio Astronomy (ASTRON)
J. Ziemke
Netherlands Institute for Radio Astronomy (ASTRON)
University of Groningen
Astronomy and Computing
2213-1337 (ISSN)
Vol. 38 100514Subject Categories (SSIF 2011)
Other Computer and Information Science
Software Engineering
Media Engineering
DOI
10.1016/j.ascom.2021.100514