"Freight Train" production model on the NOvA experiment and NOvA efforts at Argonne Leadership Computing Facility

A large obstacle for any experiment is how to store, move, and process a large amount of data effectively. On the NuMI Off-axis nu_e Appearance (NOvA) experiment this is a rather substantial obstacle. The traditional method of grabbing a file is by categorizing all the files we care about by event-type and then going through each tape and gathering all files of that type. This is not ideal as it leads to multiple readings of the same tape. The Freight Train model of production at NOvA aims to address this inefficiency and will be presented in this talk. Additionally, NOvA has implemented a scheme to run a pre-reconstruction filter (neural network-based) to remove the most obvious cosmic rays from our large recorded cosmic ray sample to reduce processing needs. This step is processed at the Argonne Leadership Computing Facility (ALCF), leveraging the additional GPU and CPU resources. This talk will present NOvA's freight train production model and the pre-reconstruction implementation at ALCF.