MIPAS is a Fourier Transform spectrometer that measured the atmospheric limb emission spectra in the middle infrared on board the ENVISAT satellite. These measurements allowed the global monitoring of the three-dimensional (latitude, longitude and altitude) distribution of temperature and of the concentrations of many species, during both day and night, for 10 years, from July 2002 to April 2012. MIPAS measurements allowed to study the atmosphere from the upper troposphere to the stratosphere and above, up to the thermosphere. The interest in these measurements goes beyond the end of the mission, as they can be used in long time series of data to determine changes in atmospheric composition and in our planet's climate. Furthermore, if the Changing-Atmosphere Infra-Red Tomography Explorer (CAIRT) mission, one of four candidates for Earth Explorer 11, will be selected, MIPAS data will constitute a benchmark for these measurements. CAIRT exploits indeed the heritage of MIPAS on ENVISAT, but allows to measure the composition of the atmosphere with unprecedented three-dimensional resolution being the first imaging Fourier Transform spectrometer sounding the limb of the atmosphere from space. For the last reanalysis of the whole MIPAS mission, a significant effort was made by the MIPAS Quality Working Group, supported by ESA, to improve both L1 [1] and L2 processors, as well as spectroscopy and Level 2 Initial Guess profiles [2], with the objectives of obtaining L2 products with increased accuracy, better temporal stability, and a larger number of retrieved species. The main improvements of L1 processor were related to the radiometric calibration and pointing. With these new processors a MIPAS full mission reprocessing has been recently performed ([1] and [3]). The quality of this final operational data set has been assessed with comprehensive validation studies including comparisons to ground-based in-situ and balloon-borne measurements. The dataset containing the new version 8 of both L1 and L2 products and covering the entire MIPAS operational lifetime period (2002-2012) is available at ESA Earth Online web site.This paper will focus on the lessons learnt, on the quality of the reprocessed data, on the remaining problems, and on further improvements that could improve the quality of both MIPAS L1 and L2 datasets.[1] Kleinert et al. Kleinert, A., Birk, M., Perron, G., and Wagner, G.: Level 1b error budget for MIPAS on ENVISAT, Atmos. Meas. Tech., 11, 5657-5672,https://doi.org/10.5194/amt-11-5657-2018, 2018 [2] Raspollini, P., Arnone, E., Barbara, F., Bianchini, M., Carli, B., Ceccherini, S., Chipperfield, M. P., Dehn, A., Della Fera, S., Dinelli, B. M., Dudhia, A., Flaud, J.-M., Gai, M., Kiefer, M., López-Puertas, M., Moore, D. P., Piro, A., Remedios, J. J., Ridolfi, M., Sembhi, H., Sgheri, L., and Zoppetti, N.: Level 2 processor and auxiliary data for ESA Version 8 final full mission analysis of MIPAS measurements on ENVISAT, Atmos. Meas. Tech. Discuss. [preprint], https://doi.org/10.5194/amt-2021-235, in review, 2021. [3] Dinelli, B. M., Raspollini, P., Gai, M., Sgheri, L., Ridolfi, M., Ceccherini, S., Barbara, F., Zoppetti, N., Castelli, E., Papandrea, E., Pettinari, P., Dehn, A., Dudhia, A., Kiefer, M., Piro, A., Flaud, J.-M., Lopez-Puertas, M., Moore, D., Remedios, J., and Bianchini, M.: The ESA MIPAS/ENVISAT Level2-v8 dataset: 10 years of measurements retrieved with ORM v8.22, Atmos. Meas. Tech. Discuss. [preprint], https://doi.org/10.5194/amt-2021-215, accepted, 2021.

High quality long-term data sets of altitude-resolved measurements of the atmospheric composition areimportant because they can be used both to study the evolu-tion of the atmosphere and as a benchmark for future mis-sions. For the final ESA reprocessing of MIPAS (MichelsonInterferometer for Passive Atmospheric Sounding) on ENVISAT (ENViromental SATellite) data, numerous improve-ments were implemented in the Level 2 (L2) processor Op-timised Retrieval Model (ORM) version 8.22 (V8) and itsauxiliary data. The implemented changes involve all aspects of the processing chain, from the modelling of the measure-ments with the handling of the horizontal inhomogeneitiesalong the line of sight to the use of the optimal estimationtechnique to retrieve the minor species, from a more sensitive approach to detecting the spectra affected by cloudsto a refined method for identifying low quality products. Improvements in the modelling of the measurements werealso obtained with an update of the used spectroscopic dataand of the databases providing the a priori knowledge ofthe atmosphere. The HITRAN_mipas_pf4.45 spectroscopic database was finalised with new spectroscopic data verifiedwith MIPAS measurements themselves, while recently measured cross-sections were used for the heavy molecules. TheLevel 2 Initial Guess (IG2) data set, containing the clima-tology used by the MIPAS L2 processor to generate the ini-tial guess and interfering species profiles when the retrieved profiles from previous scans are not available, was improved taking into account the diurnal variation of the profiles defined using climatologies from both measurements and models. Horizontal gradients were generated using the ECMWFERA-Interim data closest in time and space to the MIPASdata. Further improvements in the L2 V8 products derivedfrom the use of the L1b V8 products, which were upgraded to reduce the instrumental temporal drift and to handle theabrupt changes in the calibration gain. The improvements in-troduced into the ORM V8 L2 processor and its upgraded auxiliary data, together with the use of the L1b V8 products, lead to the generation of the MIPAS L2 V8 products, which are characterised by an increased accuracy, better temporal stability and a greater number of retrieved species.

Riporta i principali risultati ottenuti nell'ambito del progetto: "Support to MIPAS Level 2 processor Verification and Validation - Phase F", Contratto ESA 4000112093/14/I-LG, cioe' la messa a punto del codice ORM_V8 da utilizzare per la rianalisi di livello 2 dell'intera missione di MIPAS/ENVISAT, il dataset processato, i test di verifica e di validazione dei prodotti di Livello 2 generati.

The Optimized Retrieval Code (ORM) was originally designed to be the scientific code used as the reference for the ESA operational Near Real Time Analysis of MIPAS measurements on ENVISAT. After the end of ENVISAT mission, occurred on April 2017, this code has been adapted and improved to perform the reanalysis of the full MIPAS mission.

MIPAS on ENVISAT performed almost continuous measurements of atmospheric composition for approximately 10 years, from June 2002 to April 2012. ESA processor, based on the algorithm ORM (Optimized Retrieval Model), originally designed for the Near Real Time analysis and developed by an European Consortium led by IFAC, is currently used for the reanalysis of the full MIPAS mission. The maintenance and the upgrade of the ESA processor are made in the frame of the Quality Working Group, where a fruitful collaboration among Level 1, Level 2 and validation teams can be exploited. This collaboration is essential to pursue improvements in the accuracy of the products and their characterization. This paper is meant to describe the most recent upgrades in the ESA processor performed to improve the quality of ESA products. In particular, the full mission was recently reprocessed with L1 V7 and L2 V7 processors, containing significant improvements with respect to previous version V6, and further improvements are in preparation, that will be collected in version 8 of the ESA processor. Improvements involve both L1 and L2 processors, as well as the auxiliary data. Improvements in the L1 processor consist in a correction of the instrumental drift, improved spike detection algorithm and new Instrument Line Shape, as well as the use of measured daily gain instead of weekly gain. Improvements in the L2 processor include a different approach for retrieving atmospheric continuum, the use of an a posteriori regularization with altitude dependent constraint, a better approach for handling interfering species, a reduced bias in CFC-11, the handling of horizontal inhomogeneities and the use of ECMWF altitude/pressure relation for determining more accurate altitudes. Improvements in the auxiliary data consist in the use of microwindows with larger information content, new spectroscopic database and diurnally varying climatological dataset. Furthermore, with each new version additional species are provided, leading to 20 the number of retrieved species by the L2 V8 processor. Improvements in the V7 products will be revised on the light of the results of the validation with correlative measurements, and, by comparing the first new L2 V8 products with the L2 V7 ones, a preliminary assessment of the performance of the new V8 processor will be performed.

MIPAS on ENVISAT performed almost continuously measurements of the atmospheric composition for almost 10 years, from June 2002 to April 2012. These ten years cover a period when the first effect of the dismiss of the emission of the CFCs after the Montreal protocol ratification in 1987can be measured. Even if ten years constitute a short period to derive trends, it has been proven that useful information on time variation of atmospheric constituents can be derived from the analysis of these measurements. However, previous versions of MIPAS on ENVISAT dataset were characterized by an instrumental drift due to the fact that some detectors used by MIPAS were affected by non-linearities, which change with time due to the ageing of the detectors and this was cause of a non negligible systematic error in the trend estimation. The new full mission reprocessed dataset V7 that will be released very soon uses L1 files where the impact of the ageing of the detectors on non-linearities has been corrected. Furthermore, also the L2 processor has been upgraded with new functionalities improving the performances of the processor. We present the results of study of trends derived from the analysis of the new MIPAS V7 products on several MIPAS target species including ozone depleting species, like CFC-11, CFC-12, CCl4 and HCFC-22.

MIPAS measurements on ENVISAT represent a unique database for the study of atmospheric composition and of the time variation of atmospheric constituents. For trend studies it is important that instrumental drifts are reduced. Some of the MIPAS spectral bands are affected by time-dependent non-linearity which have been recently corrected. In addition to this non-linearity correction, the forthcoming new version of MIPAS products (Version 7) contains several other improvements: a new approach for handling continuum capable of making the retrieval more stable, a new selection of spectral intervals selected for the analysis of the full resolution measurements aimed to reduce the bias between full resolution and optimized resolution measurements, the regularization of the H2O profiles, the products of five new species (HCFC-22, CFC-14, HCN, COF2, CCl4), which makes equal to 15 the total number of retrieved species. The latest improvements implemented in the ESA processor and some of the results on trend will be presented and discussed.

MIPAS measurements on ENVISAT represent a unique database for the study of atmospheric composition and of the time variation of atmospheric constituents.For trend studies it is important that instrumental drifts are reduced. Some of the MIPAS spectral bands are affected by time-dependent non-linearity that have been recently corrected.In addition to this non-linearity correction, the forthcoming new version of MIPAS products (Version 7) contains several other improvements: a new approach for handling continuum leading to a more stable retrieval, a new selection of spectral intervals for the analysis of the full resolution measurements aiming to reduce the bias between full resolution and optimized resolution measurements, the regularization of the H2O profiles. Furthermore, the implementation of the retrieval of five new species (HCFC-22, CFC-14, HCN, COF2, CCl4) leads to a total of 15 species in ESA products.The latest improvements implemented in the ESA processor, the results of the validation of the products and some preliminary results on the trend of some ozone depleting substances will be presented and discussed.

The ESA-ESRIN contract no. 21719/08/I-OL covered the activities performed between April 2008 and July 2014 by the L2 sub-group of the MIPAS Quality Working Group. The main objective of this project was to monitor the quality of MIPAS L2 products, to improve the performances of the L2 ESA processor, used for both the near real time analysis during ENVISAT mission and for the off-line analysis, and to enlarge the list of retrieved species. In particular, three different versions of the MIPAS operational processor were finalized: IPF V5, ML2PP V6 and ML2PP V7, leading to significant improvements in the quality of the products and in their diagnostics, to an increase of the number of processed scans, and to an enlargement of the list of provided products. With respect to IPF V4.1&2, used to process only the first two years of MIPAS measurements (2002-2004, Full Resolution (FR) measurements) and validated with respect to correlative measurements (Ridolfi et al., 2006, Cortesi et al., 2007, Wang et al., 2007, Payan et al., 2009, Wetzel et al., 2007, Wetzel et al., 2013, all contained in the MIPAS special issue), IPF V5: o performs the analysis of the full mission (both FR and Optimized Resolution (OR) measurements, characterized by a reduced spectral resolution but finer spatial resolution) after the introduction of an a posteriori regularization with self-adapting threshold aimed to reduce instabilities of the retrieval with measurements of the OR phase (due to sampling intervals finer than the instantaneous field of view of the instrument and the choice of using a retrieval grid aligned with the vertical sampling of the measurements); o provides as output Averaging Kernel (AK) for each scan. Products of ML2PP V6 are very similar to the ones of V5 in terms of bias, but are characterized by: o an improved diagnostics, since the Covariance Matrix and the AK matrix are computed taking into account all iterations performed during the retrieval (this is needed if the final Marquardt parameter is different from zero). Furthermore, horizontal AKs are provided for each latitude band and each season. o additional four new species, namely CFC-11, CFC-12, N2O5 and ClONO2. MIPAS ESA processor products V7 are characterized by: o reduced time dependent calibration error due to non-linearities (coming from using new L1 data, V7); o availability of retrieval altitude grid characterized by a very small bias after correction with ECMWF pressure/altitude relationship; o new microwindows for FR measurements with an increased information content and leading to a reduction of the detected bias in the FR measurements for CH4, N2O and CFC-12; o larger stability, given by the new approach for retrieving continuum (the continuum transmission is fitted instead of the continuum cross-section), and new regularization with altitude dependent regularization strength; o lower bias of CFC-11, due to proper handling of COCl2 interfering species in the retrieval o better representation of the measurements, proven by the fact that a smaller chi-square is obtained for most of the species; o better handling of diurnally varying interfering species, coming from the use of diurnally varying Initial Guess profiles; o products of five new species (HCFC-22, CFC-14, COF2, CCl4 and HCN) available. Concerning V7 products, preliminary verifications have been performed only on the diagnostic dataset V7, including more than 4000 orbits: the Non-Linearity correction performed in the L1 files introduces a drift in V7 profiles with respect to previous versions, that corrects for the instrumental drift present in previous datasets. Some problems have also been identified: V7 FR Temperature profiles in polar and midlatitude regions presents a negative bias of about 0.5-1K with respect to both V6 products and correlative measurements coming from the Non-Linearity correction. In the tropics in general V7 Temperature has a positive bias with respect to previous versions, for both FR and OR measurements, and this seems to come from the new approach for handling continuum. A new version of the spectroscopic database has been finalized, with improvements in H2O, HNO3, COCl2 and C3H8. The new version of the spectroscopic database will be used for the final reprocessing of the whole MIPAS mission in the frame of the subsequent contract. A large effort was spent for improving the quality of the MIPAS L2 products, but further improvements have been identified as needed to reduce some systematic errors of the products and to fully exploit the information contained in MIPAS measurements. One of the main problems identified so far is the error due to the horizontal inhomogeneities that are not currently taken into account by the algorithm. The quality of the retrieval is affected by the horizontal gradients but from the analysis of single scans no enough information is contained in the measurements to retrieve the gradients. Considering that the code will be used only for a reanalysis, the choice has been to take advantage of the information on horizontal gradients of both temperature and target species from previous reprocessing or ECMWF reanalysis and to modify the forward model in order to handle the externally provided gradients. Another important objective is the full exploitation of MIPAS measurements that implies the retrieval of weaker and weaker species, whose interference from other species cannot be disentangled. To this purpose the possibility of performing a multi-target retrieval is crucial. Furthermore, we have to consider that the vertical profile retrieval of weak species requires the use of some constraint for the attainment of a fast and useful product and it can be useful to have the possibility of tuning or removing it as needed during the average procedure. To this purpose Optimal Estimation seems to be more apt than the current approach where the constraint is determined with a self-consistent method, difficult to rebuild. For very weak species a posteriori averages of retrieved profiles after removing a priori constrain, as studied in the frame of this project, can be also considered. Validation of ML2PP V7 and further investigations aimed to solve these open issues will be completed in the frame of the subsequent contract.

The MIPAS instrument on the ENVISAT satellite has provided vertical profiles of the atmospheric composition on a global scale for almost ten years. The MIPAS mission is divided in two phases, the full resolution phase, from 2002 to 2004, and the optimized resolution phase, from 2005 to 2012, which is characterized by a finer vertical and horizontal sampling attained through a reduction of the spectral resolution. While the description and characterization of the products of the ESA processor for the full resolution phase has been already described in previous papers, in this paper we focus on the performances of the latest version of the ESA processor, named ML2PP V6, which has been used for reprocessing the entire mission. The ESA processor had to perform the operational near real time analysis of the observations and its products needed to be available for data assimilation. Therefore, it has been designed for fast, continuous and automated analysis of observations made in quite different atmospheric conditions and for a minimum use of external constraints in order to avoid biases in the products. The dense vertical sampling of the measurements adopted in the second phase of the MIPAS mission resulted in sampling intervals finer than the instantaneous field of view of the instrument. Together with the choice of a retrieval grid aligned with the vertical sampling of the measurements, this made ill-conditioned the retrieval formalism of the MIPAS operational processor. This problem has been handled with minimal changes to the original retrieval approach but with significant improvements nonetheless. The Levenberg-Marquardt method, already present in the retrieval scheme for its capability to provide fast convergence for non-linear problems, is now also exploited for the reduction of the ill-conditioning of the inversion. An expression specifically designed for the regularizing Levenberg-Marquardt method has been implemented for the computation of the covariance matrices and averaging kernels of the retrieved products. The regularization of the Levenberg-Marquardt method is controlled by the convergence criteria and is deliberately kept weak. The resulting oscillations of the retrieved profile are a-posteriori damped by an innovative self-adapting Tikhonov regularization. The convergence criteria and the weakness of the self-adapting regularization ensure that minimum constraints are used and the best vertical resolution obtainable from the measurements is achieved in all atmospheric conditions. Random and systematic errors, as well as vertical and horizontal resolution are compared in the two phases of the mission for all products, namely: temperature, H2O, O3, HNO3, CH4, N2O, NO2, CFC-11, CFC-12, N2O5 and ClONO2. The use in the two phases of the mission of different optimized sets of spectral intervals ensures that, despite the different spectral resolutions, comparable performances are obtained in the whole MIPAS mission in terms of random and systematic errors, while the vertical resolution and the horizontal resolution are significantly better in the case of the optimized resolution measurements.

MIPAS measurements on ENVISAT represents a unique database for the study of atmospheric composition and of the time variation of atmospheric constituents and trends, in combination with other data. With the end of the ENVISAT mission, the importance of this decadal set of measurements justifies any efforts for their full exploitation. The maintenance and the upgrade of the ESA processor are made in the frame of the Quality Working Group, where a fruitful collaboration between L1, L2 and validation teams can be exploited. This collaboration is essential to pursue improvements in the accuracy of the products and their characterization. Recently a new version of the Level 2 processor (ML2PP V7) has been finalized, containing a new approach for handling continuum capable of making the retrieval more stable, a new selection of spectral intervals selected for the analysis of the full resolution measurements aimed to reduce the bias between full resolution and optimized resolution measurements, the regularization of the H2O profiles, the products of five new species (CFC-22, CFC-14, HCN, COF2, CCl4). The addition of these 5 species leads to 15 the number of species processed by the operational processor, but the list of retrieved species can be further enlarged. The latest improvements implemented in the ESA processor and the results of the feasibility studies for additional upgrades will be presented and discussed.

The MIPAS (Michelson Interferometer for Passive Atmospheric Sounding) instrument on the Envisat (Environmental satellite) satellite has provided vertical profiles of the atmospheric composition on a global scale for almost ten years. The MIPAS mission is divided in two phases: the full resolution phase, from 2002 to 2004, and the optimized resolution phase, from 2005 to 2012, which is characterized by a finer vertical and horizontal sampling attained through a reduction of the spectral resolution. While the description and characterization of the products of the ESA processor for the full resolution phase has been already described in previous papers, in this paper we focus on the performances of the latest version of the ESA (European Space Agency) processor, named ML2PP V6 (MIPAS Level 2 Prototype Processor), which has been used for reprocessing the entire mission. The ESA processor had to perform the operational near real time analysis of the observations and its products needed to be available for data assimilation. Therefore, it has been designed for fast, continuous and automated analysis of observations made in quite different atmospheric conditions and for a minimum use of external constraints in order to avoid biases in the products. The dense vertical sampling of the measurements adopted in the second phase of the MIPAS mission resulted in sampling intervals finer than the instantaneous field of view of the instrument. Together with the choice of a retrieval grid aligned with the vertical sampling of the measurements, this made ill-conditioned the retrieval problem of the MIPAS operational processor. This problem has been handled with minimal changes to the original retrieval approach but with significant improvements nonetheless. The Levenberg-Marquardt method, already present in the retrieval scheme for its capability to provide fast convergence for nonlinear problems, is now also exploited for the reduction of the ill-conditioning of the inversion. An expression specifically designed for the regularizing Levenberg-Marquardt method has been implemented for the computation of the covariance matrices and averaging kernels of the retrieved products. The regularization of the Levenberg-Marquardt method is controlled by the convergence criteria and is deliberately kept weak. The resulting oscillations of the retrieved profile are a posteriori damped by an innovative self-adapting Tikhonov regularization. The convergence criteria and the weakness of the self-adapting regularization ensure that minimum constraints are used and the best vertical resolution obtainable from the measurements is achieved in all atmospheric conditions. Random and systematic errors, as well as vertical and horizontal resolution are compared in the two phases of the mission for all products, namely: temperature, H2O, O-3, HNO3, CH4, N2O, NO2, CFC-11, CFC-12, N2O5 and ClONO2. The use in the two phases of the mission of different optimized sets of spectral intervals ensures that, despite the different spectral resolutions, comparable performances are obtained in the whole MIPAS mission in terms of random and systematic errors, while the vertical resolution and the horizontal resolution are significantly better in the case of the optimized resolution measurements.

The Michelson Interferometer for Passive Atmospheric Sounding (MIPAS) is a mid-infrared emission spectrometer which is part of the core payload of the Envisat satellite, launched by ESA in March 2002. It provides unique observations of the atmospheric spectral radiances in the 4.15 -14.6 ?m spectral interval with innovative limb scanning capabilities for the three dimensional observation of the atmospheric composition and processes. The species, the processes and events that have been studied with this instrument in its 10 years of operation are briefly reviewed.