Eventdisplay - version v490-alpha.8

Eventdisplay v490 is a major update of the reconstruction and analysis code used for VERITAS.
This update includes significant changes which break the analysis of older versions at certain stages.

Running this version requires also updates to the newest versions of Eventdisplay_AnalysisScripts_VTS and Eventdisplay_AnalysisFiles_VTS (private repository).

This is a pre-release with substantial changes expected in near future. Please try it out, but don't use it for science publications.
Changes with relation to v490-alpha.7 are:

Combine lookup tables

More flexibility to find correct NSB bins when combing lookup tables; add command line parameters noise tolerance in combineEffectiveAreas.

Propagation of cluster cleaning from v5

Propagated cluster cleaning from v5 to v490.

• removes islands with N pixels or with size smaller than a certain value
• settings see EVNDISP.reconstruction.runparameter.CC.v4x

Addition of AP cleaning

Addition of removal of islands consisting of a single image and a single border pixel, triggered by Jamie's study on increased afterpulsing contributions.

• switch this on by adding one parameter 1 to * -1 IMAGECLEANINGTHRESHOLDS 5. 2.5 1
• settings see EVNDISP.reconstruction.runparameter.AP.v4x

Improvement of optimized next-neighbour cleaning

Improved handling of short runs when there are not enough entries in the pedestal histograms to determine correct cleaning cuts. In this case, a single average histogram is filled to calculate the cleaning thresholds.

Other changes

• improved installation hints
• critical bug fix in filling lookup tables, using the correct direction values

What's Changed

• Deal with short runs with low number of events required for IPR Grphs by @GernotMaier in #209
• v490 - alpha.0.8 by @GernotMaier in #208

Full Changelog: v490-alpha.7...v490-alpha.8

Eventdisplay - version v490-alpha.7

Eventdisplay v490 is a major update of the reconstruction and analysis code used for VERITAS.
This update includes significant changes which break the analysis of older versions at certain stages.

Running this version requires also updates to the newest versions of Eventdisplay_AnalysisScripts_VTS and Eventdisplay_AnalysisFiles_VTS (private repository).

This is a pre-release with substantial changes expected in near future. Please try it out, but don't use it for science publications.
Changes with relation to v490-alpha.6 are:

Cleanup of compilation warnings and C++17

General cleanup of compilation warnings and changes to allow for C++ 14 compilation.

VLowGainCalibrator not working on all systems

VLowGainCalibrator depends on TSpectrum, which is depreciated. To allow compilation of slib, this is handled now automatically through the Makefile. Meaning that on some newer systems (e.g., 6.26.06-fedora35) the low-gain calibration scripts are not working (see issue #207)

What's Changed

• v490 - alpha.0.7 by @GernotMaier in #205

Full Changelog: v490-alpha.6...v490-alpha.7

Eventdisplay - version v490-alpha.6

Includes changes fromp v490-alpha.4, v490-alpha.5, v490-alpha.6

Eventdisplay v490 is a major update of the reconstruction and analysis code used for VERITAS.
This update includes significant changes which break the analysis of older versions at certain stages.

Running this version requires also updates to the newest versions of Eventdisplay_AnalysisScripts_VTS and Eventdisplay_AnalysisFiles_VTS (private repository).

This is a pre-release with substantial changes expected in near future. Please try it out, but don't use it for science publications.
Changes with relation to v490-alpha.3 are:

Use Pointing status bit

VPM report success of pointing reconstruction. This is used now, events without useful pointing are discarded (generally very few events; often at the very end of a run)

Improvements in plotting of instrument response functions

Re-enable plotting of instrument response functions vs true energy: Effective area files contain since v497 two trees: fEffArea (with reconstructed energy axis) and fEffAreaH2F (with true energy axis). Change reading routines to re-enable plotting of IRFs vs true energy.

Improve angular resolution plotting and fix issue with plotting cumulative theta2 distributions.

Energy axes for energy reconstruction lookup tables

Removed dynamic setting of energy axes limits (1D histogram for tables) in lookup table code and fixed it to 150 TeV (well beyond what we do in VERITAS). Dynamic settings were introduced for CTA (telescope types), but the version in Eventdisplay_v4 had a minor bug.

DISP reconstruction

Improvement how head/tail uncertainty is resolved. Apply minimum angle cut for 2-tel events only.

Remove duplication of date/MJD in season definition

Having both MJD and SQL-strings lead to errors in definitions of yearly seasons. Removed the MJD, which is now calculated in VEvndispRunParameter from the sql string.

Remove obsolete TableEnergy filling

Remove filling of unused tables with energy / R axes

Unweighted simulated histograms

Add unweighted histograms to effective area output files (mostly for debugging now; later useful for DL2).

Command line parameters to overwrite target runinfo DB values

Add possibility to overwrite the DB settings for target information (read usually from the runinfo db table): -overwritedb_rightascension, -overwritedb_declination, -overwritedb_target (this complements the existing command line options for the wobble offset: overwritedb_wobblenorth and overwritedb_wobbleeast

Eventdisplay - version v487e

v487d patch release of Eventdisplay

Very minor patch release

• printing of Non/Noff events to ecsv files

Wiki page: https://veritas.sao.arizona.edu/wiki/Eventdisplay_v487

Eventdisplay - version v490-alpha.3

Eventdisplay v490 is a major update of the reconstruction and analysis code used for VERITAS.
This update includes significant changes which break the analysis of older versions at certain stages.

Running this version requires also updates to the newest versions of Eventdisplay_AnalysisScripts_VTS and Eventdisplay_AnalysisFiles_VTS (private repository).

This is a pre-release with substantial changes expected in near future. Please try it out, but don't use it for science publications.
Changes with relation to v490-alpha.1 are:

dispBDT angular resolution

• add correct addition of VPM pointing monitor correction to dispBDT direction reconstruction

Writing of image/border pixel lists on evndisp stage

Option -writeimagepixellist to evndisp allows to write out list of pixel (with integrated charge and timing) surviving the image cleaning.

This option increases the output files of evndisp by approximately a factor 2.5-3. It is therefore switched off by default.

Written are image, border pixels, and one additional ring of pixels around them.

Written the pars trees:

PixelListN : PixelListN/i
PixelID   : PixelID[PixelListN]/i 
PixelType : PixelType[PixelListN]/i 
PixelIntensity : PixelIntensity[PixelListN]/F
PixelTimingT0 : PixelTimingT0[PixelListN]/F 

PixelType indicates the following:

• PixelType == 1: image pixel
• PixelType == 2: border pixel
• PixelType == 3: neighbour pixel to image/border

Use DB text files instead of direct query to VERITAS data base

New functionality to read DB text files. This allows faster parallel processing of many runs without opening up too many connections to the VERITAS database. Requires reading of DB information using the scripts available in the db_scripts directory of Eventdisplay_AnalysisScripts_VTS. Possibly also a step to remove the ROOT-mysql dependency and allow for easier compilation.

Others

• DOI badge

Eventdisplay - version v490-alpha.2

(consistency release - no major updates to v490-alpha.1)

Eventdisplay - version v490-alpha.1

Eventdisplay v490 is a major update of the reconstruction and analysis code used for VERITAS.
This update includes significant changes which break the analysis of older versions at certain stages.

Running this version requires also updates to the newest versions of Eventdisplay_AnalysisScripts_VTS and Eventdisplay_AnalysisFiles_VTS (private repository).

This is a pre-release with substantial changes expected in near future. Please try it out, but don't use it for science publications.

Eventdisplay v490 is now public

Similar to the Eventdisplay version used for CTA (see here), this code is now public.

Optimised next-neighbour cleaning

(back ported from v5)

Improves the low-energy response.

• requires to run Evetndisplay with the runparameter file EVNDISP.reconstruction.runparameter.NN.v4x

dispBDT angular resolution

(back ported from v5)

Improves direction reconstruction at low elevation angles (issue #184 and PR #190).

Note that dispBDT direction reconstruction is applied on the mscw_energy stage.

• dispBDT files are located in $VERITAS_EVNDISP_AUX_DIR/DispBDTs
• in alpha release: must be switched on in IRF.mscw_energy_MC.sh and ANALYSIS.mscw_energy.sh (search for DISPBDT)

Replacement of slalib routines by sofa

see PR #180

Eventdisplay has been using a copy of the slalib code since the very beginning (VASlalib). All astronometry routines are replaced by the sofa package (same authors as slalib; but permissive licence) for the following reasons:

• slalib (as used in Eventdisplay) is not maintained since many years and the status of the routines is unclear (e.g. means that timing routines do not include leap seconds introduced recently)
• slalib's licence unclear and very likely the current usage Eventdisplay is not allowed
• sofa is a well maintained IAU package

#PR 180 lists some tests listing differences between using the two different astronometry packages: generally consistent results with max differences in reconstructions observations of <2 arcseconds.

Note that this involves the installation of the sofa package before compiling eventdisplay. Use the script install_sofa.sh to download and install the package.

Addition of mergeVBF binaries

mergeVBF is used for the simulation production to merge several (possibly 1000s) of simulation vbf files into one file.

Improved MC/Data comparison plots

Improvements to MC/Data comparison includes:

• weighting of events according to the azimuth of the data runs
• energy-dependent theta2 comparision

Code cleanup

Eventdisplay-code base includes a lot of obsolete code which makes maintenance more difficult than necessary. Try and remove anything which will not be used in future: CTA-related code (uses v5), frogs and 3D model (will realistically never by used and would require a re-implementation); other smaller bits.

Code formatting (astyle) has been applied. For git diffs, best to remove white space comparision.

Eventdisplay - version v487d

v487d patch release of Eventdisplay

Very minor patch release

• bug fix in reading IRFs as function of true energy (relevant for using likelihood method, see issue #164)
• re-enable writing of data_on and data_off trees in anasum when user sets this flag in the anasum runparameter file: * WRITEDATAONOFFEVENTS 1. Note that these trees are a subset of the DL3EventTree.
• expand environmental variables when writing to cvs in VEnergySpectrum
• add further options for the storage of log files in the evndisp root files (./bin/logFile)

Wiki page: https://veritas.sao.arizona.edu/wiki/Eventdisplay_v487

Eventdisplay - version v487c

v487c patch release of Eventdisplay

Very minor patch release

• improved printout in combineEffectiveArea help
• additional variables written to pointing tree for DB pointing (useful for debugging)
• removal of duplicated entries from Makefile targets.

Release wiki page including the list of major changes: https://veritas.sao.arizona.edu/wiki/Eventdisplay_v487

Eventdisplay - version v487b

v487b patch release of Eventdisplay

Addresses critical issue as described in #170

Release wiki page including the list of major changes: https://veritas.sao.arizona.edu/wiki/Eventdisplay_v487