UnicodeDecodeError while processing fdsn request log

[icarluccio]

While processing the attached fdsn request log an error occurs on the first line.

fdsnws_requestLog.log.2024-12-30.gz

The error is reported below

Traceback (most recent call last):
  File "/usr/local/bin/eida_stats_aggregator", line 8, in <module>
    sys.exit(cli())
  File "/usr/lib/python3/dist-packages/click/core.py", line 1128, in __call__
    return self.main(*args, **kwargs)
  File "/usr/lib/python3/dist-packages/click/core.py", line 1053, in main
    rv = self.invoke(ctx)
  File "/usr/lib/python3/dist-packages/click/core.py", line 1395, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/usr/lib/python3/dist-packages/click/core.py", line 754, in invoke
    return __callback(*args, **kwargs)
  File "/usr/local/lib/python3.10/dist-packages/aggregator/aggregator.py", line 235, in cli
    statistics.parse_file(f)
  File "/usr/local/lib/python3.10/dist-packages/aggregator/aggregator.py", line 168, in parse_file
    with click.progressbar(logfile.readlines(), label=f"Parsing {filename}") as bar:
  File "/usr/lib/python3.10/codecs.py", line 322, in decode
    (result, consumed) = self._buffer_decode(data, self.errors, final)
UnicodeDecodeError: 'utf-8' codec can't decode byte 0xdf in position 10: invalid continuation byte

By removing the first line from the log file, the eida_stats_aggregator script runs successfully.

[icarluccio]

If my analysis is correct, checking inside the following line with an hexadecimal editor

{"service": "fdsnws-dataselect", "userID": 1645451296, "clientID": "Wget/1.21.2", "userEmail": null, "auth": false, "userLocation": {"country": null}, "created": "2024-12-30T00:00:00.163377Z", "trace": [{"net": "IV", "sta": "ASS", "loc": "", "cha": "SHZ", "start": "2009-04-11T20:49:27.0000Z", "end": "2009-04-11T20:52:47.0000Z", "restricted": false, "status": "NODATA", "bytes": 0}], "status": "NODATA", "bytes": 0, "finished": "2024-12-30T00:00:00.188065Z"}

The byte 0xdf (highlighted in the previous figure) responds to the space character after colon character related to "sta" key.