Rate too high: Datenpunkt wird trotzdem im Dataviewer angezeigt

[reserve85]

The Problem

Ist es möglich den Datenpunkt in der *.csv zu ignorieren?
Beim Anzeigen ggf. auf "no error" an 8. Stelle mit überprüfen, ansonsten den Punkt ignorieren.

Version

Release: v13.0.8 (Commit: 04f2f23+)

Logfile

2022-12-30T08:14:54+0100,main,31300.06,31300.06,31300.06,0.000000,0.00,no error,2.9,1.0,2.9,9.9,10.0,0.0,6.0
2022-12-30T08:14:54+0100,main,31360.06,31360.06,31300.06,12.000000,0.00,,3.3,1.4,3.3,6.3,10.0,0.0,6.0
2022-12-30T08:14:54+0100,main,31360.06,,31300.06,,0.00,Rate too high - Read: 31360.06 - Pre: 31300.06 - Rate: 60.00,3.3,1.4,3.3,6.3,10.0,0.0,6.0
2022-12-30T08:24:54+0100,main,31300.06,31300.06,31300.06,0.000000,0.00,no error,3.0,1.0,2.8,9.9,10.0,0.0,6.0

Expected Behavior

Der fehlerhafte Datenpunkt sollte bei der grafischen Anzeige ignoriert werden.

Screenshots

Additional Context

No response

[forrestfunk]

Den Fehler hatte ich auch schon. Siehe auch hier:
Diskussion
Ich wollte auch ein bug report starten, habe aber kein log (mehr) zu dem Vorfall und bisher ist der Fehler nicht nochmal aufgetreten (habe mein Erkennsungsmodel auf "dig-class100-0150" gestellt, seitdem läuft mein System deutlich stabiler).

gleiche Version v13.0.8

[caco3]

Could be related to #1710

[caco3]

[reserve85]

Why not simply use the „previous data“ value from the csv?

[caco3]

That's how it works. The problem seems to be that the erroneous data also ends up in this csv file.

So we either must:

• Not add erroneous data to the data files, or
• skip this data in the plot

[reserve85]

I think you use the return value and not the pre value? In my log the pre value would be correct, even if it’s a error line.

Content: time, name-of-number, raw-value, return-value, pre-value, change-rate, change-absolute, error-text, cnn-digital, cnn-analog

[forrestfunk]

I don't know if that's useful to you and if you still need more info on this? I was able to capture the bug in debug mode.

Data graph:

Data viewer:

Debug log:

[0d21h30m34s] 2023-01-08T10:28:46 [TFLITE SERVER] Round #259 started
[0d21h30m34s] 2023-01-08T10:28:46 [MQTT IF] Published topic: wasserzaehler/status, content: Take Image (msg_id=5217)
[0d21h30m40s] 2023-01-08T10:28:51 [MQTT IF] Published topic: wasserzaehler/status, content: Aligning (msg_id=5218)
[0d21h31m20s] 2023-01-08T10:29:31 [MQTT IF] Published topic: wasserzaehler/status, content: Digitalization of ROIs (msg_id=5219)
[0d21h31m20s] 2023-01-08T10:29:31 [CNN] doFlow nach Alignment
[0d21h31m20s] 2023-01-08T10:29:32 [TFLITE] Make Allocate
[0d21h31m20s] 2023-01-08T10:29:32 [CNN] Processing Number 'main'
[0d21h31m20s] 2023-01-08T10:29:32 [CNN] ROI #0 - TfLite
[0d21h31m20s] 2023-01-08T10:29:32 [CNN] CNN Type: Digital100 or Analogue100
[0d21h31m21s] 2023-01-08T10:29:33 [CNN] ROI #1 - TfLite
[0d21h31m21s] 2023-01-08T10:29:33 [CNN] CNN Type: Digital100 or Analogue100
[0d21h31m22s] 2023-01-08T10:29:34 [CNN] ROI #2 - TfLite
[0d21h31m22s] 2023-01-08T10:29:34 [CNN] CNN Type: Digital100 or Analogue100
[0d21h31m23s] 2023-01-08T10:29:34 [CNN] ROI #3 - TfLite
[0d21h31m23s] 2023-01-08T10:29:34 [CNN] CNN Type: Digital100 or Analogue100
[0d21h31m24s] 2023-01-08T10:29:35 [CNN] ROI #4 - TfLite
[0d21h31m24s] 2023-01-08T10:29:35 [CNN] CNN Type: Digital100 or Analogue100
[0d21h31m24s] 2023-01-08T10:29:36 [MQTT IF] Published topic: wasserzaehler/status, content: Digitalization of ROIs (msg_id=5220)
[0d21h31m25s] 2023-01-08T10:29:36 [CNN] doFlow nach Alignment
[0d21h31m25s] 2023-01-08T10:29:37 [TFLITE] Make Allocate
[0d21h31m25s] 2023-01-08T10:29:37 [CNN] Processing Number 'main'
[0d21h31m25s] 2023-01-08T10:29:37 [CNN] ROI #0 - TfLite
[0d21h31m25s] 2023-01-08T10:29:37 [CNN] CNN Type: Analogue
[0d21h31m26s] 2023-01-08T10:29:38 [CNN] Nach Invoke
[0d21h31m26s] 2023-01-08T10:29:38 [CNN] ROI #1 - TfLite
[0d21h31m26s] 2023-01-08T10:29:38 [CNN] CNN Type: Analogue
[0d21h31m27s] 2023-01-08T10:29:39 [CNN] Nach Invoke
[0d21h31m27s] 2023-01-08T10:29:39 [CNN] ROI #2 - TfLite
[0d21h31m27s] 2023-01-08T10:29:39 [CNN] CNN Type: Analogue
[0d21h31m28s] 2023-01-08T10:29:40 [CNN] Nach Invoke
[0d21h31m28s] 2023-01-08T10:29:40 [CNN] ROI #3 - TfLite
[0d21h31m28s] 2023-01-08T10:29:40 [CNN] CNN Type: Analogue
[0d21h31m29s] 2023-01-08T10:29:41 [CNN] Nach Invoke
[0d21h31m29s] 2023-01-08T10:29:41 [MQTT IF] Published topic: wasserzaehler/status, content: Post-Processing (msg_id=5221)
[0d21h31m29s] 2023-01-08T10:29:41 [CNN] getReadout _analog=0, _extendedResolution=0, prev=-1
[0d21h31m29s] 2023-01-08T10:29:41 [CNN] ZeigerEvalAnalogNeu - kein Vorgänger - Ergebnis = 5 zahl: 5.651917 ziffer_vorgaenger = -1 AnalogFehler = 3.000000
[0d21h31m29s] 2023-01-08T10:29:41 [CNN] ZeigerEvalAnalogNeu - Zahl eindeutig, keine Korrektur notwendig - Ergebnis = 3 zahl: 3.422153 ziffer_vorgaenger = 5 AnalogFehler = 3.000000
[0d21h31m29s] 2023-01-08T10:29:41 [CNN] ZeigerEvalAnalogNeu - Zahl eindeutig, keine Korrektur notwendig - Ergebnis = 7 zahl: 7.431698 ziffer_vorgaenger = 3 AnalogFehler = 3.000000
[0d21h31m29s] 2023-01-08T10:29:41 [CNN] ZeigerEvalAnalogNeu - Zahl uneindeutig, Korrektur nach unten - Ergebnis = 6 zahl: 6.712809 ziffer_vorgaenger = 7 AnalogFehler = 3.000000
[0d21h31m29s] 2023-01-08T10:29:41 [CNN] getReadout _analog=0, _extendedResolution=0, prev=6
[0d21h31m29s] 2023-01-08T10:29:41 [CNN] ZeigerEvalAnalogToDigitNeu - digitaleUnschaerfe - Ergebnis = 1 zahl: 0.900000 ziffer_vorgaenger: 6.712809 erg_vorkomma: 1 erg_nachkomma: 0
[0d21h31m29s] 2023-01-08T10:29:41 [CNN] ZeigerEvalHybridNeu - Analoger Vorgänger, Bewertung über ZeigerEvalAnalogNeu = 1 zahl: 0.900000 zahl_vorgaenger = 6.712809 eval_vorgaenger = 6 DigitalUnschaerfe = 0.200000
[0d21h31m29s] 2023-01-08T10:29:41 [CNN] getReadout(dig100) prev=1
[0d21h31m29s] 2023-01-08T10:29:41 [CNN] ZeigerEvalHybridNeu - KEIN Analoger Vorgänger, kein Ziffernwechsel, da Vorkomma weit genug weg = 1 zahl: 0.900000 zahl_vorgaenger = 0.900000 eval_vorgaenger = 1 DigitalUnschaerfe = 0.200000
[0d21h31m29s] 2023-01-08T10:29:41 [CNN] getReadout#ZeigerEvalHybridNeu()= 1
[0d21h31m29s] 2023-01-08T10:29:41 [CNN] getReadout#result= 11
[0d21h31m29s] 2023-01-08T10:29:41 [CNN] ZeigerEvalHybridNeu - KEIN Analoger Vorgänger, kein Ziffernwechsel, da Vorkomma weit genug weg = 7 zahl: 7.000000 zahl_vorgaenger = 0.900000 eval_vorgaenger = 1 DigitalUnschaerfe = 0.200000
[0d21h31m29s] 2023-01-08T10:29:41 [CNN] getReadout#ZeigerEvalHybridNeu()= 7
[0d21h31m29s] 2023-01-08T10:29:41 [CNN] getReadout#result= 711
[0d21h31m29s] 2023-01-08T10:29:41 [CNN] ZeigerEvalHybridNeu - KEIN Analoger Vorgänger, kein Ziffernwechsel, da Vorkomma weit genug weg = 1 zahl: 0.900000 zahl_vorgaenger = 7.000000 eval_vorgaenger = 7 DigitalUnschaerfe = 0.200000
[0d21h31m29s] 2023-01-08T10:29:41 [CNN] getReadout#ZeigerEvalHybridNeu()= 1
[0d21h31m29s] 2023-01-08T10:29:41 [CNN] getReadout#result= 1711
[0d21h31m29s] 2023-01-08T10:29:41 [CNN] ZeigerEvalHybridNeu - KEIN Analoger Vorgänger, kein Ziffernwechsel, da Vorkomma weit genug weg = 1 zahl: 0.900000 zahl_vorgaenger = 0.900000 eval_vorgaenger = 1 DigitalUnschaerfe = 0.200000
[0d21h31m29s] 2023-01-08T10:29:41 [CNN] getReadout#ZeigerEvalHybridNeu()= 1
[0d21h31m29s] 2023-01-08T10:29:41 [CNN] getReadout#result= 11711
[0d21h31m30s] 2023-01-08T10:29:41 [POSTPROC] main: Raw: 11711.6735, Value: , Status: Rate too high - Read: 11711.6735 - Pre: 1385.6687 - Rate: 2065.2010
[0d21h31m30s] 2023-01-08T10:29:42 [MQTT IF] Published topic: wasserzaehler/status, content: Sending MQTT (msg_id=5222)
[0d21h31m30s] 2023-01-08T10:29:42 [MQTT SERVER] Publishing system MQTT topics...
[0d21h31m30s] 2023-01-08T10:29:42 [MQTT IF] Published topic: wasserzaehler/uptime, content: 77478 (msg_id=5223)
[0d21h31m30s] 2023-01-08T10:29:42 [MQTT IF] Published topic: wasserzaehler/freeMem, content: 3027255 (msg_id=5224)
[0d21h31m30s] 2023-01-08T10:29:42 [MQTT IF] Published topic: wasserzaehler/wifiRSSI, content: -82 (msg_id=5225)
[0d21h31m30s] 2023-01-08T10:29:42 [MQTT IF] Published topic: wasserzaehler/CPUtemp, content: 39 (msg_id=5226)
[0d21h31m30s] 2023-01-08T10:29:42 [MQTT] Publishing MQTT topics...
[0d21h31m30s] 2023-01-08T10:29:42 [MQTT IF] Published topic: wasserzaehler/main/error, content: Rate too high - Read: 11711.6735 - Pre: 1385.6687 - Rate: 2065.2010 (msg_id=5227)
[0d21h31m30s] 2023-01-08T10:29:42 [MQTT IF] Published topic: wasserzaehler/main/changeabsolut, content: 0.0070 (msg_id=5228)
[0d21h31m30s] 2023-01-08T10:29:42 [MQTT IF] Published topic: wasserzaehler/main/rate_per_digitalization_round, content: 0.0070 (msg_id=5229)
[0d21h31m30s] 2023-01-08T10:29:42 [MQTT IF] Published topic: wasserzaehler/main/raw, content: 11711.6735 (msg_id=5230)
[0d21h31m30s] 2023-01-08T10:29:42 [MQTT IF] Published topic: wasserzaehler/main/timestamp, content: 2023-01-08T10:23:51+0100 (msg_id=5231)
[0d21h31m30s] 2023-01-08T10:29:42 [MQTT IF] Published topic: wasserzaehler/main/json, content: { "value": "", "raw": "11711.6735", "pre": "1385.6687", "error.. (msg_id=5232)
[0d21h31m30s] 2023-01-08T10:29:42 [MQTT IF] Published topic: wasserzaehler/status, content: Flow finished (msg_id=5233)
[0d21h31m30s] 2023-01-08T10:29:42 [TFLITE SERVER] CPU Temperature: 39.4
[0d21h31m30s] 2023-01-08T10:29:42 [TFLITE SERVER] Round #259 completed
[0d21h35m34s] 2023-01-08T10:33:46 [TFLITE SERVER] ----------------------------------------------------------------

[caco3]

This should be fixed in #1839

[reserve85]

never occurred again.