-
Notifications
You must be signed in to change notification settings - Fork 218
/
ReleaseNotes.txt
2456 lines (2216 loc) · 151 KB
/
ReleaseNotes.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
695
696
697
698
699
700
701
702
703
704
705
706
707
708
709
710
711
712
713
714
715
716
717
718
719
720
721
722
723
724
725
726
727
728
729
730
731
732
733
734
735
736
737
738
739
740
741
742
743
744
745
746
747
748
749
750
751
752
753
754
755
756
757
758
759
760
761
762
763
764
765
766
767
768
769
770
771
772
773
774
775
776
777
778
779
780
781
782
783
784
785
786
787
788
789
790
791
792
793
794
795
796
797
798
799
800
801
802
803
804
805
806
807
808
809
810
811
812
813
814
815
816
817
818
819
820
821
822
823
824
825
826
827
828
829
830
831
832
833
834
835
836
837
838
839
840
841
842
843
844
845
846
847
848
849
850
851
852
853
854
855
856
857
858
859
860
861
862
863
864
865
866
867
868
869
870
871
872
873
874
875
876
877
878
879
880
881
882
883
884
885
886
887
888
889
890
891
892
893
894
895
896
897
898
899
900
901
902
903
904
905
906
907
908
909
910
911
912
913
914
915
916
917
918
919
920
921
922
923
924
925
926
927
928
929
930
931
932
933
934
935
936
937
938
939
940
941
942
943
944
945
946
947
948
949
950
951
952
953
954
955
956
957
958
959
960
961
962
963
964
965
966
967
968
969
970
971
972
973
974
975
976
977
978
979
980
981
982
983
984
985
986
987
988
989
990
991
992
993
994
995
996
997
998
999
1000
16/08/2023: IPED-4.1.4:
News:
#1294: Support parsing iCloud backup LZFSE compressed files (@lfcnassif)
#1525: Support parsing MacOS XXXXX.partial.emlx emails attachments (@FelipeFcosta, @lfcnassif)
#1798: Support iLBC (Internet Low Bitrate Codec) audios (@tc-wleite)
#1786: Improve the detection of Matroska files: MKV, MKA and WEBM (@tc-wleite)
#1815: Improve the detection of WhatsApp iOS account plist file (@lfcnassif)
#1793: Improve the detection of Apple iWork 13 documents (@lfcnassif)
#1809: Make VideoThumbTask work on videos in mounted paths longer than 256 chars on Windows (@lfcnassif, @tc-wleite)
Fixes:
#1769: Map renders locations but a blank background [regression 4.1.0] (@lfcnassif)
#1774: Old WhatsApp databases parsing affected by forwarded message feature [regression 4.1.3] (@hauck-jvsh, @lfcnassif)
#1791: WhatsApp parser may lose recent messages (@tc-wleite)
#1765: Aborting IOException from AudioTranscriptTask (@lfcnassif)
#1801: Never add video: prefix to transcription properties (@lfcnassif)
#1782: Error opening items inside an E01 from an unmounted READ ONLY Windows network share (@tc-wleite)
#1762: --remove evidence option fails if graph feature wasn't enabled (@lfcnassif)
#1757: Infinite loop in IOUtil.ignoreInputStream() causing thread leak and wasting CPU (@hauck-jvsh, @lfcnassif)
#1814: Corrupted ISO caused an "infinite recursion loop" in SevenZipParser (@tc-wleite, @lfcnassif)
#1752: TorTcParser timestamp in UTC although not informed (@patrickdalla, @lfcnassif)
#1795: TorTcParser giving different values on Linux and Windows (@lfcnassif)
#1750: Absence of JavaFX aborting processing if user clicks on "Preview Case" (@lfcnassif)
#1806: Mimetype of encrypted Office documents without extension ending with a hyphen (@lfcnassif)
#1807: Avoid minor NPE while reading AD1 contained file after parsing timeout (@lfcnassif)
30/06/2023: IPED-4.1.3:
News:
#1287: Flag WhatsApp Forwarded messages (@tc-wleite, @gfd2020)
#1647: Handle some new and common WhatsApp system messages (@tc-wleite, @lfcnassif)
#1610: Read WhatsApp owner account information from more sources on Android (@tc-wleite)
#1559: Decode "Unavailable" WhatsApp audio and video calls (@tc-wleite)
#1661: Support WhatsApp reactions (@tc-wleite)
#1655: Improve WhatsApp emojis internal visualization quality (@tc-wleite)
#1654: Replace WhatsApp HTML preview fonts (@tc-wleite)
#1636: Emule *.part.met files carving (@hugohmk)
#1707: Load Timeline chart data just when it becomes visible to decrease memory usage by UI (@patrickdalla)
#1719: Use Windows trusted certificate store so Map view works through some organization proxies (@patrickdalla)
#1701: Export items to local case if enableAutomaticExportFiles and enableMinIO are both enabled (@hauck-jvsh)
#1533: Option to configure OpenSearch/MinIO retries and abort if exhausted (@hauck-jvsh, @lfcnassif)
#1671: Add support to pass the elasticsearch credentials by ENV vars (@hauck-jvsh)
#1644: Don't include WhatsApp Business "externally" parsed HTMLs if phoneParsersToUse = "internal" (@tc-wleite)
#1694: Optimize UFDR evidences opening time through some networks (@lfcnassif, @tc-wleite)
#1678: Optimize KnownMetCarving to seek instead of skipping huge files (@hugohmk)
#1724: Makes processing not dependent on stdin again (@lfcnassif)
#1737: Update localization files for Italian, Spanish and German (@flates, @AburtoArielPM, @mobab-th, @lfcnassif)
Fixes:
#1691: Possible incorrect association between WhatsApp accounts and chats when there are multiple accounts if processing on Windows (@tc-wleite)
#1712: Max heap memory used by Analysis App can be greater than RAM causing UI crashes (@patrickdalla, @lfcnassif)
#1730: Emule known.met parser missing several entries (@hauck-jvsh, @tc-wleite)
#1679: WhatsApp parsing timeout can break parsing of other WA databases (@lfcnassif)
#1663: Processing frozen due to infinite timeouts transcribing huge audios on transcription service (@hauck-jvsh)
#1664: Problems decoding Cyrillic and other unicode chars from registry files (@lfcnassif)
#1672: Problems rendering Cyrillic and other Unicode chars extracted from SQLite Tables (@lfcnassif)
#1668: Aborting IllegalArgumentException: DocValuesField "parentIds" is too large, must be <= 32766 caused by GeofileParser (@patrickdalla)
#1676: Aborting ArrayIndexOutOfBoundsException from Lucene when creating reports with huge files (@lfcnassif)
#1686: IllegalArgumentException: Inconsistency of field data structures across documents when generating reports from multicases (@lfcnassif)
#1726: Artifacts parsing depending on other case items can be incomplete if they are located into splitted embedded disks (@lfcnassif)
#1660: Aborting FileSystemExeption from deleted Embedded Disks: the file is already being used by another process (@lfcnassif)
#1684: Metadata with dots not being indexed on opensearch (@hauck-jvsh)
#1666: Timeline chart draw synchronization problems (@patrickdalla)
#1589: Error creating report with local wav2vec2 transcription enabled (@lfcnassif)
#1665: Web service start up not working (@patrickdalla)
#1677: KnownMetCarveTask might miss some deleted known.met files (@lfcnassif)
#1723: Processing App may not respond to Ctrl+C on Console (@lfcnassif)
#1698: Any executable in the case root folder is being copied to the report destination folder (@tc-wleite)
17/04/2023: IPED-4.1.2:
News:
#1559: Support decoding audio and video calls from android WhatsApp databases v2.22.8+ (@hauck-jvsh, @lfcnassif)
#1170: Delete temp DLLs and whole temp folder after processing (@lfcnassif)
#1643: Update localization files (@flates, @mobab-th, @AburtoArielPM, @lfcnassif)
Fixes:
#1630: Some Emlx emails being detected as Html (@lfcnassif)
#1623: Change EML parser/viewer behavior to inline extra txt/html body parts instead of extracting them as attachments (@lfcnassif)
#1628: Communication properties of items decoded from UFDR not exported to reports (@lfcnassif)
#1629: Temp files opened externally (e.g. by double click) leaked in temp folder (@lfcnassif)
#1597: Parameter -d NOT working when related value has a comma in a folder name (@lfcnassif)
#1607: Multicases do not work if case parent folder is named "iped" (@lfcnassif)
#1606: NoRouteToHostException causing remote transcription to skip audios (@lfcnassif)
#1595: "Wait" progress does not hide after quick operation on Linux (@tc-wleite, @patrickdalla)
#1614: EntropyTask processing videos when creating report slowing down report generation (@tc-wleite)
#1638: For some (rare) images, ocrCharCount is including a few characters that didn't come from OCR (@tc-wleite)
#1641: Exception thrown by the splash screen manager in the very first usage (@tc-wleite)
#1596: Test error while building when comparing Dates in some timezones (@lfcnassif)
14/03/2023: IPED-4.1.1:
News:
#1553: New Tab to list Referenced items (@lfcnassif)
#1566: Convert audios to WAV on transcription service side again (@lfcnassif)
#1556: Makes Ctrl+A and Space (Check selected) work for Subitems, Duplicates, References and ReferencedBy tabs (@lfcnassif)
#1552: Sort subitems/duplicates/references tabs results (@lfcnassif)
#1267: Makes Google and Wav2Vec2 audio transcription not dependent of FFmpeg anymore (@tc-wleite)
#1576: Decrease remote wav2vec2 transcription retry rate on clients (@lfcnassif)
#1569: Externalize MIN_TIMEOUT parameter for remote audio transcription (@lfcnassif)
#1531: Converge all TwelveMonkeys libraries to 3.9.4 (@tc-wleite)
Fixes:
#1555: Media captions missed by new Android Whatsapp parser and UFDR chat parser (@lfcnassif)
#1565: Layout restore prevents panels added in newer IPED versions to be visible (@tc-wleite)
#1544: Error parsing Shareaza Library1/2.dat files (@tc-wleite)
#1585: Some chat messages from UFDR reports being duplicated (@lfcnassif)
#1142: Improve LocalConfig.txt options loading on different machines (@lfcnassif)
#1577: Aborting FileNotFoundException when starting case (@lfcnassif)
#1584: Error reading extracted text file from XXXXX, maybe your antivirus blocked or deleted it: java.io.FileNotFoundException (@lfcnassif)
#1561: Clients with slow networks blocking transcription cluster resources (@lfcnassif)
#1589: Error creating report with local wav2vec2 transcription enabled (@lfcnassif)
#1588: Aborting NullPointerException when creating reports if remote transcription service was used (@lfcnassif)
#1540: Socket timeouts thrown by transcription service side not retried (@lfcnassif)
#1564: Better exception handling and logging messages when transcription service returns errors (@lfcnassif)
#1530: Occasional NoClassDefFoundError from OCRParser (@tc-wleite)
#1572: Logging dependencies duplicating classes may cause NoSuchMethodError (@lfcnassif)
#1535: External parsing processes not reused when converting PDFs to images before OCR (@lfcnassif)
#1542: ExternalParsers inserting new lines at wrong places (@lfcnassif)
#1558: Repaint all tables checkboxes when some of them is changed (@lfcnassif)
#1583: Exception caused by non wa.db files detected as such (@lfcnassif)
17/02/2023: IPED-4.1.0:
News:
#306: Timeline chart to show item counts and filter items based on date ranges (@patrickdalla, @lfcnassif, @FelipeFCosta, @paulobreim)
#1214: New local/remote audio transcription using Facebook wav2vec2 and transcription cluster service (@lfcnassif)
#1183: Restrict audio transcription to some mimeTypes and skip known audios by default (@lfcnassif, @aberenguel)
#1286: Parser for Windows 10 Mail App (@FelipeFcosta, @lfcnassif)
#390: Discord cache files parser (@felipecampanini, @lfcnassif)
#1322: New Windows EVTX parser to extract events timestamps (@patrickdalla, @lfcnassif)
#281: Extract P2P (Emule, Shareaza, Ares) history entries as separate items in case (@patrickdalla, @lfcnassif)
#1461: Support importing new NIST NSRL RDS version 3 format (@tc-wleite)
#1202: Image blur and gray filters in gallery and image viewer (@abdalla-mar, @lfcnassif, @tc-wleite)
#1201: Support rendering tracks on Map tab (@patrickdalla)
#1480: Create toggle button to show plotted items on map as a track (@patrickdalla)
#1460: Extract features from kml (@patrickdalla)
#1107: Option to extract a number of video frames as a function of video duration (@lfcnassif)
#1371: Search for Vendors and Products Identifiers for Hardware Wallets (@mobab-th, @lfcnassif)
#1092: Spanish Translation (@AburtoArielPM, @lfcnassif)
#1513: Include Tesseract fast language models for Italian, German and Spanish (@lfcnassif)
#1370: Create categories for other types extracted from UFDRs (@tc-wleite)
#1282: Extract telegram deleted groups (@hauck-jvsh, @lfcnassif)
#1426: Improve PDF rendering quality (@tc-wleite)
#1383: Render ICO files (@tc-wleite)
#1474: Increase the image thumbnail resolution (@tc-wleite)
#1378: Faster WEBP images rendering using a Java ImageIO plugin (@tc-wleite)
#1291: Render file type icons on table user interface (@gfd2020, @lfcnassif, @tc-wleite)
#1356: Add file type icons rendering on more panels (@lfcnassif)
#1359: Add icons for mime types and option to change size (@tc-wleite)
#1300: Continuous navigation with left/right arrows in the gallery (@tc-wleite, @lfcnassif)
#1085: Change gallery multiple selection behavior to display last clicked file in the viewer (@lfcnassif)
#1453: Run KnownMetCarveTask on the same areas as LEDCarveTask (@lfcnassif)
#1451: Disable LED carving on VHDX virtual disks (@lfcnassif)
#1325: Maps the image features as knn vector when indexing to opensearch (@hauck-jvsh)
#1408: Export the extracted faces to opensearch (@hauck-jvsh, @lfcnassif)
#1216: Fixes the content type in the elasticsearch index (@hauck-jvsh, @lfcnassif)
#1511: Visual Enhancements in Processing UI (@tc-wleite)
#1416: Splash Screen (@tc-wleite, @lfcnassif)
#1494: Set an icon for processing UI (@tc-wleite)
#1413: "Wait..." dialog hidden behind main window (@tc-wleite, @lfcnassif)
#1410: Copy embedded JRE to user home and reuse it (@tc-wleite, @lfcnassif)
#1319: Move scripts code from conf folder to root (@lfcnassif)
#1320: Move mplayer to iped/tools folder (@lfcnassif)
#1261: Parameterize Google Speech-To-Text transcription model (@lfcnassif)
#1504: Make Microsoft speech client SDK a plugin module (@lfcnassif)
#1377: Try to load scripts first from profiles/X/scripts/tasks then from root scripts/tasks folder (@lfcnassif)
#1206: New methods to configure new metadata prefixes and data types from parsers (@lfcnassif)
#1463: Unable to use VisualVM to monitor IPED process (@tc-wleite)
#897: Log all Configurables settings (@lfcnassif)
#1279: Regripper Custom Reports (@DHoelz, @lfcnassif)
#1432: Support comments in Multicase TXT files (@lfcnassif)
#1493: Update DIE nudity detection model (@tc-wleite)
#331: Upgrade to RegRipper-3.0 and move it to tools folder (@lfcnassif)
#1462: Update index search quick help (@lfcnassif)
#1434: Update localization files to Italian, German & Spanish (@flates, @mobab-th, @AburtoArielPM, @lfcnassif)
#1524: Upgrade to PDFBox-2.0.27 (@lfcnassif)
#1340: Upgrade to Sleuthkit-4.12.0: Linux LVM support (@lfcnassif)
Fixes:
#1427: Maps with lot of items not being plotted (@patrickdalla, @lfcnassif)
#1485: Thread leak in Face recognition python task causing performance degradation (@hauck-jvsh)
#1476: The --restart and -remove evidence options are not cleaning the bookmarks (@lfcnassif)
#1281: Aborting ArrayIndexOutOfBoundsException while indexing huge files (@lfcnassif)
#1499: Email dates in portable case reports being formatted to a bad string (@lfcnassif)
#1176: System properties not copied to parsing process affecting externalParsing [TSK-4.11.1 bug] (@lfcnassif)
#1505: AIOOBE in Timeline table view causing no results returned (@lfcnassif)
#1458: Fix incorrect usage of InputStream.read(byte[]) through code (@lfcnassif)
#1510: Fix incorrect implementations of InputStream.read() through code (@lfcnassif)
#1497: Fix non thread safe parsers, they can return inconsistent results (@lfcnassif)
21/12/2022: IPED-4.0.7:
Fixes:
#1336: Makes analysis UI to work from an unmounted network path again (@tc-wleite)
#1446: Map tab not working with http(s) system proxy (@lfcnassif)
#1403: OutOfMemoryError caused by com.dd.plist library (@lfcnassif)
#1421: Aborting StackOverflow exception thrown by QRCodeTask (@lfcnassif)
#1415: QRCodeTask hangs for hours (@hauck-jvsh @lfcnassif)
#1392: Error applying user defined filters with colon in property name after reopening the case (@lfcnassif)
#1441: DocThumbTask not working on 4.0.x if enableExternalParsing is enabled (@lfcnassif)
#1433: Common properties of items coming from UFED decoding not exported to reports (@lfcnassif)
#1307: FaceRecognition module not detecting large faces full filling some high resolution images (@lfcnassif)
#1409: Items with "thumbsOnly" option don't display properly in the generated report (@tc-wleite)
#1452: LedCarveTask might miss a lot of items (@lfcnassif)
#1451: Disable LED carving on VHDX virtual disks (@lfcnassif)
#1394: Error opening subitems on Linux inside a case processed on Windows (@lfcnassif)
#1439: The IdInDataSource in MinIO is being changed to the preview item (@hauck-jvsh)
#1428: On Linux v.4.0.6. fails to decrypt APFS partition that v.3.17.1 could decrypt - Sleuthkit 4.11.1 issue (@arisjr)
#1454: Remove "<br/> Empty media" from Telegram messages (@lfcnassif)
19/10/2022: IPED-4.0.6
Fixes:
#1374: Vulnerability in WhatsAppParser caused by Apache Commons Text 1.8 dependency [affects 3.18.1 to 4.0.5] (@lfcnassif)
#1379: DBX parser not working [4.0 regression] (@lfcnassif)
#1358: OutOfMemoryError caused by processing queue growing too much (@lfcnassif)
#1368: User interface scaling is not working in some environments (@tc-wleite)
#1357: Any zero sized file rendered as X icon in gallery (@lfcnassif)
#1387: Unneeded network dependency slowing down application start up (@lfcnassif, @tc-wleite)
#1381: Sometimes autocomplete (TAB) does not find certain properties (@tc-wleite)
#1365: Minor UI glitch in similar image search panel (@tc-wleite)
#471: Log Console Error (@tc-wleite)
04/10/2022: IPED-4.0.5
Fixes:
#1350: Several folders and files missed by TSK-4.11.1 when processing an evidence with files owned by IIS default account (@lfcnassif)
#1338: UFED chat messages with unknown sender (@hauck-jvsh, @lfcnassif)
#1349: Timeouts while transcribing small audios - 4.0.4 regression (@lfcnassif)
#1328: IgnoreFilesByPathTask.js not being executed by triage profile (@lfcnassif)
#1327: Aborting IndexOutOfBoundsException caused by carved file with negative size (@lfcnassif)
#1332: Databases classified in categories other than 'Databases' are showing all table content on HTMLViewer - affects 3.18.x (@lfcnassif, @patrickdalla)
#1353: Table column parallel sorting may not be visible to other threads - affects 3.18.x (@lfcnassif, @patrickdalla)
#1348: Check/Uncheck all items action not propagated to Map tab - affects 3.18.x (@lfcnassif)
#697: Map previous/next buttons first click after sorting change are considering previous sorting order - affects 3.18.x (@patrickdalla, @lfcnassif)
#1352: If processing aborts, sometimes a different exception than the cause is printed in the Console - affects 3.18.x (@lfcnassif)
16/09/2022: IPED-4.0.4
Fixes:
#1293: Errors in multicases: rendering chats with attachments, bookmarking duplicates and exporting file properties (@lfcnassif)
#1321: Inconsistent behavior of enableAutomaticExportFiles and CategoriesToExport/KeywordsToExport (@lfcnassif)
#1288: Error generating multicase graph depending on current directory (@lfcnassif)
#1292: Processing can hang in AudioTranscriptTask (@lfcnassif)
#1290: HexViewerPlus search for big hexadecimals not working (@gfd2020)
#1324: Fix audio:transcriptConfidence type as double (@lfcnassif)
#1299: Clicking on an item in the gallery, sometimes trigger multiple events (@tc-wleite)
#1323: Rare mplayer processes left behind on Windows after processing finished (@lfcnassif)
25/08/2022: IPED-4.0.3
Fixes:
#661: Fix dynamic metadata types detection divergences in multicases (@lfcnassif)
#1281: Aborting ArrayIndexOutOfBoundsException while indexing embedded virtual disk segments or huge files (@lfcnassif)
#1278: Processing rarely aborting by ArrayIndexOutOfBoundsException from QRCodeTask (@lfcnassif)
#1277: Searching in Hex Viewer not working (@lfcnassif)
#1274: Error creating bookmarks from python scripts (@lfcnassif)
#1288: Error generating multicase graph depending on current directory (@lfcnassif)
#1273: Fix PythonScriptTask.py example and ExampleScriptTask.js (@lfcnassif)
#1276: Fix ending white spaces in some localization strings (@lfcnassif)
08/08/2022: IPED-4.0.2
Fixes:
#1262: Preview of device info, contacts & emails from UFDR evidences can be overridden with --append - also affects 3.18.x (@lfcnassif)
#1246: Token normalization rules not being applied on wildcard/prefix/fuzzy/regex/range queries (@lfcnassif)
#1250: New evidence location dialog stopped to be shown if it was moved (@lfcnassif)
#1254: External file opening confirmation dialog not working (@lfcnassif)
#1247: Hits panel not populated and hits not highlighted on Preview tab after a MultiTermQuery search (@lfcnassif)
#1256: Some files from UFDR could not be opened temporarily when fast switching between them (@lfcnassif)
#1255: Link files (application/x-lnk) are being parsed by RawStringParser instead of LNKShortcutParser (@lfcnassif)
#1249: Audio transcription can fail depending on audio encoding (@lfcnassif)
#1242: Error SQLITE_CONSTRAINT_PRIMARYKEY when importing hash sets that require a record merge (@tc-wleite)
#1248: Out of memory when parsing contacts of whatsapp (@lfcnassif, @hauck-jvsh)
#1258: Report creation from cmd line can fail sometimes (@lfcnassif)
#1244: Downgrade MinIO to version 8.3.8 (@hauck-jvsh)
18/07/2022: IPED-4.0.1
Fix:
#1223: Bookmark panel not being updated if [No Bookmarks]/Bookmarks root is selected (Luís Nassif, André Berenguel) [4.0.0-final]
15/07/2022: IPED-4.0.0-final
News:
#1227: Support for NIST CAID - Child Abuse Image Database - hash dataset (Wladimir Leite, Luís Nassif)
#1211: Retry the MinIO upload (João Hauck, Luís Nassif)
#1213: Decrease IPED VOSK minWordScore parameter (Luís Nassif)
Fixes:
#1199: Iped-search-app stops to open files from UFDR after fast switching between them (Luís Nassif) [4.0-beta]
#1217: Inconsistent timezone conversion of Exif dates (Luís Nassif) [3.18.x, 4.0-beta]
#1203: Aborting OutOfMemoryError while running QRCode detection (João Hauck, Luís Nassif) [4.0-beta]
#1204: Error adding file to the database: TskCoreException: Could not find parent (Luís Nassif) [4.0-beta]
#1209: False positives when detecting phone numbers in Graph module (Luís Nassif) [3.18.x, 4.0-beta]
#1221: Date range searches do not work with uppercase 'T' in timestamp values (Luís Nassif) [4.0-beta]
#1194: Error when creating Bookmark named "Bookmarks" (Luís Nassif) [3.18.x, 4.0-beta]
#1200: FaceRecognition feature doesn't work on Linux with default installation steps (Felipe Costa) [4.0-beta]
#1007: IllegalArgumentException: cannot change field "XXX" from index options=DOCS_AND_FREQS_AND_POSITIONS to inconsistent index options=NONE (Luís Nassif) [4.0-beta]
#994: Negative estimated time to finish processing (Luís Nassif) [4.0-beta]
24/06/2022: IPED-4.0.0-beta
News:
#361: Face recognition functionality (Luis Nassif & Rui Santana)
#118: Centralized hash database, refactor importing and look up for different hashsets: NSRL, ProjectVic, LED, PhotoDNA, CSV (Wladimir Leite)
#1136: Support Interpol ICSE CSAM hash database (Wladimir Leite)
#451: Unified Timeline Table View and Event Filtering (Luis Nassif)
#248: Local audio transcription [Experimental] (Luis Nassif & Wladimir Leite)
#102: Processing of supported forensic/virtual disk images recursively (Luís Nassif)
#515: Run OCR on HEIC, PSD, WEBP, WMF, EMF, SVG, JBIG2 and other non standard image types (Wladimir Leite & Luis Nassif)
#619: Run OCR on partially corrupted images (Luis Nassif)
#238: Support for OpenStreetMaps/Bing maps using Leaflet library (Patrick Bernardina & Luis Nassif)
#18: Refactor internationalization (Luis Nassif)
#675: German translation (Dennis Schreiber & Luís Nassif)
#1091: Italian translation (Flavio Tessitore)
#1105: Support for WhatsApp version up to 2.22.9 (João Hauck, Luís Nassif)
#1065: Recover deleted WhatsApp Chats, Messages and Contacts (Fábio Pfeifer, Luís Nassif, João Hauck)
#486: Link WhatsApp attachments in Apple Warrant Returns Cellebrite Reports (Fábio Pfeifer)
#150: Merge Whatsapp msgstore.db backups (João Hauck & Luís Nassif)
#802: Add support to download and decode WhatsApp attachments (João Hauck, Luís Nassif)
#1025: Implement the download WhatsApp attachments feature for IOS (João Hauck, Luís Nassif)
#972: Optimize WhatsAppParser memory usage (Luís Nassif)
#538: Refactor module configuration (Luís Nassif)
#120: Makes Configuration Profiles Hierarchical/Differential (Luis Nassif)
#1067: Embed a portable python distribution and JEP (Luís Nassif)
#483: Support parser implementations in python (Luis Nassif)
#362: Change processing pipeline to allow tasks to accumulate items and process them together (Luis Nassif)
#357: Optimize NSFWNudityDetectTask.py, run on videos and makes it easier to enable (Luis Nassif)
#180: Public API changes including translations to english (Luís Nassif)
#388: Change python tasks to implement classes instead of isolate functions (Luis Nassif)
#340: Object Storage Module using MinIO (Luis Nassif & João Hauck)
#732: Optimize MinIOTask (João Hauck, Luís Nassif)
#530: Increase ALTCOINS Regexes and Validators (Fábio Pfeifer)
#847: Identify QRcodes (João Hauck & Luís Nassif)
#1081: Extract video frames as subitems to run all image processing modules on them (Aristeu Junior, Luís Nassif, Wladimir Leite)
#763: Extract frames from Animated GIFs and APNGs (Wladimir Leite & Luís Nassif)
#854: Extract frames from animated HEIC/HEIF sequence images (Wladimir Leite)
#1034: Optimize external PDF thumb creation running it in the external parsing processes (Luís Nassif)
#575: Enhancements in thumbnail generation and image viewer for non-standard formats (Wladimir Leite)
#293: Allow removing evidences from case (Luis Nassif)
#463: Reenable MP4Parser to extract more metadata from MP4 videos and audios (Luis Nassif)
#65: Store all email headers as metadata (Thales Rodrigues e Luis Nassif)
#745: New properties to count the number of email attachments and to flag them (Luis Nassif)
#744: Populate Message-Recipient-Address property by all email parsers (Luis Nassif)
#459: Allow running multiple parsers on the same file (Luis Nassif)
#63: Parser for binary plist files (Luis Nassif)
#465: Enable Tika's executable file parser combined with RawStringParser (Luis Nassif)
#466: Enable Tika's EMF parser combined with RawStringParser (Luis Nassif)
#979: Enable new Vorbis audio parsers included after Tika upgrade (Luis Nassif)
#570: Normalize again some common metadata keys (Luís Nassif)
#633: Optimize TelegramParser html report output (João Hauck & Luis Nassif)
#445: Implement unit tests for parsers (Guilherme Andreúce & Luís Nassif)
#479: Filtering and copying to clipboard the results of Metadata filter panel (Leandro Oliveira & Luis Nassif)
#520: Allow filtering property names in Metadata filter panel (Wladimir Leite)
#434: Add an original extension and mismatch columns (Luís Nassif)
#493: Support new Media Classification properties from Cellebrite UFDR reports (André Berenguel & Luís Nassif)
#1068: Optimize UFDR reading using Apache Commons Compress instead of Zip4J (Luís Nassif)
#1062: Change index schema to use parent-children docs to index item metadata-content (Luís Nassif)
#960: Refactor item content source references (Luís Nassif)
#517: Better detection for iPhone iTunes Backups (Luis Nassif)
#552: Merge category by mimetype config with category hierarchy (Luís Nassif)
#803: Allow CategoriesToExport.txt config to use non leaf categories (Luís Nassif)
#1111: Create subcategories for chats (João Hauck, Luís Nassif)
#646: Localized Number Formatting (Wladimir Leite & Luis Nassif)
#929: Change checked items localization to portuguese (Luís Nassif)
#1167: Remove DIE classes from its model file (Wladimir Leite)
#713: Rename DIE properties (Wladimir Leite)
#764: Use UTF-8 Control when reading localization bundle property files (Luis Nassif)
#837: Change geo properties to use specific Lucene geo points (Luís Nassif & João Hauck)
#644: Change MACB date format in index (Luis Nassif)
#637: Rename 'recordDate' file system date to 'metaChanged' (Luis Nassif)
#784: Improve and rename persistentID to trackID (Luís Nassif)
#983: Change a few more property names in index (Luís Nassif)
#908: Use a custom Policy again instead of custom proxy to block Internet access (Luís Nassif)
#985: Support ProjectVIC Data Model 2.0 (Wladimir Leite)
#1165: Add a few more options to HashDB import tool (Wladimir Leite, Luís Nassif)
#288: Populate hashDb:set property with LED hashset file name (Wladimir Leite)
#300: Change NSRL hashset look up module to use "known" flag as default (Wladimir Leite)
#307: Compress LED hashset loaded on memory (Wladimir Leite)
#364: Change NSRL database to store all product references to the same hash (Wladimir Leite)
#614: Add a metadata with the number of pages for TIFFs (Wladimir Leite)
#522: Simpler names for important image metadata (Wladimir Leite)
#898: Raster images with no image:Width and image:Height properties (Wladimir Leite)
#1074: Optimize bookmarking when "Add duplicates (hash)" is selected (André Berenguel, Luís Nassif)
#724: Save bookmarks shortcuts (Wladimir Leite)
#1146: Option to store remote or local item data references when exporting files to MinIO (Luís Nassif)
#370: Implement --continue & --restart semantics in ElasticSearch module (Luis Nassif)
#378: Export file previews to ElasticSearch and MinIO (João Hauck)
#716: Relocate all elasticsearch & minio shaded jars dependencies (Luís Nassif)
#1160: Switch from ElasticSearch to Opensearch plugin (João Hauck)
#915: Save the preview size in metadata sent to ElasticSearch (João Hauck)
#371: Cmd line option to set ElasticSearch index name and index ID fields as keyword (Luis Nassif)
#777: New property to flag artifacts/reports generated by the tool (Luis Nassif)
#933: Save custom panels Layout (Wladimir Leite & Luis Nassif)
#569: Dark Theme (Wladimir Leite & Luis Nassif)
#900: Allow user-global setting for the User Interface Scale [UiScale] (Wladimir Leite & Luís Nassif)
#823: Minor GUI improvements (Wladimir Leite)
#1156: Make large properties values collapsible in the metadata panel (Wladimir Leite)
#519: Add a button to clear Metadata filter panel content (Wladimir Leite)
#981: Minor improvements related to similar images and faces search (Luis Nassif)
#649: Minor Visual Enhancements in Metadata Panel (Wladimir Leite)
#906: Group all layout and appearance related menu items (Wladimir Leite)
#799: Just show "initial graph includes the most linked entities" message if the graph tab is selected (Luís Nassif)
#1188: Improve robustness of external image reading processes (Luis Nassif)
#772: Enable robustImageReading by default for faster E01 or APFS processing (Luís Nassif)
#612: Decrease minFileSize2OCR and increase maxFileSize2OCR default values (Luis Nassif)
#642: Optimization if parseUnknown = false and robustImageReading = true (Luís Nassif)
#554: Support more escapes and char classes in RegexConfig.txt (Luís Nassif)
#643: Optimize RegexTask initialization (Luis Nassif)
#457: Minor optimization - detectors executing twice (Matheus Bichara)
#670: Makes all SeekableInputStreams support mark/reset (Luis Nassif)
#1083: Split application startup into two processes and get rid of custom class loader (Luís Nassif)
#622: Always use embedded JRE on Windows (Luís Nassif)
#509: Remove old support for indexing FTK reports (Luís Nassif)
#506: Remove old global duplicate file flag in favor of dynamic duplicate filter (Luís Nassif)
#232: Upgrade to Sleuthkit-4.11.1: support for APFS unallocated areas (Luís Nassif)
#825: Upgrade LIBVMDK to support splitted and differential images (Luís Nassif)
#598: Upgrade LIBVHDI to support vhdx evidences (Luís Nassif)
#827: Upgrade to java 11 LTS (Luis Nassif)
#885: Make Java 11 minimum required java version to build project (Luís Nassif)
#1029: Upgrade to Tika 2.4.0 (Luis Nassif)
#568: Review metadata types after upgrade to Tika-1.26 (Luís Nassif)
#1043: Upgrade to Lucene 9.2.0 (Luis Nassif)
#889: Upgrade Neo4J to 4.4.4 (Luís Nassif)
#1073: Upgrade to JEP-4.0.3 (Luís Nassif)
#228: Upgrade drewnoakes metadata-extractor to Tika version (Luis Nassif)
#205: Upgrade to DockingFrames-1.1.2 so LibreOffice viewer works with java 11 (Wladimir Leite)
#736: Change 'optional_jars' plugin folder to 'plugins' in the whole codebase (Luis Nassif)
#850: Change "indexador" folder to "iped" in whole codebase (Luis Nassif)
Fixes:
#420: Fix diacritics normalization and filtering rules for other languages (Luis Nassif)
#1187: Multiple "Possible SleuthkitServer X crash reading..." non problematic files (Luis Nassif)
#586: Python modules loading error: jep.JepException: <class 'ModuleNotFoundError'>: No module named 'org.apache' (Luis Nassif)
#380: Error when more than one python task is enabled at the same time (Luis Nassif)
#731: ArrayIndexOutOfBoundsException: -2147483629 when using log scale on Metadata panel if an infinite value is present in a numeric field (Wladimir Leite)
#487: Fix debugging analysis UI from eclipse IDE (Luis Nassif)
#471: Log Console Error (Wladimir Leite)
06/06/2022: IPED-3.18.15
News:
#1064: Support new Telegram versions 8.5-8.7 (João Hauck)
#1035: Decode base64 values from UFDR xml (Luís Nassif)
#1049: Support more date formats when processing UFDR files from PA 7.54 (Luís Nassif)
#1074: Optimize bookmarking when "Add duplicates (hash)" is selected (André Berenguel & Luís Nassif)
#1117: Optimize time to generate report when OCR was enabled (André Berenguel & João Hauck)
#1042: Upgrade to latest OpenJDK 8 + JFX in 3.x branch (Luís Nassif)
Fixes:
#1056: TelegramParser plugin not working with iped.exe/java8 [3.18.13 regression] (Luís Nassif)
#1032: OutOfMemoryError while generating PDFs thumbnails using internal conversion (Luís Nassif)
#795: Missing DLL in OfficeViewer could cause LibreOffice window to be detached from main GUI (Luís Nassif & André Berenguel)
#1028: AIOOBE generating report from another report caused by chat attachments parents not exported (Luís Nassif)
#1031: Upgrade Microsoft client-sdk to 1.19.0 to fix audio transcription failing on Linux (Luís Nassif)
#1137: OCR on TIF images > 3 pages fails on environments without X (Luís Nassif)
#1033: Duplicated empty "WhatsApp Account" item in each report generation (Luís Nassif)
#1063: Processing rarely aborts with a java swing exception (Luís Nassif)
#1057: Exception in IPEDReader.copyBookmarksToReport (Luís Nassif)
#1055: Evidence's 'isRoot' property being displayed as 'false' in metadata panel (Luís Nassif)
#1114: NullpointerException when processing UFDR file (Luís Nassif)
15/03/2022: IPED-3.18.14
News:
#995: Upgrade to LIBEWF-20201230: partial Ex01 and Lx01 support (Luís Nassif)
Fixes:
#1001: TextViewer not displaying final text fragments of files [3.18.8 regression] (Luís Nassif)
#973: Group participants aren't being extracted [regression 3.18.9] (João Hauck)
#997: Messages from chats decoded from UFDRs may be duplicated and shown as attachments in preview [since 3.18-beta] (Luís Nassif)
#986: Graph in multicases not generated when cases/multicase.txt parent folder is writeable [regression 3.18.5] (Luís Nassif)
#993: Excessive memory consumption processing large E01 images (Wladimir Leite, Luís Nassif & André Berenguel)
#996: Bookmarks not saved in user local temp if case is on network and readonly using ACLs (Luís Nassif)
#1005: Query parsing fails if there is an odd number of “ (0x93) chars in the query string (Luís Nassif)
#991: Graph creation in reports generated from multicases can fail (Luís Nassif)
#1004: Similar image search filter panel not rendering selected external image (Luís Nassif)
#1008: Random aborting ClassCastException in GraphTask (Luís Nassif)
#989: Rare ClassCastException when opening GUI (Luís Nassif)
#970: Graphs with zero or few connections could render disconnected nodes initially (Luís Nassif)
#976: NPE when parsing corrupted WhatsApp android account xml (Luís Nassif)
15/02/2022: IPED-3.18.13
News:
#911: Support new Telegram version 8.4 (João Hauck)
#341: Delete ignored subitem data from SQLite containers (Luís Nassif)
#910: Open attachments from EML/MSGViewer externally using detected extension (Luís Nassif)
Fixes:
#905: EMLViewer opens the wrong attachment when images are inlined [3.18.8 regression] (Luís Nassif)
#965: Some carved files from ignored subitems could not be processed/exported when using blind or similar profiles (Luís Nassif)
#921: Missing some metadata values when removing composite/duplicate keys (Luís Nassif)
#941: Subitems or items from UFDR may point to inexistent parent when resuming processing (Luís Nassif)
#792: Carved/Subitems may be added again to case when resuming processing with --continue (Luís Nassif)
#892: Possible arbitrary JS code execution when viewing Telegram HTML reports (João Hauck & Luís Nassif)
#894: Fix WhatsAppParser, SkypeParser, VCardParser and UFEDChatParser to encode untrusted strings (Luís Nassif & João Hauck)
#895: HtmlViewer vulnerabilities in Windows and Linux (Luís Nassif)
#917: Some Telegram system messages were shown as different messages (João Hauck)
#964: Automatic bookmarks for items shared by p2p applications may not be created (Luís Nassif)
#942: Rare aborting ConcurrentModificationException when making partial index commits (Luís Nassif)
#967: Rare aborting ConcurrentModificationException when resuming processing (Luís Nassif)
#962: Exception in image similarity search when some kinds of evidences are moved (Luís Nassif)
#963: Clicking on carved item from moved local folder datasource doesn't ask for new folder location (Luís Nassif)
#954: EML/MSG emails with forbidden NTFS chars in attachment extension not rendered (Luís Nassif)
#939: Exception when selecting an item without hash (Wladimir Leite)
22/12/2021: IPED-3.18.12
News:
#887: Upgrade to Log4j-2.17.0 in 3.x branch (Luís Nassif)
Fixes:
#881: Subitems > 16MB or exported to HTML reports not opened by analysis app [3.18.10 regression] (Luis Nassif)
#880: Exporting files to report fails depending on evidence type if it was moved (Luís Nassif)
#872: Aborting NullPointerException in DocThumbTask (Luís Nassif)
10/12/2021: IPED-3.18.11
Fixes:
#871: Upgrade log4j to 2.15.0 (Luís Nassif)
#864: CriptoSeedPhraseValidator not working on 3.18.x (Luís Nassif)
03/12/2021: IPED-3.18.10
News:
#119: Create thumbnails for PDFs (Wladimir Leite & Luís Nassif)
#419: Create thumbnails for formats supported by LibreOffice (Wladimir Leite & Luís Nassif)
#809: Parse eMule part.met files (Wladimir Leite & Luís Nassif)
#615: Classify preferences.ini/AC_SearchStrings.dat and parse preferences.dat eMule artifacts (João Hauck, Luís Nassif & Wladimir Leite)
#811: Improve decoding of E-Mule known.met entry file names with diacritics (Wladimir Leite)
#622: Use embedded JRE on windows when creating report (Luis Nassif)
#860: New methods to allow saving bookmarks synchronously (Luis Nassif)
#846: Some export files/properties dialogs take a long time to open (Luis Nassif)
#710: Improve bookmarks shortcuts responsiveness (Wladimir Leite)
#722: Avoid conflict between bookmark shortcuts and navigation/assigned keys (Wladimir Leite)
#852: Upgrade to ImageMagick-7.1.0-q8-x64 to fix animated webp images not being rendered (Luis Nassif)
#862: Upgrade to PDFBox 2.0.23 (Luís Nassif)
Fixes:
#793: Error in "Name" column when selecting some Regexes caused by IllegalArgumentException in 3.18.9 (Luis Nassif)
#848: NumberFormatException in Report Generation in 3.18.9 (Wladimir Leite)
#840: Invalid file Date causes export to ZIP feature to abort (Luis Nassif)
#791: 2nd level containers could be deleted from case folder when resuming with --continue (Luis Nassif)
#839: ConcurrentModificationException while creating bookmarks programmatically can stop bookmark saving (Luis Nassif)
#794: Aborting NullPointerException from NamedEntityTask not fixed (Luis Nassif & Wladimir Leite)
#805: Date values in unexpected fields could cause the processing to abort (Luis Nassif & Fábio Pfeifer)
#785: Not found folder datasource look up and replacement may fail (Luis Nassif)
#795: Missing DLL in OfficeViewer could cause LibreOffice window to be detached from main GUI (Luis Nassif)
#817: Fix copying items table cell content using CTRL+C (Wladimir Leite)
#788: Subitems of 2nd level containers might point to no parent when resuming processing (Luis Nassif)
#806: Processing error if evidence has dollar sign in the name (Luis Nassif)
#766: Ignore search matches when the search expression is used to filter (Luis Nassif)
#819: SleuthkitServer starting eventually fails due to same temp dir being used by multiple processes (Luis Nassif)
10/14/2021: IPED-3.18.9
News:
#758: Support new Android WhatsApp msgstore.db schema (Luis Nassif)
#558: New regex patterns to search for cripto wallets seed phrases (João Hauck & Luis Nassif)
#752: Validation for crypto wallets seed phrases (João Hauck & Luis Nassif)
#778: Compute md5, sha1 (and sha256) by default and include them in "FileListing.csv" (Luis Nassif)
#754: Add fixed size VHD detection based on footer signature (Luis Nassif)
#773: Allow specifying multiple passwords for different evidences in command line (Luis Nassif)
#733: Add a "-nocontent all" parameter value when exporting items to report (Luis Nassif)
#761: Remove "bookmark" and "score" properties from metadata panel and autocomplete (Wladimir Leite)
#768: Protection for StackOverflow from Tika in SignatureTask (Luis Nassif)
Fixes:
#708: Don't print Shareaza albums entries in new rows again if already in the library (Fábio Pfeifer)
#718: Aborting IllegalArgumentException in ExportCSVTask.finish() with --continue/--restart and EN locale (Luis Nassif)
#709: ClassCastException when re-extracting subitems from carved/sub containers when resuming processing (Luis Nassif)
#719: NullPointerException caused by 2nd level containers if processed again with --continue (Luis Nassif)
#721: Error exporting subitem: java.io.FileNotFoundException indexador\subitens\043 (Access is denied) when resuming processing (Luis Nassif)
#783: Processing aborting due to MaxBytesLengthExceededException: bytes can be at most 32766 in length (Luis Nassif)
#760: Highlight regex hits corresponding to substrings in TextViewer and HitsTab (Luis Nassif)
#759: Report creation from UI with Google audio transcription enabled fails (Luis Nassif)
#740: Legacy Imagemagick 6.x version does not work with IPED on Linux (Luis Nassif)
#705: MPlayer consuming enormous ammount of memory on Linux (Wladimir Leite)
#750: RegistryParser, OutlookPSTParser & LibPffPSTParser not flagging files with parsing errors (Luis Nassif)
#717: Rare aborting NullPointerExceptions when resuming processing (Luis Nassif)
08/18/2021: IPED-3.18.8
News:
#470: Change default plain text parser to support chars outside Latin1 charset (Luis Nassif)
#416: Integrate a MSGViewer for MSG emails (Guilherme Dutra & Luis Nassif)
#415: Improve EMLViewer to render inline images inline (Luis Nassif)
#206: Upgrade to tesseract 5.0-alpha (Wladimir Leite)
#651: Partially parse emails and attachments from Outlook for Mac (Luis Nassif)
#605: Support rendering JBIG2 images without preamble extracted from PDFs (Luís Nassif)
#578: Thumbnails generated by external conversion may be larger than necessary (Wladimir Leite)
#356: Warn user if WhatsAppParser runs and sha-256 was disabled by him (Luis Nassif)
#707: Warning message about LED >= 1.29 incompatibility (Luis Nassif)
Fixes:
#698: Shareaza parser output missing files from albums (Fábio Pfeifer)
#669: NTFS USN Journal parsing fails when processing disk images if indexTempOnSSD = false or journal size > 1GB (Luis Nassif)
#655: TaggedIOException: unsupported feature (data descriptor + stored flags) could cause internal ZIP structure to be lost (Luis Nassif & Wladimir Leite)
#689: Google Maps item selection by rectangle or radius is not working (Luis Nassif)
#638: Processing rarely aborts with MalformedInputException because of invalid unicode strings being created (Luis Nassif, João Hauck & Wladimir Leite)
#635: Scroll to media position instead of keyword search hit when using the References tab (Luis Nassif)
#645: Exact searches on recordDate and extended date fields are not working (Luis Nassif)
#682: Sometimes HitsTab shows too short fragments and TextViewer has undesired breaklines (Luis Nassif)
#639: CSV exporting should use separator and hyperlink formula depending on locale (Luis Nassif)
#685: Korean chars rendered as squares in TextViewer (Luis Nassif & Wladimir Leite)
#700: Don't ask for new datasource path if the case is a report (Luis Nassif)
#678: Wildcard queries with uppercase chars and case sensitive indexing doesn't work (Luis Nassif)
#664: WhatsApp media links to folder datasource not working when opening the chat externally (Luis Nassif)
#690: Rare aborting ConcurrentModificationException while processing (Luis Nassif)
#686: "CTRL+" text zoom doesn't work for some keyboard layouts (Luis Nassif)
06/28/2021: IPED-3.18.7
News:
#49: From a selected media file, go to related conversations / p2p histories (Luis Nassif)
#562: 15x Faster PSD images rendering using a Java library to read them (Wladimir Leite)
#623: Change TelegramParser to handle just Android databases by default when processing UFDR (Luis Nassif)
#611: Makes processing robust against imported NSRL databases with product code inconsistencies (Luis Nassif & Wladimir Leite)
#548: Optimize linked items searching when creating reports (Luis Nassif)
#560: Add file signature for TS videos (Wladimir Leite)
#547: Signature and classification for NSF Lotus Notes files (Luis Nassif)
#604: Removes duplicate device information from UFDR reports with no source extraction id (Luis Nassif)
#581: Meaningful error message with the --continue flag if the output folder is empty (Luis Nassif)
#550: Improved message for Sleuthkit errors (Wladimir Leite)
Fixes:
#553: Avoid conflict between bookmarks shortcut keys and "type to find" an item (Wladimir Leite)
#601: "NoSuchFieldError: annotation" in RTFParser2 can cause parsing error with PST/OST and enableExternalParsing = true (Luis Nassif)
#603: NullPointerException when creating device info from UFDR with empty extraction name (Luis Nassif)
#559: Automatic export files by keywords feature is ignoring just a few diacritics (Luis Nassif)
#607: Some apps in tools folder depend on MS DLL not always present in processing machine (Luis Nassif)
#592: Invalid video thumbs in reports when creating report from Linux or cmd line on Windows (Luis Nassif)
#621: Warning on GUI and exit if user doesn't have JavaFX installed instead of displaying error null (Luis Nassif)
#577: Exception in ImageSimilarity if thumbnail dimension exceeds standard dimensions (Wladimir Leite)
#549: NullPointerException in VcardParser when parsing vcards pointing to external thumbnail (Luis Nassif)
#620: Image thumbnail creation for non standard formats fails for about 1% of them (Wladimir Leite)
#624: Processing UFDR + HDD together can cause WhatsApp & Telegram DBs from HDD to be ignored depending on configs (Luis Nassif)
#582: Files with 0 bytes not included in "Empty Files" category (Wladimir Leite)
#571: Processing rarely aborting when some file with corrupted metadata is indexed (Luis Nassif)
#576: Deadlock if (100k+numThreads) sqlites are found (Luis Nassif)
#609: Typing some keys cause an undesired advance to the next item in the main table (Wladimir Leite)
#590: Inconsistent ocrCharCount in Text and Metadata viewers (Wladimir Leite)
#490: Errors in the console while processing corrupted VCFs (Luis Nassif & Wladimir Leite)
#365: Fail to delete temp file of DBX mailboxes (Luis Nassif)
05/14/2021: IPED-3.18.6
News:
#469: Plot videos with geo information on map (Luis Nassif)
#540: Support Telegram version 7.6/7.7 (João Hauck)
#336: Device Info Category - UFDR x IPED (Wladimir Leite)
#507: Automatic detection for unknown charsets of PST/OST extracted emails (Luis Nassif)
#334: Support decoding of Firefox saved sessions (Thales Rodrigues e Luis Nassif)
#500: Handle Message.rtf items extracted from emails of OST files as body not as attachment (Luis Nassif)
#428: Add WhatsApp sender/recipient info to chat preview and metadata for 2 parties chats (Leandro Oliveira)
#504: Remove "Experimental" label from Image Similarity and enable it in some profiles (Wladimir Leite)
#544: Enable TelegramParser by default for UFDR (Luis Nassif)
#320: Items count for each bookmark (Wladimir Leite)
#482: Change Bitcoin SegWit address Regex to be more specific (Fábio Pfeifer)
#437: Improve chat formatting when copied to (or inserted into) text editors MS Word/LibreOffice (Wladimir Leite)
#473: Upgrade java-libpst library to 0.9.5-20210209-p1 (Luis Nassif)
#502: Upgrade DIE nudity detection model to 20210505 (Wladimir Leite)
Fixes:
#539: OutOfMemoryError caused by ZipBomb control map cumulative memory leak (Luis Nassif)
#488: "Processing did not finish ok" warning incorrectly shown in multicases (Luis Nassif)
#430: Embedded MSG attachments of other MSG emails not extracted correctly (Luis Nassif)
#422: Selecting many edges at the same time in graph tab sometimes leaves some edges unselected (Luis Nassif)
#435: Issues with displaying Cyrillic (абвгдеёжз..) and Latvian (aābcčd..) characters in some areas of the program (Luis Nassif)
#510: Race condition in QueryBuilder (Fábio Pfeifer)
#542: Blind profile default configuration not populating graph with instant messages (Luis Nassif)
#460: Large ZIP > 10MB parsing can fail with rare combination of STORED_ENTRIES and DATA_DESCRIPTOR flags (Luis Nassif)
#496: Very old WhatsApp version chats are not being parsed (Fábio Pfeifer)
#543: TelegramParser contact decoding is not thread safe (João Hauck)
#477: Fix exceptions thrown from PhotoDNATask module (Wladimir Leite)
#446: TSK $UPCASE_TABLE files from ExFAT FS causes the processing to take too long (Luis Nassif)
#454: Error accessing files extracted from local folders with blind profile and enableHtmlReport = false (Luis Nassif)
#476: Fix exporting DB individual records to report with blind profile and enableHtmlReport = true (Luis Nassif)
#518: External thumbnail generation fails for rare valid images (Wladimir Leite)
#436: Rare ConcurrentModificationException closing UFDR file cache when finishing processing (Luis Nassif)
03/26/2021: IPED-3.18.5
News:
#360: NTFS USN Journal parser (João Hauck and Luis Nassif)
#136: Create memory and file cache for UFDR compressed files (Luis Nassif)
#391: Faster item count per category (Wladimir Leite)
#376: Optimize --continue option starting (Luis Nassif)
#399: Break tables extracted from SQLite files in multiple html subitems (João Hauck and Luis Nassif)
#413: Show warning in GUI if case processing has not finished successfully (Luis Nassif)
#305: Handle Windows10 1703/1709 user activities ActivitiesCache.db (Matheus Bichara)
#353: Populate CategoriesToExport.txt config with phone categories (Luis Nassif)
#363: Uncompress NSRL.txt.zip automatically and show progress window icon on task bar (Luis Nassif)
#412: Identify source case when selecting file in multicase analysis (Luis Nassif)
#394: Non ascii chars in extension of exported files could be inconvenient (Luis Nassif)
#417: Sort bookmark labels inside the "Bookmark" column (Luis Nassif)
#359: IPEDSearcher should be reusable after first search (Luis Nassif)
Fixes:
#397: Too many Sleuthkit processes with multiple evidences (memory leak) (Wladimir Leite)
#352: Infinite processing caused by ZipBomb files (Luis Nassif)
#375: --restart option is not working properly (Luis Nassif)
#330: Some inline text/html EML bodies are wrongly extracted as attachments (Luis Nassif)
#411: Diffs between EML parser and viewer when raw emails are forwarded inline (Luis Nassif)
#418: Bookmark disappearing from the bookmark manager when changing capitalization (Luis Nassif)
#389: JBIG2 images in PDFs not being rendered in preview (Luis Nassif)
#329: Aborting NullPointerException in NamedEntityTask (Luis Nassif)
#393: Abrupt power off could corrupt OCR results database while processing (Luis Nassif)
#381: ClassLoader is loading gui related classes with --nogui option (Luis Nassif)
#374: Multicase graph and log in readonly cases not working (Luis Nassif)
#346: Carved item content sometimes is less than its size (Luis Nassif)
#328: NullPointerException and "too many -1 (EOFs)" with some emails (Luis Nassif)
#382: NullPointerException when indexing UFDR reports to ElasticSearch (Luis Nassif)
11/27/2020: IPED-3.18.4
News:
#280 Load and look up ProjectVIC photoDNA hashes (Luis Nassif)
#254 Parser for Google Drive Files (Matheus Bichara and Luis Nassif)
#282 Support RAR 5 format via upgrade to 7zipJBinding-16.02-2.01 (kraftdenker)
#296 Look up ProjectVIC hashes in app history records for Emule, Ares, Shareaza, WhatsApp, Telegram, Skype, Ufed chats, Google Drive (Luis Nassif)
#173 Decode and fill in whatsapp group message recipients in individual messages (João Hauck)
#290 Fix known.met generated visualization to allow copying to a spreadsheet style format (Wladimir Leite)
#291 Add explicit columns to known.met visualization to indicate files found in KFF and in the case (Wladimir Leite)
#294 Add "found in case/hashset" columns and fix tabular format copy in Ares parser (Wladimir Leite)
#297 Add "found in case/hashset" columns to ShareazaParser (Luis Nassif)
#311 Warn user instead of aborting if antivirus has blocked or deleted extracted text temp file (Luis Nassif)
#315 Allow ElasticSearch module to use http or https (Luis Nassif)
#240 Block when appending an image in a case processed in a previous version of IPED (Luis Nassif)
#283 Configurable double click behaviour (Luis Nassif)
Fixes:
#285 Analysis GUI frozen if libreoffice-java-common is not installed on Linux (Luis Nassif)
#299 WhatsApp attachment hash look up at LED hashset may not work (Luis Nassif)
#301 Error parsing files with enableExternalParsing = true after upgrading to SevenZipJBinding-16.02-2.01 (Luis Nassif)
#303 EdgeWebCacheParser not working when enableExternalParsing = true (Luis Nassif)
#304 ClassCastException: java.lang.String cannot be cast to dpf.sp.gpinf.indexer.process.task.regex.RegexHits (Luis Nassif)
#309 Old WhatsApp databases from 2015 app version with parsing error (Luis Nassif)
#310 Rare OutOfMemoryError in VCardParser (Luis Nassif)
#314 Error indexing to ElasticSearch: NoSuchMethodError: org.apache.http.ConnectionClosedException: method <init>()V not found (Luis Nassif)
#313 Deadlock or very slow rendering with error in gallery if enableImageThumbs = false (Luis Nassif)
#316 Items not configured to be exported being indexed to ElasticSearch (Luis Nassif)
#318 Integer overflow when reading media_size column in android WhatsApp database (Luis Nassif)
#319 Error creating report in other machine if projectVicHashSetPath is not found (Luis Nassif)
#312 Carved files wrongly processed after ExportFileTask with blind profile and enableHtmlReport = false (Luis Nassif)
#321 Evidence can be duplicated in case when resuming with --continue (Luis Nassif)
#322 RuntimeException: duplicated id: null when starting web server on Windows when / is used instead of \\ in cases json (Luis Nassif)
#323 Carved files not opened in GUI when folder datasource is moved (Luis Nassif)
#327 Wrong warning about plugin Jpeg2000 not found (Luis Nassif)
10/08/2020: IPED-3.18.3
News:
#81 Optimize image thumb generation up to 3x (Luis Nassif & Wladimir Leite)
#129 Nudity detection for videos (Wladimir Leite)
#177 Parser for Telegram/Vidogram (disabled for UFDR for now - João Hauck & Luis Nassif)
#221 Support ProjectVIC hashset format (Luis Nassif)
#231 Decode WhatsApp stickers in messages (João Hauck)
#230 Update java-dbx plugin to 1.1-p4 (Wladimir Leite)
#250 Do not change item size based on UFDR info, possibly misleading (Luis Nassif)
#252 Verify if the hashes of missing WhatsApp attachments are in the LED CSAM database (João Hauck)
#255 New config option to allow skipping input folders by regex for triage scenarios (Luis Nassif)
#259 Append hash suffix to name of exported zip file if GUI is in triage mode (Luis Nassif)
#263 Using variable time-out when generating thumbs according to image size (Luis Nassif)
#264 Change PSD and EMF images to be rendered by ImageViewer (Luis Nassif)
#269 Identify if Ufed or Skype chat attachments are in LED CSAM database (Luis Nassif)
#271 Ask before external opening executable files (Luis Nassif)
#274 Change default numImageReaders param to 1/4 of logical cpu cores (Luis Nassif & Wladimir Leite)
#275 Upgrade DIE nudity detection model to 20200916 (Wladimir Leite)
#276 Description about the meaning of red lines in P2P history reports (Luis Nassif)
Fixes:
#20 Temporary sqlite file leak (Luis Nassif)
#213 Phones incorrectly decoded from email addresses and user accounts (Luis Nassif)
#223 Aborting error when indexing to ElasticSearch (Luis Nassif)
#224 Possible division by zero in HexViewerPlus searching progress bar (Guilherme Guimarães)
#225 Items exported to indexed reports not opened by GUI viewers when enableHtmlReport = false (Luis Nassif)
#226 Error creating reports from "blind" cases or from other reports when enableHtmlReport = false (Luis Nassif)
#229 Rare InvalidPathException when deleting temp processing directory (Luis Nassif)
#233 LedKFFTask caching is not working (Wladimir Leite)
#235 NPE when creating report with graph enabled when graph was not enabled in original case (Luis Nassif)
#244 Checking empty attachments in UFED chat previews selects all empty files in case (Luis Nassif)
#245 ClassCastException when generating report with process-proximity-relationships true in GraphConfig.json (Luis Nassif)
#249 Error creating report from GUI if audio transcription was enabled (Luis Nassif)
#253 Error generating graph in a multicase if some of its cases has no graph information (Luis Nassif)
#256 Aborting NullPointerException when processing Windows root folders (Luis Nassif)
#257 -dname option not updating item paths when processing folders (Luis Nassif)
#258 Export file tree of checked items is filtering by selected tree node (Luis Nassif)
#260 Error generating graph in multicases if some case folder was renamed or moved (Luis Nassif)
#261 Error generating graph in multicases with duplicate node ids between cases (Luis Nassif)
#265 Race condition in item id generator (Luis Nassif)
#268 Checking empty skype attachments causes selection of all empty files in case (Luis Nassif)
#272 Syntax error in ParserConfig.xml of triage profiles (Luis Nassif)
#273 Aborting ParseException with uncommon date format from UFDR reports (Luis Nassif)
08/04/2020: IPED-3.18.2
News:
#216 Persist any new dataSource locations chosen by user (Luís Nassif)
#215 Print full timestamp for each WhatsApp message in chat html (Luís Nassif)
#214 Periodically log items being processed when using --nogui (Luís Nassif)
#203 Warn Linux users about need to install graphviz for graph layouts (Luís Nassif)
#207 Automatic CI jobs for newer java versions and upload java8 snapshot builds (Luís Nassif)
#217 Disable addToGraph menu option for items not related to communications (Luis Nassif)
Fixes:
#209 Error creating report in version 3.18.1 (Luís Nassif)
#218 Error generating graph in reports (Luís Nassif)
#212 Sorting results by some single valued columns never ends in 3.18.1 (Luís Nassif)
#213 Phones incorrectly decoded from email addresses and user accounts (Luís Nassif)
#210 Case remains image dependent when using blind profile w/ enableHtmlReport off in 3.18 (Luís Nassif)
#204 Gallery image click not working with openJDK8 on Linux (Luís Nassif)
#211 Right click on table regression in 3.18 and 3.18.1 on Linux (Luís Nassif)
07/16/2020: IPED-3.18.1
News:
#175 Synchronize chat view checkboxes of medias with table tab checkboxes (Luis Nassif)
#201 Merge decoded whatsapp accounts with wa accounts extracted from ufed xml in graph (Luis Nassif)
#197 Categorize HFS DECOMP streams when using fastmode (Luis Nassif)
#188 Support pure negative queries like -field1:xxx -field2:yyy (Luis Nassif)
#200 User and password parameters to connect to ElasticSearch (Luis Nassif)
#181 Unzip Libreoffice files to AppData\Local directory (Luis Nassif)
#193 Optimize whatsapp chat html (Fabio Pfeifer)
#179 Migrate to Lucene-5.5.5 (Luis Nassif)
Fixes:
#191 Checking media files in whatsapp chats works just when chat loading finishes (Luis Nassif)
#182 Pure negative queries like -field:xxx being inverted (Luis Nassif)
#187 Error generating graph when there is space in iped path (Luis Nassif)
#199 Error generating graph database on windows if output folder has accents (Luis Nassif)
#196 Error creating report from command line with graph generation enabled (Luis Nassif)
#189 Some iped gui processes left behind if errors occur opening cases (Luis Nassif)
07/02/2020: IPED-3.18-beta
News:
#15 Graph analysis for communications (Filipe Simões and Luis Nassif)
#62 Resume aborted or stopped processing: new options --continue & --restart (Luis Nassif)
#85 Audio transcription: implementations with Azure and Google cloud, must set credentials (Luis Nassif)
#156 First version of similar image search feature, disabled by default (Wladimir Leite)
#26 Initial ElasticSearch indexing module, not accessed by java GUI for now (Luis Nassif)
#25 Store small subitems, thumbs and ocr text in containers, speeding up case copying and deletion (Luis Nassif)
#29 Improved HexViewer with goto, search, charset selection, layout customization and more (Guilherme Dutra)
#70 Regex validators for bitcoin cash, ethereum and riple criptocurrencies, now enabled by default (Fabio Pfeifer)
#152 Add regexes and validation for bitcoin related private Keys (Fabio Pfeifer)
#61 Parsers for torrent and resume.dat files (Fabio Pfeifer)
#31 Parser for Windows 10 user activities timeline (Matheus Bichara)
#14 Basic parser for SkypeV12 (Patrick Bernardina)
#45 Improved Image/TiffViewer with rotation, size fit and brightness control (Wladimir Leite)
#55 Refactoring to detach individual viewers (Wladimir Leite)
#60 Viewer for Autocad DWG files (Alberto Magno)
#60 Keyboard shortcuts for bookmarks (Alberto Magno and Luis Nassif)
#60 Recursive subitem checking (Alberto Magno and Luis Nassif)
#58 GPX and KML files are now expanded in more profiles (Luis Nassif)
#96 Select media files embedded in html chat conversations (Luis Nassif)
#97 Extract each WhatsApp/Skype message as a new item into the case (Luis Nassif and Patrick Bernardina)
#82 Links to open cached images embedded in old Skype chats (Luis Nassif)
#164 Go to parent chat position from individual messages (Luis Nassif)
#163 Normalize skype chat recipient names to use skypename (Luis Nassif)
#165 Viewer for referenced files (eg. message attachments) (Luis Nassif)
#162 Extract WhatsApp account information (Luis Nassif)
#134 Render contact and user photos in gallery (Luis Nassif)
#127 Option to create thumbs for videos to be shown in the gallery (Wladimir Leite)
#141 Simple button to clear all filters (Luis Nassif)
#148 Better auto manage columns rules and pin columns feature (Luis Nassif)
#145 Create html conversation for Ufed chats with no messages (Luis Nassif)
#105 Do not duplicate UFED chat attachments in case (Luis Nassif)
#101 Files are exported with original extension instead of detected one (Luis Nassif)
#153 Update nudity detection model to 1.26 (Wladimir Leite and Luis Nassif)
#126 Optimize WhatsApp contact thumb searching to 50x (Luis Nassif)
#109 Optimize processing of OLE2 files up to 50x (Luis Nassif)
#166 Optimize memory usage of UFEDChatParser (Luis Nassif)
#64 Optimization for PST decoding up to 3x (Luis Nassif)
#47 Optimization for bookmarking hash duplicates (Luis Nassif)
#93 Avoid pop up error dialog for corrupted PDFs (Wladimir Leite)
#131 Auto rotate videos (Wladimir Leite)
#113 Dynamic layout of frames extracted from videos (Wladimir Leite)
#122 Kffcarving and categorization for vhdx files as "Image Disks" / "Virtual Disks" (Luis Nassif)
#168 Try to fill in empty party info from communications decoded from ufed xml (Luis Nassif)
#53 Easier way to change the number of thumbnail columns in gallery (Wladimir Leite)
#124 Copy item name in the gallery (Wladimir Leite)
#75 Embed html resources in chat html previews (Fabio Pfeifer)
#44 Changed vcard parser to generate a html preview instead of subitems (Fabio Pfeifer)
#160 Skip lines with syntax errors in keyword list file when processing (Luis Nassif)
#142 Move default configuration files to profiles/en (Luis Nassif)
Fixes:
#106 OutOfMemory when processing last items from huge cases in CPUs with many cores (Luis Nassif)
#158 SQLites up to 16MB from UFDRs kept in heap when indexTempOnSSD = false (Luis Nassif)
#100 Free term searches and regex scan not working with video metadata (Luis Nassif)
#138 Aborting error when indexing internal dates with english locale (Luis Nassif)
#117 Display all attachments of each UFED chat message in conversation preview (Luis Nassif)
#133 Render Vcard photos in html preview (Fabio Pfeifer)
#132 Metadata "video:format" contains incorrect information (Wladimir Leite)
#130 Some Long values are printed in scientific notation (Luis Nassif)
#147 ufed:labels wrongly typed as integer causing 'Error' when rendering multivalued cells (Luis Nassif)
#116 Estimated negative time to finish UFDR processing (Luis Nassif)
#111 Minor bug when copying a cell content with highlighted text (Wladimir Leite)
#167 User info in vcards sent through chats decoded from ufed xml stored in wrong metadata (Luis Nassif)
#86 Links in chat html previews not working for attachments with wrong extension (Luis Nassif)
#83 Some cached image thumbs of old Skype versions not inserted in chats (Luis Nassif)
#79 Columns added again and mixing content after refreshing GUI when analyzing case before processing ends (Luis Nassif)
#69 Report creation from command line sometimes did not work (Luis Nassif)
#161 Report generation from command line does not fill evidence description (Luis Nassif)
#51 On demand duplicate filter sometimes did not filter first duplicate (Luis Nassif)
#46 GUI error when re-opening case while processing (Luis Nassif)
#92 PPSX presentations played automatically when viewed (Wladimir Leite)
#87 Wal logs merged in main SQLite when stored in FS (Fabio Pfeifer)
#54 Row selection by typing in sorted column was not working (Wladimir Leite)
#50 Export to CSV sometimes generates malformed CSV (Luis Nassif)
#94 ParseException "Unparseable date" with some UFDR chat reports (Luis Nassif)
#95 Email recipients should be stored individually in metadata (Luis Nassif)
#98 Vcard Html preview is using wrong encoding (Luis Nassif)
#99 Infinite subitem recursion causing IllegalArgumentException: DocValuesField "parentIds" is too large (Luis Nassif)
03/18/2020: IPED-3.17.2
Fixes:
- Profile fastmode not working in v3.17 (#30)
- HtmlViewer is downloading external resources since 3.16 (#22)
- Typed evidence description not included in html report (#37)
- Records from sqlites in wal mode may be missed (#21)
- Range searches in internal dates (exif, office, message-date...) not working (#19)
- Error reading files on Linux without patch in sleuthkit (#16)
- Retry sleuthkit sqlite read errors (#38)
- Fix parsing of carved vcards (PR #40) by Fabio Pfeifer
02/13/2020: IPED-3.17.1
News:
- Check and abort if user changed default locale and default english configuration files
- Changed communication with external robustImageReaders from sockets to pipes
- Better pooling, increased timeout and communication checks with robustImageReaders
Fixes:
- NullPointerException in PhotoDNA module
- Back compatibility of PhotoDNA module with 3.16.x version
- -ocr option did not work with bookmark names or enableExternalParsing on
- useNIOFSDirectory option did not work properly
- Rare infinite loop in robustImageReader restarting if mmap is interrupted
12/27/2019: IPED-3.17
News:
- Changed default locale and configuration files to english
- Moved all source code to github
- Moved custom dependencies from internal to external repo
- Report dialog to fill in case information
- Created json format to store and load report info
- Embedded fast random forest nudity detection model
- Allow opening multicases from iped program folder
- Show warning info instead of aborting when optional databases are not found
- Updated project and thirdparty licenses, moved them to root project
- Removes photoDNA compile dependency
Fixes:
- back compatibility of IPEDSource class
- FileNotFoundException when opening case while processing with some profile
- Fix NSRL importing error
### Previous release notes in Portuguese (not translated) ###
26/11/2019: IPED-3.16.3
- Corrige StringIndexOutOfBounds na validação de boletos que abortava processamento (3.16)
- Menor uso de memória no EdgeParser e proteção para raros erros de concorrência (3.16)
- Corrige abertura de casos somente leitura via patch04 no tsk-4.6.5-apfs (3.16)
- Corrige abertura de multicasos, no carregamento do ResultSetViewersConf.xml (3.16)
- Filtra erros e warns do PDFBox e Freemarker do log e console, melhor log de exceções de parsing (<=3.16)
- Workarounds para erros raros SQLITE_BUSY que abortavam processamento (<3.16)
- Corrige erro "Image not found" ao abrir caso durante processamento com --portable e --append (<3.16)
- Upgrade xerial-sqlite 3.23.1 -> 3.25.2
19/11/2019: IPED-3.16.2
- Obtenção de mais dados de downloads quando disponíveis (bytes totais e recebidos, datas de downloads p/ Safari)
- Utilização de parsers genéricos no caso de erro nos parsers específicos de navegadores
- Correção da obtenção das URLs de downloads do Chrome, tratamento de versões antigas do Chrome (3.16)
- Correção do RecycleBinParser: estava incluindo nome de arquivos temporários na saída (<3.16)
- Raro NullPointerException ao reaproveitar arquivo temporário abortava processamento (<3.16)
- Raro IOException "Write end dead" abortava processamento (<3.16)
- Fixa erro ao alterar layout vertical/horizontal na interface (3.16)
- Upgrade PDFBox-2.0.13 -> 2.0.17
01/11/2019: IPED-3.16.1-beta
- Plugin RegRipper para downloads e pesquisas do Shareaza (PCF Ayrton)
- Assinatura e categorização para bases de dados MSSQL (PCF Patrick)
- Pergunta por caminho de evidências ad1, ufdr ou pastas não encontradas
- Verifica se arquivo de marcadores carregado manualmente é compatível com caso atual (<3.16)
- Coluna "Tamanho" era ocultada em alguns casos com autoManageCols = true (<3.16)
- Fixa NoClassDefFoundError ao gerar relatório com base photoDNA configurada (3.16)
- Fixa EdgeWebCacheParser quando enableExternalParsing = true (3.16)
- Fixa abertura de documentos Office quando caminho do caso contém '#' (PCF Pfeifer) (<3.16)
- Fixa NullPointerException no SleuthkitJNI-4.6.5 (3.16)
- Portadas correções do sleuthkit-4.6.6 para o 4.6.5 com APFS (<3.16)
16/10/2019: IPED-3.16-beta
- Suporte a APFS (novo parâmetro -p password)
- Suporte a módulos de processamento em Python (ver detalhes em conf/scripts/PythonScriptTask.py)
- Detecção de nudez via deeplearning com Yahoo open-nsfw (desligado por padrão, ver detalhes em NSFWNudityDetectTask.py)
- Integração do PhotoDNA-3.3 (distribuído a parte, copiar photodna-1.0.0.jar em optional_jars)
- Busca de hashes em base PhotoDNA, configurar 'photoDNAHashDatabase' em LocalConfig.txt
- Refactoring do data carving, agora configurável em XML e javascript (PCFs Patrick e Nassif)
- Melhorias nos carvers de ZIP e EML (PCFs Patrick e Nassif)
- Carvers para KML, GPX, DER e certificados digitais (PCF Patrick)
- Novo Carver para VCARD (PCF Pfeifer)
- Melhorias no WhatsAppParser: suporte a msgs de sistema, localizações (exibidas no mapa), chamadas de áudio e vídeo, melhor linkagem de anexos no iphone (PCF Pfeifer)
- Parsers específicos para históricos do Chrome, Firefox, Edge e Safari (PCF Herrmann e Nassif)
- Parser para arquivos KML e GPX (PCF Patrick)
- Parser para arquivos VCARD (PCF Pfeifer)
- WebAPI básica para pesquisas em casos remotos, obtenção de propriedades, extração de itens, texto, thumbs e criação de marcadores (PCF Átila)
- Refactoring do módulo de Regex, permitindo escrever validadores em java ou javascript (APF Filipe Simões)
- Regex e validador para endereços Bitcoin (PCF Pfeifer)
- Regex comentadas para criptomoedas Ethereum, Ripple, Neo, Dash, Dogecoin e habilitada para Monero;
- Otimização da exibição dinâmica de colunas, re-habilitada por padrão (desligável em AdvancedConfig/autoManageCols)
- Opção "useNIOFSDirectory" para não mapear o índice em memória, o que eventualmente causava crashes pela rede
- Opção "numImageReaders" para setar nº de processos ao ligar 'robustImageReading', padrão usa metade do nº de CPUs lógicas
- Altera "numExternalParsers=auto" para usar metade do nº de processadores caso OCR esteja desligado
- Opção "storeTextCacheOnDisk", desabilitada no perfil triage para usar menos espaço no temp
- Configuração do perfil "triage" para ignorar itens em pastas de sistema (PCF Sícoli)
- Foco na subAba de metadados ao clicar em itens do UFED ou registros de browsers
- Solicitação de chave Google Maps Javascript API para correto uso do mapa
- Incluído modelo de relatório html em inglês
- Atualização para sleuthkit-4.6.5
- Suporte a AD1 versão 4
Correções:
- Erro ao processar relatórios UFED com bookmarks (ignorados por ora)
- Caracteres de controle inválidos no XML do UFED abortavam processamento
- Erro ao gerar relatório ao mover caso de máquina
- Emails de PST com corpo apenas em RTF apareciam em branco
- Downgrade da libpff p/ 20131028 devido a raros anexos extraídos zerados
- Erro ao ligar enableExternalParsing qdo PATH continha valores com aspas duplas
- Correções diversas na localização para o inglês
- Travamento no processamento ao abrir GUI de análise com opção 'robustImageReading' ligada
- Hard links HFS+ exportados zerados para relatório, caso nele incluídos
- Subitens corrompidos zerados eram abandonados na pasta indexador/subitens
- Timeouts com itens de processamento mto lento (ex: OCR em pdfs grandes) ao ligar 'enableExternalParsing'
- Raro bug de concorrência na comunicação com robustImageReaders
- Raro OutOfMemory devido a milhões de hits de Regex em arquivos gigantes
- Fixa navegação no mapa quando os itens estão ordenados na tabela
29/03/2019: IPED-3.15.6