Skip to content

Commit

Permalink
feat: 🚩 add qalign_8bit and qalign_4bit
Browse files Browse the repository at this point in the history
  • Loading branch information
@chaofengc
chaofengc committed Aug 30, 2024
1 parent ae90cf0 commit e225d8f
Showing 1 changed file with 14 additions and 12 deletions.
26 changes: 14 additions & 12 deletions tests/NR_benchmark_results.csv
View file
Original file line number Diff line number Diff line change
@@ -1,25 +1,27 @@
Metric name,livec(PLCC/SRCC/KRCC),koniq10k(PLCC/SRCC/KRCC),tid2013(PLCC/SRCC/KRCC),flive(PLCC/SRCC/KRCC),spaq(PLCC/SRCC/KRCC),koniq10k-1024(PLCC/SRCC/KRCC)
brisque,0.3509/0.3128/0.2113,0.2107/0.23/0.1548,0.4317/0.3672/0.2574,,0.5333/0.5259/0.366,
nrqm,0.4122/0.3012/0.2013,0.4756/0.3715/0.2517,0.4795/0.349/0.2413,,0.6784/0.6507/0.45,
niqe,0.48/0.4505/0.3069,0.3155/0.3769/0.2555,0.3669/0.3121/0.2124,,0.6692/0.6929/0.4928,
ilniqe,0.4938/0.4381/0.2972,0.5232/0.551/0.3862,0.5156/0.487/0.3442,,0.6596/0.719/0.5137,
nrqm,0.4122/0.3012/0.2013,0.4756/0.3715/0.2517,0.4795/0.349/0.2413,,0.6784/0.6507/0.45,
pi,0.5201/0.4615/0.3139,0.4688/0.4573/0.3132,0.4627/0.3479/0.2398,,0.7353/0.7307/0.5227,
nima,0.4993/0.5071/0.348,0.7156/0.6662/0.4816,0.3324/0.321/0.2159,,0.5153/0.5201/0.3558,
paq2piq,0.7542/0.7188/0.5302,0.7062/0.643/0.4622,0.5776/0.4011/0.2838,,0.775/0.8289/0.6207,
pi,0.5201/0.4615/0.3139,0.4688/0.4573/0.3132,0.4627/0.3479/0.2398,,0.7353/0.7307/0.5227,
musiq-ava,0.6001/0.5954/0.4235,0.589/0.5273/0.3714,,,,
cnniqa,0.6372/0.6089/0.4257,0.7934/0.7551/0.558,0.398/0.1769/0.117,,0.7272/0.7397/0.5263,
wadiqam_nr,0.6631/0.6675/0.4721,0.83/0.8046/0.6129,0.3517/0.1544/0.1002,,,
clipiqa,0.6883/0.6955/0.5065,0.7211/0.6572/0.4736,0.6471/0.5786/0.4107,,,
tres-flive,0.7213/0.7336/0.5373,0.7507/0.7068/0.516,,,0.6137/0.7269/0.533,
paq2piq,0.7542/0.7188/0.5302,0.7062/0.643/0.4622,0.5776/0.4011/0.2838,,0.775/0.8289/0.6207,
clipiqa+_vitL14_512,0.7679/0.7729/0.5733,0.8747/0.861/0.6721,0.6063/0.5259/0.3709,,,
dbcnn,0.774/0.7562/0.5563,0.9197/0.9034/0.7338,0.5141/0.3855/0.2691,,0.8549/0.8473/0.639,
musiq-ava,0.6001/0.5954/0.4235,0.589/0.5273/0.3714,,,,
musiq-koniq,0.8295/0.7889/0.5986,0.8958/0.8654/0.6817,0.6814/0.575/0.4131,0.5128/0.4978/0.3437,0.8626/0.8676/0.6649,
hyperiqa,0.7779/0.7546/0.5562,0.9233/0.904/0.7336,0.5627/0.4537/0.3177,,,
musiq-paq2piq,0.8014/0.7672/0.5743,0.7655/0.7084/0.5146,,,0.8112/0.8436/0.6412,
tres-koniq,0.8118/0.7771/0.5808,,,0.513/0.4919/0.3391,0.8624/0.8619/0.66,
musiq-spaq,0.8134/0.789/0.5937,0.7528/0.6799/0.4927,,0.6039/0.5627/0.3941,,
maniqa,0.8262/0.8399/0.6491,0.9133/0.8934/0.7198,0.457/0.4515/0.318,0.4416/0.4489/0.3052,0.814/0.8166/0.6036,
clipiqa,0.6883/0.6955/0.5065,0.7211/0.6572/0.4736,0.6471/0.5786/0.4107,,,
clipiqa+,0.8312/0.8045/0.6109,0.8454/0.8026/0.6123,0.701/0.6318/0.4541,,,0.909/0.8954/0.7181
clipiqa+_rn50_512,0.8181/0.818/0.6231,0.9012/0.8847/0.7033,0.6577/0.5949/0.4241,,,
clipiqa+_vitL14_512,0.7679/0.7729/0.5733,0.8747/0.861/0.6721,0.6063/0.5259/0.3709,,,
tres-koniq,0.8118/0.7771/0.5808,,,0.513/0.4919/0.3391,0.8624/0.8619/0.66,
tres-flive,0.7213/0.7336/0.5373,0.7507/0.7068/0.516,,,0.6137/0.7269/0.533,
hyperiqa,0.7779/0.7546/0.5562,0.9233/0.904/0.7336,0.5627/0.4537/0.3177,,,
topiq_nr,0.8261/0.8106/0.6165,0.9436/0.9299/0.7727,0.5625/0.4452/0.3143,0.6289/0.5819/0.4105,0.8744/0.8704/0.6716,
maniqa,0.8262/0.8399/0.6491,0.9133/0.8934/0.7198,0.457/0.4515/0.318,0.4416/0.4489/0.3052,0.814/0.8166/0.6036,
musiq-koniq,0.8295/0.7889/0.5986,0.8958/0.8654/0.6817,0.6814/0.575/0.4131,0.5128/0.4978/0.3437,0.8626/0.8676/0.6649,
clipiqa+,0.8312/0.8045/0.6109,0.8454/0.8026/0.6123,0.701/0.6318/0.4541,,,0.909/0.8954/0.7181
qalign_8bit,0.8935/0.8833/0.7024,,0.8578/0.8385/0.6456,,,0.9452/0.9325/0.7778
qalign_4bit,0.8935/0.8833/0.7024,,0.8578/0.8385/0.6456,,,0.9452/0.9325/0.7778
qalign,0.8942/0.8814/0.6993,,0.8529/0.8313/0.6368,,,0.9506/0.941/0.7924

0 comments on commit e225d8f

Please sign in to comment.