Skip to main content
. Author manuscript; available in PMC: 2025 Sep 30.
Published in final edited form as: Proc Mach Learn Res. 2025 Jun;287:527–542.

Table 2:

Performance of models under different promptings and data integration methods on string-level metrics. ↑ indicates the higher the better.

Model : Parameters Prompting Method TSR (%)↑ Levenshtein ↑ ExactMatch ↑

qwen2:7b FS UGP 25.107 0.043 0.001
qwen2:7b ZS UGP 27.748 0.057 0.001
qwen2:7b ZS FCSP 43.477 0.297 0.211
qwen2:7b ZS UCP 43.513 0.298 0.210
qwen2:7b FS UCP 48.592 0.343 0.259
qwen2:7b FS FCSP 48.693 0.344 0.260

qwen2.5:7b ZS UGP 28.432 0.071 0.001
qwen2.5:7b FS UGP 28.627 0.085 0.031
qwen2.5:7b ZS FCSP 51.946 0.423 0.345
qwen2.5:7b ZS UCP 52.041 0.425 0.345
qwen2.5:7b FS FCSP 56.377 0.453 0.383
qwen2.5:7b FS UCP 56.456 0.454 0.383

qwen2.5:32b FS UGP 23.378 0.032 0.001
qwen2.5:32b ZS UGP 28.805 0.082 0.001
qwen2.5:32b ZSCOT UCP 49.680 0.385 0.284
qwen2.5:32b ZS UCP 49.917 0.386 0.285
qwen2.5:32b ZS FCSP 50.203 0.387 0.288
qwen2.5:32b ZSCOT FCSP 50.203 0.387 0.288
qwen2.5:32b FS UCP 51.332 0.387 0.292
qwen2.5:32b FS FCSP 51.467 0.388 0.296

llama3:8b FS UGP 26.072 0.047 0.001
llama3:8b ZS UGP 28.732 0.066 0.001
llama3:8b ZS FCSP 49.462 0.343 0.259
llama3:8b ZS UCP 49.536 0.344 0.258
llama3:8b FS UCP 50.255 0.362 0.283
llama3:8b FS FCSP 50.351 0.363 0.285

gPt4o FS UGP 23.416 0.033 0.001
gPt4o ZS UGP 23.452 0.033 0.001
gPt4o FS UCP 30.862 0.136 0.046
gPt4o FS FCSP 31.051 0.132 0.044
gPt4o ZS FCSP 31.107 0.132 0.044
gpt4o ZS UCP 31.148 0.135 0.046