Connect chronos run binary with sitevar

Summary: create a sitevar config to control all chronos job for the unified llm_under_test: https://www.internalfb.com/intern/sv/CYBERSECEVAL_CHRONOS_RUN_REFERENCE/

Differential Revision: D63501640

fbshipit-source-id: 3a8b10e2c9cc52de096fb2aeb3bb0001f1b25ea9

CybersecurityBenchmarks/benchmark/run.py

@@ -138,7 +138,12 @@ def main(
         type=int,
         const=16,
         default=1,
-        help="Specify the number of parallel calls to the LLM to speed up execution. Default is 1.",
+        help=(
+            "Specify the number of parallel calls to the LLM to speed up execution. "
+            "When not provided, it defaults to 1 thread. "
+            "When set as a flag (--run-llm-in-parallel), it defaults to 16 threads. "
+            "Users can also specify the number of threads, e.g., --run-llm-in-parallel=8."
+        ),
     )
 
     parser.add_argument(