Skip to content

llm_runner: plumb prefill temperature (#20244) #14035

llm_runner: plumb prefill temperature (#20244)

llm_runner: plumb prefill temperature (#20244) #14035

Job Run time
2s
32s
46m 16s
52m 12s
16m 40s
19m 44s
42m 49s
17m 59s
13m 47s
28m 58s
19m 33s
26m 45s
25m 41s
27m 24s
20m 25s
19m 46s
24m 21s
31m 11s
21m 37s
30m 9s
25m 35s
25m 19s
52m 19s
3s
19m 57s
11m 3s
19m 48s
23m 22s
12m 1s
20m 36s
18m 19s
22m 9s
27m 4s
12m 16s
8m 58s
14m 28s
14m 19s
11m 5s
12m 0s
11m 36s
27m 36s
28m 38s
15h 4m 22s