perf(callaway): stop materializing per-cell unit-label arrays in influence_func_info

perf(callaway): stop materializing per-cell unit-label arrays in influence_func_info #2060