In case of large tables, there is no logs to infer on the current status of the worker. So logging the count of batches written will be helpful. Something like a global thread safe counter which increments and logs on every successful batch write should be helpful.
In case of large tables, there is no logs to infer on the current status of the worker. So logging the count of batches written will be helpful.
Something like a global thread safe counter which increments and logs on every successful batch write should be helpful.