Trying to set the DCS batch settings. What is recommended?
(here higher and lower values are relative terms.)
So these parameters should basically ensure/optimize/modulate three things:
1.) No data loss (lower number of batches and lower batch-size may cause data loss)
2.) Real time availability of data in the dcs service (higher number of batches and higher batch-size and higher the time interval may lead to data unavailability in the dcs service for a long time)
3.) Optimize idle time for the batch thread (higher the batch-size and higher the time interval may lead the batch-thread to sit idle for a long time and then hyper-active for a longtime)
But in the case of migration for such a large number of users, the events get stored in the engine-cache in a short amount of time, which makes the event frequency very high to ensure the above mention three tasks. So, you cannot optimize the synchronization time, ensuring no data loss.
Maximum number of batches in the file -> 5
Number of events to be sent in batch -> 5
Time interval between submitting events -> 2