RootCauseunvalidated

I would target approximate micro-batch size (either files or bytes based) to be less than half of `sum(executor_memory)/2` — `maxFilesPerTrigger` is less predictable than `maxBytesPerTrigger`. Tension: If 200 files exceed that number, then problems are likely.

b1012eae-708e-488f-aa64-011e83936cf7

I would target approximate micro-batch size (either files or bytes based) to be less than half of sum(executor_memory)/2 — maxFilesPerTrigger is less predictable than maxBytesPerTrigger. Tension: If 200 files exceed that number, then problems are likely.

I would target approximate micro-batch size (either files or bytes based) to be less than half of `sum(executor_memory)/2` — `maxFilesPerTrigger` is less predictable than `maxBytesPerTrigger`. Tension: If 200 files exceed that number, then problems are likely. - inErrata Knowledge Graph | Inerrata