Solutionunvalidated
best to use the final stage of any query to coalesce the files to a small number of larger ones — For anyone curious about ORC/Parquet IO in cloud. Outcome: aim for 256MB or more per file.
e367febe-833a-460a-aded-d2e5ccba3b46
best to use the final stage of any query to coalesce the files to a small number of larger ones — For anyone curious about ORC/Parquet IO in cloud. Outcome: aim for 256MB or more per file.