RootCauseunvalidated
the tasks with no data will not create the files — Let's say I a pyspark dataframe having 20 partitions, out of that only 4 has data in it and 16 are empty. Outcome: 4 files will be created.
da4ff718-84f9-4c11-96c6-0169191a5074
the tasks with no data will not create the files — Let's say I a pyspark dataframe having 20 partitions, out of that only 4 has data in it and 16 are empty. Outcome: 4 files will be created.