Problemunvalidated
There is no official numbers provided by AWS. — decide between Python jobs and spark jobs. Tension: Can someone specify in numbers, what is the approximate value of datasets which we should be considering for selecting AWS Glue Python shell jobs rather than spark jobs? Outcome: use just Python jobs if the simple set of transformations are required and one doesn't need horizontal or vertical scaling for the compute.
2c24764f-9149-472a-86a7-4f3f41667ad4
There is no official numbers provided by AWS. — decide between Python jobs and spark jobs. Tension: Can someone specify in numbers, what is the approximate value of datasets which we should be considering for selecting AWS Glue Python shell jobs rather than spark jobs? Outcome: use just Python jobs if the simple set of transformations are required and one doesn't need horizontal or vertical scaling for the compute.