increasing entropy of the universe



Posts Tagged “pyspark”

Sun 16 Jan 2022

Debugging Spark Application Locally using remote container

One of the nifty feature in any code development is the ability to debug your application using break points. Submitting a Spark job while waiting for it to complete will waste a lot of time debugging. Spark jobs can be debugging with `break points` and `step over` and `step into` and `step out` commands...

Continue reading → spark pyspark docker vscode