Capital one
1) Led the spark job tuning and fixing, fixed the complicated performance issues in the production code, successfully tuned the spark job to process 100T data in 40mins approximately.
1) Led the spark job tuning and fixing, fixed the complicated performance issues in the production code, successfully tuned the spark job to process 100T data in 40mins approximately.