I have a pyspark script which will process the data for single table in spark submit mode in aws emr, now i want to process for multiple table in aws emr, so I need help.
hi, i have good experience of spark hadoop and emr clusters and can help to reuse code for multiple tables using scripting and python code. please initiate discussion to help me understand the scenario.
I am a leading developer in the field of creating projects in python and python / Django in one of the best it companies in the world. Guaranteed every project that I completed with high quality is supported by me for free all the time of its continued existence.
I am 8 years experienced bigdata/spark developer currently working on pyspark developments and implementation. I worked on various migration projects from SQL/Teradata to pyspark implementation.
Hi,
I have worked in Big Data for 7.5 years . I have worked in Pyspark,spark scala,hive ,hbase. I have worked in cloud AWS , hortonworks,cloudera,Mapr.
Thanks,
Prateek