Report this job

---

What is the problem? *

Incorrect company
Incorrect location
Job is expired
Job may be a scam
Other

Role: PySpark developer

Location: Philadelphia, PA

Client: TCS

Skills:

Ability to design, build and unit test the application in Spark/Pyspark.

In-depth knowledge of Hadoop, Spark, and similar frameworks.

Ability to understand existing ETL & logic to convert into Spark/PySpark/ Spark SQL.

Knowledge of Unix shell scripting, RDBMS, Hive, HDFS File System, HDFS File Types, HDFS compression codec.

Experience in processing large amounts of structured and unstructured data, including integrating data from multiple sources.