Experience in PythonScala. Strong experience in working with Apache Spark in leveraging SparkSQL, Batch and Streaming processes. Strong experience in Big data Hadoop framework and architecture. Experience in Distributed computing storage systems like HDFS, S3 Should have strong experience in operating Unix environments. Should have strong experience working with Github, Jenkins, Maven, shell and python scripting. Good experience in AWS knowledge, hands on experience in deploying and enhancing the infrastructure. Should have worked in any of the Agile methodologies before. Strong troubleshooting, problem solving and analytical skills. Ability to coordinate with multiple teams in a highly available platform supported by multiple APIs and Applications. Strong written and communication skills. Required Skills 7+ years Python, strong PySpark Donrsquot want someone with heavy data science, really wants to work through data platforms Need to have In depth python based data engineering, has taken on batch jobs for Spark, experience with AWS