Description & Requirements
Essential Skills & Experience:
- Demonstrable experience in:
- Data Engineering Support-Production support on AWS stack – Spark, Glue, Redshift, Airflow, S3 and related ETL-DW data services.
- Strong AWS -ETL job process monitoring-tracking-production issue-fixing experience on data process and BI reporting.
- Understanding of Big Data , Hadoop.BO report, Power BI report
- Very good in SQL and database/data understanding
- Comfortable in production deployment ,job scheduling, batch monitoring ,usage tracking etc.
- Comfortable to work with production support rotational shifts (no night shift-but week-offs are rotational)
- Good understanding of tech stack , ETL,DW BI, BO -Qlik-Power BI , Cloud Platforms, specifically AWS, and components EMR, S3, SQS, Step function Lambda, Java.
Desirable Skills & Experience:
- Strong Production Support experience on AWS Cloud on data services support.
- An understanding of the concepts and strategies of a Data Lake in the Cloud.
- Knowledge in multiple programming languages including Spark,Java, Scala, Python and Shell Scripting.
- Experience of building unit tests, integration tests, system tests and acceptance tests.
- Experience in data modelling.
- Experience of ETL techniques and tools.
Experience : 7+ years (with minimum 5 years Production support AWS data Engg hands on experience)
- Working knowledge of the SDLC.
- Should be able to work closely within an onshore and offshore model.
- Being part of an Agile delivery team (i.e. Scrum/Jira).
Strong communication and inter-personal skills