Position Overview & Specifications
Job Description:
• Develop and maintain data platforms using Python, Spark, PySpark • Handling migration to PySpark on AWS • Work with AWS and Big Data, design and implement data pipelines, and ensure data quality and integrity. • Collaborate with cross functional teams to understand data requirements and design solutions that meet business needs. • Implement and manage agents for monitoring, logging, and automation within AWS environments
• Develop and maintain data platforms using Python, Spark, PySpark • Handling migration to PySpark on AWS • Work with AWS and Big Data, design and implement data pipelines, and ensure data quality and integrity. • Collaborate with cross functional teams to understand data requirements and design solutions that meet business needs. • Implement and manage agents for monitoring, logging, and automation within AWS environments