Position Overview & Specifications
Title: Data Engineer IILocation: Remote Duration: 3+ Months (Possible Extension)No C2C, Only W2
Must have:AWS experience with kubernetes operating knowledge.Working with data pipelines and experience with Spark and FlinkExcellent communication skillsNice to have:Programming experience in Scala, Java, and PythonKnowledge on Machine Learning (Client)
Job description:The client seeks to improve products by using data as the voice of our customers. We are looking for engineers to collaborate with users of our infrastructure and architect new pipelines to improve the user onboarding experience. As part of this group, you will work with petabytes of data daily using diverse technologies like Spark, Flink, Kafka, Hadoop, and others. You will be expected to effectively partner with upstream engineering teams and downstream analytical & product consumers. Experience:10+ YOE, with 5+ years of experience designing and implementing batch or real-time data pipelinesHands-on experience on batch processing (Spark, Presto, Hive) or streaming (Flink, Beam, Spark Streaming)Experience in AWS and knowledge in its ecosystem. Experience in scaling and operating kubernetes.Excellent communication skills is a must, experience working with customers directly to explain how they would use the infrastructure to build complex data pipelinesProven ability to work in an agile environment, flexible to adapt to changesAble to work independently, research on possible solutions to unblock customerProgramming experience in Scala, Java, or PythonFast learner and experience with other common big data open source technologies is a big plusKnowledge on machine learning (Client) is a nice-to-have
Must have:AWS experience with kubernetes operating knowledge.Working with data pipelines and experience with Spark and FlinkExcellent communication skillsNice to have:Programming experience in Scala, Java, and PythonKnowledge on Machine Learning (Client)
Job description:The client seeks to improve products by using data as the voice of our customers. We are looking for engineers to collaborate with users of our infrastructure and architect new pipelines to improve the user onboarding experience. As part of this group, you will work with petabytes of data daily using diverse technologies like Spark, Flink, Kafka, Hadoop, and others. You will be expected to effectively partner with upstream engineering teams and downstream analytical & product consumers. Experience:10+ YOE, with 5+ years of experience designing and implementing batch or real-time data pipelinesHands-on experience on batch processing (Spark, Presto, Hive) or streaming (Flink, Beam, Spark Streaming)Experience in AWS and knowledge in its ecosystem. Experience in scaling and operating kubernetes.Excellent communication skills is a must, experience working with customers directly to explain how they would use the infrastructure to build complex data pipelinesProven ability to work in an agile environment, flexible to adapt to changesAble to work independently, research on possible solutions to unblock customerProgramming experience in Scala, Java, or PythonFast learner and experience with other common big data open source technologies is a big plusKnowledge on machine learning (Client) is a nice-to-have