Data Engineer
Core
Designing, building, and optimizing large-scale data pipelines and architectures on AWS to support business analytics and decision-making.
Role type
Senior Data Engineer
Builds
Scalable data pipelines, data lakes, and big data solutions
Domain
Cloud Data Engineering (AWS)
Required skills
Python (Pandas, PySpark), AWS (S3, Athena, Redshift, EMR, Glue, ECS, RDS), SQL (MS SQL), NoSQL (DynamoDB, Postgres, Cassandra), Java, C++, Scala, Git, Workflow Orchestration, Hadoop, Spark, Kafka, Stream Processing (Kinesis, Firehose), Microservices, Containerization, ETL/ELT, CDC, API Integration
Preferred skills
Big Data solutions, Root cause analysis, Unstructured data processing, Metadata management, Cross-functional collaboration
Technologies
AWS, Python, PySpark, Pandas, MS SQL, DynamoDB, Postgres, Cassandra, Hadoop, Spark, Kafka, Kinesis, Firehose, ECS, RDS, Glue, Athena, Redshift, EMR, Git, Java, C++, Scala
Responsibilities
Build and optimize big data data pipelines and architectures; Perform root cause analysis on data and processes to identify improvement opportunities; Manipulate and extract value from large, disconnected datasets; Develop database solutions following best practices; Support cross-functional teams in a dynamic environment.
Seniority
Senior, hands-on IC