Data Engineer (Elasticsearch + Datawarehousing)
Core
Design and build scalable data solutions using Elasticsearch, data warehouses, and data lakes to create unified datasets for analytics and business use cases.
Role type
Senior IC Data Engineer (Elasticsearch + Datawarehousing)
Builds
High-performance, secure, and maintainable data infrastructure including pipelines, indexes, and backend components.
Domain
Data Engineering, Cloud Platforms, Distributed Processing
Required skills
Elasticsearch, Python, Data Warehousing, Data Lakehouse, Relational Databases (MySQL/PostgreSQL), NoSQL (MongoDB), Cloud Ecosystems (AWS/Azure/GCP), Git, Linux/Shell Scripting
Preferred skills
Java, Flask, Databricks, Spark/PySpark, Scikit-learn, OpenCV, Redis, ELK stack, Distributed task queues
Technologies
Elasticsearch, Python, MySQL, PostgreSQL, MongoDB, Flask, Databricks, Pandas, Spark, PySpark, Scikit-learn, OpenCV, Java, Redis, AWS, Azure, GCP, Git, Linux
Responsibilities
Design and optimize Elasticsearch clusters for high-performance querying and indexing; Build and manage efficient data storage solutions including warehouses and lakes; Develop data pipelines and transformation processes for accuracy and reliability; Integrate structured and unstructured data from multiple sources; Develop backend components, APIs, and automation scripts; Conduct unit and integration testing to validate functionality and performance.
Seniority
Mid-Senior, hands-on IC