Data Lake Engineer Expert

An exciting opportunity awaits for a Data Lake Engineer Expert to join a forward-thinking organisation based in South Tangerang. This role is perfect for someone who thrives on transforming vast and complex datasets into valuable resources that empower analytics, data science, and AI/ML initiatives.

Data Lake Engineer Expert

Salary: Competitive and based on experience

Location: South Tangerang

Keywords: data lake, data engineering, ETL, ELT, big data, object storage, Hadoop, Cloudera, Spark, Kafka, Airflow, Dremio, Python, R, Docker, Kubernetes

The company offers a supportive environment where your expertise will be valued, and you will have the chance to work with cutting-edge technologies in a collaborative team setting. With flexible working opportunities and a commitment to professional development, this position provides the ideal platform for you to further hone your skills while making a significant impact on the organisation’s data-driven journey.

• Work with an inclusive and knowledgeable team dedicated to advancing data capabilities across the business, ensuring your contributions are recognised and celebrated.
• Enjoy flexible working opportunities in a modern office located in Serpong, South Tangerang, designed to support both collaboration and individual focus.
• Benefit from ongoing training opportunities and exposure to the latest tools and methodologies in big data engineering, supporting your continuous professional growth.

What you'll do:

As a Data Lake Engineer Expert, you will play a pivotal role in shaping how information flows through the organisation. Your day-to-day activities will involve extracting raw information from various sources before transforming it into accessible formats that power advanced analytics and machine learning projects. You will be responsible for building resilient storage solutions using state-of-the-art tools while ensuring that every aspect of the system operates smoothly. By collaborating with other teams and maintaining rigorous standards for data quality, you will help unlock actionable insights that drive strategic decisions. Your ability to automate workflows and document procedures will be essential in fostering an environment of shared knowledge and operational excellence.

• Extract data from diverse primary and secondary sources, then reorganise it into formats optimised for downstream processes such as analytics, data science, or artificial intelligence and machine learning applications.
• Oversee daily operations related to collecting, storing, processing, and analysing large-scale datasets by constructing robust data storage solutions and developing efficient data-access tools using a data lake approach.
• Monitor the overall performance and stability of the entire system infrastructure, proactively identifying issues to maintain seamless operation of all data pipelines.
• Implement comprehensive warehouse cleansing routines to ensure high-quality, reliable datasets are always available for business needs.
• Collaborate closely with cross-functional teams including analytics, IT, and business stakeholders to understand requirements and deliver tailored data solutions.
• Design and maintain scalable architectures that can handle ever-increasing volumes of structured and unstructured data efficiently.
• Develop automated workflows for ETL (Extract, Transform, Load) and ELT (Extract, Load, Transform) processes to streamline data integration from multiple sources.
• Continuously evaluate new technologies and best practices in big data engineering to enhance existing systems and recommend improvements.
• Document all processes thoroughly to ensure knowledge sharing within the team and facilitate smooth onboarding of new members.
• Support troubleshooting efforts by providing expert guidance on technical challenges related to data ingestion, transformation, storage, or access.

What you bring:

To excel as a Data Lake Engineer Expert in this organisation, you will bring extensive hands-on experience architecting scalable solutions that manage massive volumes of structured and unstructured information. Your background should include deep familiarity with both traditional ETL/ELT processes as well as modern cloud-native technologies. You will possess not only technical proficiency but also strong communication skills that allow you to work effectively within multidisciplinary teams. A passion for leveraging technology to solve real-world problems—combined with meticulous attention to detail—will set you apart. Your willingness to share knowledge through documentation ensures everyone benefits from your expertise while your adaptability allows you to thrive amidst evolving project requirements.

• A minimum of 7-12 years’ proven experience implementing large-scale data lake solutions within complex organisational environments is required for this role.
• Demonstrated expertise in designing and setting up end-to-end data lake architecture, including topology planning and infrastructure deployment.
• Hands-on experience building ETL (Extract, Transform, Load) as well as ELT (Extract, Load, Transform) pipelines using industry-standard tools is essential.
• Proficiency with key technologies such as Object Storage platforms (e.g., S3), Hadoop ecosystems (including Cloudera), Spark processing frameworks, Kafka messaging systems, Airflow orchestration tools, Dremio query engines, Python programming language, R statistical computing environment, Docker containerisation technology, Kubernetes orchestration platform, Iceberg/HUDI table formats is highly desirable.
• A genuine passion for working with large datasets combined with strong problem-solving abilities when addressing complex technical challenges is expected.
• Excellent interpersonal skills enabling effective collaboration with colleagues from diverse backgrounds are important for success in this position.
• Experience managing system performance monitoring tasks as well as implementing robust cleansing routines for warehouses is advantageous.
• Familiarity with best practices around documentation and process standardisation within big data environments will be beneficial.
• A commitment to continuous learning by staying updated on emerging trends in big data engineering is encouraged.

What sets this company apart:

This organisation stands out due to its unwavering commitment to fostering an inclusive workplace where every team member’s voice matters. Employees benefit from flexible working arrangements that promote work-life balance while enjoying access to state-of-the-art facilities in Serpong. The company invests heavily in professional development through regular training sessions focused on emerging technologies within the big data landscape. Collaboration is at the heart of their culture; you’ll find yourself surrounded by supportive colleagues who are eager to share ideas and celebrate collective achievements. By joining this team, you become part of a network dedicated not only to technological advancement but also personal growth—ensuring your career flourishes alongside the company’s continued success.

What's next:

If you are ready to take your expertise in big data engineering to new heights within a supportive environment that values your contributions, this is your moment!

Due to the high volume of applications we are experiencing, our team will only be in touch with you if your application is shortlisted.