Big Data Engineering
Consultant Thobie Gerinardi
Date posted 01 October 2018Jl. Jend Sudirman Kav. 29-31 Jakarta 12920 Robert Walters Indonesia
An attractive Big Data Engineer job based in Jakarta has just become available in a leading financial technology company in Jakarta, reporting to Lead Solution Architect.
About the Big Data Engineer role:
In this role, you will design, assess, and build innovative solutions based on big data analytic platform to solve existing business problems.
- Identify and gather current gap between big data implementation and business requirements
- Design solutions and product to existing business issues using big data platform
- Exploration of new technologies to improve existing solution stack
- Perform technical assessment of big data platform technologies to determine solution best practice
- Verify technical architecture for big data solutions with architect team
- Internal coordination with Lead Solution Architect for design and overall architect alignment
- Coordinate with Data engineer team for data ingestion and daily operations
- Coordinate with BI team for business requirements
- Coordinate with Data Modeler team for data model and design
- Coordinate with Tech Team for data source and infrastructure
- Coordinate with PMO team for project organisation, and data governance and documentation
- Escalate problem related to the respective system principal
- Coordinate on the data ingestion method with partners, and data source understanding
- Hands-on experience as an individual contributor in Design, Development, Testing and Deployment of Big Data technologies-based applications
- Experienced in Big data platform tools, such as Hadoop, Map Reduce, Spark, Spark Streaming, Kafka, etc.
- Experience on NoSQL databases like MongoDB, Cassandra, Arango, HBase, etc.
- Experience with Linux OS environment (shell script, AWK, SED)
- Experience in programming skills with Java, Scala, Python programming languages to build and run distributed applications
- Intermediate RDBMS Skill, able to write SQL query with complex relation on top of big RDMS (100+ table)
- Preferable to have knowledge in ETL process and tools such as Informatica
- Preferable to have knowledge of in-memory database and GPU technology such as Kinetica
This firm is recognised as one of Indonesia next unicorn. If you have a successful in data engineering projects, this is a perfect opportunity for you. Apply now or call me to discuss this exciting opportunity.