Pasig City, Philippines

Lead Data Engineer

Full-time / part-time
Contract
Level
Mid-Senior Level
Department
Technology
Address
Ortigas Center
Pasig City
Philippines

Job description

The data engineer will be the key interface in operationalizing data and analytics on behalf of the business unit(s) and organizational outcomes. This role will require both creative and collaborative working with IT and the wider business. It will involve evangelizing effective data management practices and promoting a better understanding of data and analytics. The data engineer will also be tasked with working with key business stakeholders, IT experts, and subject-matter experts to plan and deliver optimal analytics and data science solutions.

Additionally, data engineers will also be expected to collaborate with data scientists, data analysts, and other data consumers and work on the models and algorithms developed by them in order to optimize them for data quality, security, and governance and put them into production leading to potentially large productivity gains.

Responsibilities:

  • Build Data pipelines
  • Collaborate across departments
  • Educate and train
  • Participate in ensuring compliance and governance during data use
  • Become a data and analytics evangelist
  • Drive Automation through effective metadata management.

This will include (but not be limited to):

  • Learning and using modern data preparation, integration, and AI-enabled metadata management tools and techniques.
  • Tracking data consumption patterns.
  • Performing intelligent sampling and caching.
  • Monitoring schema changes.
  • Recommending — or sometimes even automating — existing and future integration flows

 

Qualifications

  • An advanced degree in computer science (MS), statistics, applied mathematics (Ph.D.), information science (MIS), data management, information systems, information science (postgraduation diploma or related), or a related quantitative field [or equivalent work experience] is preferred.
  • At least 10 years or more of work experience in data management disciplines including data integration, data, and analytical modeling, creating graph-based schemas, optimization and data quality, and/or other areas directly relevant to data engineering responsibilities and tasks.
  • At least 8 years of experience working in cross-functional teams and collaborating with business stakeholders in support of a departmental and/or multi-departmental data management and analytics initiative.
  • Demonstrated success in working with large, heterogeneous datasets to extract business value using popular data preparation tools such as SSIS, Altryx, Azure Data Flow, Azure Data Factory, Trifacta, Paxata, Unifi, Denodo, others to reduce or even automate parts of the tedious data preparation tasks.
  • Strong experience with popular database programming languages including SQL, PL/SQL, others for relational databases, and certifications on upcoming NoSQL/Hadoop oriented databases like MongoDB, Cassandra, and others for nonrelational databases.
  • Strong experience with advanced analytics tools for Object-oriented/object function scripting using languages such as R, Python, Java, C++, Scala, and others. 
  • Strong experience in working with both open-source and commercial message queuing technologies such as Kafka, JMS, Azure Service Bus, Amazon Simple queuing Service, and others, stream data integration technologies such as Apache Nifi, Apache Beam, Apache Kafka Streams, Amazon Kinesis, and stream analytics technologies such as Apache Kafka KSQL Apache Spark Streaming Apache Samza, others.
  • Demonstrated ability to work across multiple deployment environments including cloud, on-premises, and hybrid], multiple operating systems, and through containerization techniques such as Docker, Kubernetes, AWS Elastic Container Service, and others.
  • Adept in agile methodologies and capable of applying DevOps and increasingly DataOps principles to data pipelines to improve the communication, integration, reuse, and automation of data flows between data managers and consumers across an organization.
     

Additional information

At IQ-EQ we want you to reach your full potential. We offer an inclusive and diverse environment to support your career aspirations. With a strong emphasis on continuous learning and a holistic approach to your professional and personal development. We also offer opportunities across our service lines and our international network of offices.

Company description

IQ-EQ is a leading Investor Services group which combines global expertise with an unwavering focus on client service delivery. We support fund managers, global companies, family offices and private clients operating worldwide.

Apply now

To apply, please enter your details into the below form. If you experience any issues with this form, please click here to apply via our provider SmartRecruiters directly.

Personal
CV
Allowed document formats are PDF, Word, RTF, JPG or PNG. Maximum file size 2MB.
Current
Do you have the right to work in the location of the vacancy?

If you haven't uploaded a CV, please detail your experience and education.

Experience
Education