London, United Kingdom

Senior Data Engineer

Full-time / part-time
Full-time
Level
Mid-Senior Level
Department
Technology
Address
3 More London Riverside
London
SE1 2RE
United Kingdom

Job description

Due to substantial growth on a global scale we have a newly created opportunity seeking a an experienced Data Engineer to be part of our cutting edge Data & Analytics team. You will play a pivotal role in building and operationalizing the minimally inclusive data necessary for the enterprise data and analytics initiatives following industry standard practices and tools. 

You will work closely with key business stakeholders, IT specialists and subject-matter experts to plan and deliver optimal analytics and data science solutions.

Key responsibilities include:

  • Build data pipelines
  • Drive Automation through effective metadata management 

This will include (but not be limited to):

  • Learning and using modern data preparation, integration and AI-enabled metadata management tools and techniques.
  • Tracking data consumption patterns.
  • Performing intelligent sampling and caching.
  • Monitoring schema changes.
  • Recommending or sometimes even automating existing and future integration flows.
  • Collaborate across departments
  • Educate and train other team members
  • Participate in ensuring compliance and governance during data use
  • Become a Data and Analytics Evangelist

Qualifications

  • An advanced degree in computer science (MS), statistics, applied mathematics
  • (Ph.D.), information science (MIS), data management, information systems, information science (post graduation diploma or related) or a related quantitative field [or equivalent work experience] 
  • The ideal candidate will have a combination of IT skills, data governance skills, and analytics skills with a technical or computer science degree.

Experience in several of the following areas will be highly desirable: 

  • Experience with various Data Management architectures i.e. Data Warehouse, Data Lake, Data Hub and supporting processes such as Data Integration, Governance, Metadata Management
  • Ability to design, build and manage data pipelines for data structures encompassing data transformation, data models, schemas, metadata and workload management.
  • Experience in working with large, heterogeneous datasets in building and optimizing data pipelines, pipeline architectures and integrated datasets using traditional data integration technologies. These should include ETL/ELT, data replication/CDC, message-oriented data movement, Data API design and access and upcoming data ingestion and integration technologies such as stream data integration, CEP and data virtualization.
  • Demonstrated success in working with large, heterogeneous datasets to extract business value using popular data preparation tools such as SSIS, Altryx, Azure Data Flow, Azure Data Factory, Trifacta, Paxata, Unifi, Denodo, others to reduce or even automate parts of the tedious data preparation tasks.
  • Experience with popular database programming languages including SQL, PL/SQL, others for relational databases and certifications on upcoming NoSQL/Hadoop oriented databases like MongoDB, Cassandra, others for nonrelational databases.
  • Experience with advanced analytics tools for Object-oriented/object function scripting using languages such as R, Python, Java, C++, Scala, and others.
  • Experience working with both open-source and commercial message queuing technologies such as Kafka, JMS, Azure Service Bus, Amazon Simple queuing Service, and others, stream data integration technologies such as Apache Nifi, Apache Beam, Apache Kafka Streams, Amazon Kinesis, and stream analytics technologies such as Apache Kafka KSQL Apache Spark Streaming Apache Samza, others.

Additional information

At IQ-EQ we want you to reach your full potential. We offer an inclusive and diverse environment to support your career aspirations. With a strong emphasis on continuous learning and a holistic approach to your professional and personal development. We also offer opportunities across our service lines and our international network of offices.

Interested? Please apply today for immediate consideration.

Company description

Do you want to be part of a Global Private Equity Administrator who provides outsourced Administration services for PE, Real Estate, Depository and Compliance with Assets under Administration in the excess of $650Billion? If so, please read on!

With offices across 23 jurisdictions including New York, London, Paris, Amsterdam, Cayman, BVI, Belfast, Dublin, Guernsey, Jersey, Luxembourg, Netherlands, Cyprus, Mauritius, Singapore, Hong Kong and Manila our growth journey has only just begun. 

Apply now

To apply, please enter your details into the below form. If you experience any issues with this form, please click here to apply via our provider SmartRecruiters directly.

Personal
CV
Allowed document formats are PDF, Word, RTF, JPG or PNG. Maximum file size 2MB.
Current
Do you have the right to work in the location of the vacancy?

If you haven't uploaded a CV, please detail your experience and education.

Experience
Education