Find a Job
356 available
Back to all search results

Data Engineering Lead

Ref: 78187

  • 90,000-100,000
  • 02 Nov 2022
  • Limerick
  • Permanent

Salary: €90,000-€105,000

10% bonus, full health/dental/vision, pension and more

1 day a month in the office, the rest from home

 

JOB RESPONSIBILITIES

As a Lead Data engineer, you will need to work with data engineers, data scientists and ML engineers to deliver on quality software for our business partners in collaboration with product and business partners. You will use various methods to transform raw data into useful data systems.

Tasks and Qualifications include:

  • Experience in defining project solution approach leveraging agile methodologies working with Product Owners and Scrum Masters.
  • Develop highly scalable and extensible Big Data platforms which enable collection, storage, modelling, and analysis of massive data sets including those from streaming data
  • Analyse, develop, and maintain data pipelines from internal and external sources
  • Developing, maintaining datasets, improving data quality and efficiency
  • Apply and build automated test-driven development, continuous integration/delivery, and version control best practices

QUALIFICATION & EXPERIENCE

Education and Experience:

  • Bachelor of Science in Computer Science, Engineering, or MIS, or equivalent experience – preferred
  • Proven experience as a Data Engineer or similar role with some leadership/mentorship experience
  • Hands-on experience developing data systems and data architecture

Must Have Technical Skills

  • Strong in Spark, Python/R, API, NoSQL, BigData, Hadoop, Shell scripting,
  • Very good SQL, Performance tuning, Query Optimisation
  • Good working experience in Linux Environment

Good to have Technical Skills

  • RDBMS, Data Warehousing experience
  • AWS, GCP or Any Cloud experience
  • Experience with cloud gateways, queues, messaging hubs
  • Big Data Analytic frameworks and query tools
  • Data Warehouse and DataMart design and implementation
  • NoSQL environments such as MongoDB, Cassandra
  • Data modelling of relational and dimensional databases
  • Architect/design data management processes and capabilities (e.g governance, archiving, metadata, master data mgmt., data modelling, data quality)
  • A nice to have would be knowledge of ML / AI environments and challenges – particularly as it relates to data management

Certifications

  • AWS or GCP certifications - preferred

Other qualifications

  • Familiarity with Jira is a plus

Domain and industry knowledge:

  • Ideal candidate will have extensive experience with the creation and delivery of advanced analytics solutions for healthcare payers or insurance companies, including anomaly detection, provider optimisation, studies of sources of fraud, waste, and abuse, and analysis of clinical and economic outcomes of treatment and wellness programs involving medical, or pharmacy claims data, electronic medical record data, or other health data
  • Experience with healthcare providers is a plus

Contact

For a confidential and discreet conversation to understand more about this Technology job, please contact John Howe on +353 1 592 7868 or email