Data Engineer
- Posted August 23, 2024
- £35000 - £55000 per annum
- Manchester
- Permanent
Job Title: Data Engineer
Location: Manchester (but mostly remote – just required onsite for training and team events)
Salary: £34,500 – £55,000 (depending on experience)
We are seeking a talented Data Engineer to join an innovative technology and data team. This is a hands-on technical role where you will be responsible for building technical data solutions for projects and persistent data products.
Key Responsibilities:
- Developing secure/high-quality data pipelines from various data sources.
- Ensuring data is cleansed/mapped/transformed/optimised for storage.
- Building data observability/quality into all data pipelines.
- Creating solutions for data lake storage/physical database models/reporting structures.
- Conducting unit testing/peer testing to ensure code quality.
- Maintaining effective documentation for transparency/understandability.
- Following coding standards/architectural principles.
- Mentoring/coaching junior data engineers.
- Developing BI solutions including data marts/semantic layers/visualisations.
Core Skills:
- Strong PySpark and SQL development skills.
- Experience with Azure Data Engineering.
- Ability to turn customer requests into actionable designs.
- Collaboration skills in an agile team environment.
Experience & Knowledge:
- 2-5 years of experience in designing and building end-to-end data solutions.
- Proficiency in SQL Server and/or Azure (Datafactory, Databricks).
- Experience with large, event-based datasets.
- Familiarity with testing techniques and tools.
- Excellent communication skills and a proactive approach.
- Understanding of the full data lifecycle and CI/CD practices.
- Experience working in an agile environment.