Blackpool, Leeds, Newcastle-upon-Tyne, Sheffield
About the job
A fantastic opportunity to work within the DWP’s data engineering community, developing modern data products to meet a wide variety of customer needs. As DWP embarks on a modernisation program we are looking for bright, adaptable data engineers to develop modern data pipelines using a variety of technology and platforms. This is a great opportunity to develop your career, and help the DWP move to become a data centric organisation.
DWP take great pride in enabling our people to grow as professionals, having access to a variety of training materials (Classroom, online platforms, self-paced), we actively encourage a culture of learning, carving out time in each sprint for self-development. This combined with communities of practice to enable sharing of knowledge ensures our people have the support and tools to develop and help DWP meet its strategic goals.
You will have the opportunity to work in agile teams, analysing, designing and developing data products across a range of business areas. You will be utilising multi cloud platforms, modern software deployment methods, to deliver business value that has real world impact on the most vulnerable citizens.
You will join the Integrated Risk and Intelligence Service (IRIS), which is a collaboration between DWP Digital, Counter Fraud, Compliance and Debt (CFCD) and Cyber Resilience Centre (CRC).
IRIS is central to the DWP fraud and error strategy, and is radically transforming how the welfare system and those that use it are protected.
As a Data Engineer you are responsible for the development and maintenance activities for the delivery of data products and services to meet customer needs to agreed timescales.
You will work within the overall product development Lifecycle Processes within Data Engineering; learning about the agreed Data Architecture and Data Engineering principles and standards to ensure developed systems are fit for purpose, and play an active role in code development activities for delivery of data products, including:
•Data engineer responsibility for developing innovative data solutions using Cloud platforms & open source tooling.
•Developing & maintaining data pipelines, ensuring data engineering best practice & standards.
•Design of ETL/ELT processes, including; data staging, loading & archiving, data modelling techniques, data transformation & integration, error handling etc.
•Maintaining appropriate storage (RDBMS, NoSQL, Big data, Cloud storage), performance tuning & troubleshooting issues as required.
•Responsible for developing, testing, version control & deployment of code.
Your responsibilities will include but are not restricted to, the following:
•As a Data Engineer you are responsible for the development and maintenance activities for the delivery of data products and services to meet customer needs to agreed timescales.
•Develop automated data pipelines for structured and unstructured data.
•Accountable for translating user requirements into effective, robust ETL/ELT solutions in line with build standards and ensure code is production ready.
•Rapid prototyping and productionised product development.
•Responsible for delivering data processing pipelines in a cloud or on premise environment.
•Responsible for creating and maintaining data pipelines using batch, messaging and/or streaming technology.
•As a Data Engineer you support continuous improvement of standards and provide leadership to develop Associate Data Engineers, providing technical guidance alongside other data engineering functions for customers.
The ideal candidate for this role will be able to demonstrate the following essential criteria:
•Designs, develops. codes, tests, corrects and documents simple programs or scripts under the direction of others.
•Understands core technical concepts related to their role and is able to apply them.
•Aware of the need to translate technical concepts into non-technical language and understands what communication is required to internal and external stakeholders.
•Technical Specialisms – Programming Languages – Experience in one or more programming languages eg: SQL, HIVE SQL, Spark SQL, Python, Shell / BASH.
•Experience of developing automated ETL / ELT pipelines (error handling, re-start, data quality, telemetry).
•Experience of version control and modern deployment approaches.
We’ll assess you against these behaviours during the selection process:
We’ll assess you against these technical skills during the selection process:
• Learning and development tailored to your role
• An environment with flexible working options
• A culture encouraging inclusion and diversity
• An employer pension contribution of up to 27%
• A generous annual leave allowance
HEO Salary for this role is from £31,989 to £34,285.
Where the maximum salary is offered, a Digital Allowance of up to £3,595 per annum is available for exceptional candidates, based on our assessment of your skills and experience.
SEO Salary for this role is from £35,310 to £40,666.
Where the maximum salary is offered, a Digital Allowance of up to £1,016 per annum is available for exceptional candidates, based on our assessment of your skills and experience.
Our offer to successful candidates will be based on an assessment of your skills and experience as demonstrated at interview.
Existing Civil Servants who secure a new role on lateral transfer should maintain their current salary.
Existing Civil Servants who gain promotion may move to the bottom of the next grade pay scale or 10% increase in salary whichever would be the greater.
This role can be based out of either (Blackpool, Newcastle, Leeds or Sheffield) corporate hub locations.
The Department is committed to promoting flexible ways of working, whilst enabling the business to operate at maximum efficiency and will expect colleagues to work from a blend of locations, including some time working at home, as required. The corporate hub location will be the designated place of work and any remote or home working arrangement does not constitute a change to your designated place of work or contractual Terms and Conditions. Please be aware that this role can only be worked in the UK and not overseas.
Things you need to know
Successful candidates must pass a disclosure and barring security check.Successful candidates must meet the security requirements before they can be appointed. The level of security needed is .
.People working with government assets must complete checks.
Apply For This Job
You can apply for this job externally via the button below.Apply for this job externally