Find a nanny, babysitter or childminder — post your free profile at - opportunities through partnership log into your account
recruiter | candidate

« Return to Homepage


Data Engineer/Architect - Cloudera, AWS, PySpark (SC Cleared

Get jobs like this by email... (We will never pass your details to third parties)

Data Engineer/Architect - Cloudera, AWS, PySpark (SC Cleared) , PySpark, Python, Spark, Amazon Web Services, AWS, Cloudera, Hive, Impala SQL, ETL, Integration, Jenkins, GIT, Version Control, JIRA, Development Lifecycle, Data Management, SC Cleared, SC Clearance, Security Cleared, Security Clearance, Government, Newport.

Our client based in Newport are looking for a Data Engineer/Architect (SC cleared) to join an existing project team and to work with an established product backlog to delivery system capability to a BAU team (responsible for publication of new/improved trade and investment data).

With the UK due to leave the European Union in 2020, the focus on trade and investment statistics has never been higher. There is a need to develop and transition new and existing processing systems. Their platform is based on both PySpark by Cloudera and Amazon Web Services technology.

Key Skills/Experience:

  • Strong experience in development of relational database systems using the Cloudera stack (particularly PySpark, Hive and Impala SQL)
  • Ability to produce technical documentation to support development of production systems
  • Experience in the development of Extract Transform and Load (ETL) pipelines
  • Experience developing continuous integration solutions (particularly in Jenkins)
  • Experience in version control and software review using GIT
  • Proficient in use of Jira for work item management
  • Experience of working across the full development lifecycle
  • Awareness of good data security procedures and adherence to secure information management policies
  • Ability to work collaboratively with members in other technical roles, including Business Analysts and Methodologists
  • Experience of data management

Job reference:
Temporary or Contract
Immediate start
12 Months
Apply for this job
Send this job to your friend
If you have an account with us, log in now to pre-fill this form from your profile:
Apply Online
Are you a UK citizen or eligible to work in the UK?
Show calendar days
  (.doc, .docx, .pdf)
Would you like to upload your profile and CV to our website?
(Your contact details will only be shown to recruiters)

When you click on the Apply button above, you will be registered with and will receive daily Jobs by Email matching this job's criteria. We will send you an email including your password so that you can manage your account in the future. (If you already have an account, your current Jobs by Email settings will not be overwritten.)

Contact Details

Telephone Number 0161 924 3912

Our network » - the childcare, nursery and nanny job board   childcare, nursery
and nanny jobs - the social work, care and social housing job board   social work, care
and social housing jobs - the education, training and teaching job board   education, training
and teaching jobs - the medical, nursing and healthcare job board   medical, nursing
and healthcare jobs
The Supply Curve - jobs for economists
for economist jobs, econometrician jobs, and statistician jobs - nannies, babysitters, childminders babysitters, childminders and nannies
top of page | services | terms & conditions | privacy statement | ©