Apply for this vacancy

  Upload Your CV
Apply via LinkedIn
or call Sophie Newton on:
0191 620 0123
Interested in referring a friend? Click here
Location: Newcastle upon Tyne Tyne and Wear Newcastle upon Tyne NE12 8BX
Salary: £50000 - £60000
Sector: Data  
Type: Permanent
Posted: 10/23/2023
Data Engineer Ronald James Group 2024-01-23

This is an exciting opportunity for an Data Engineer to join a company who are constanty investing in new products & using technology to increase their market share! They are looking for someone to join their team who is enthusiastic about new ideas which they can’t wait to share with their team & bring to life. 

As a Data Engineer, you’ll focus on building and maintaining robust data pipelines within the AWS ecosystem, with a primary focus on the Delta Lakehouse Platform on Databricks.

Responsibilities:

  • Data Ingestion: Build and optimize data ingestion pipelines using AWS services such as Lambda, Kinesis, and Glue.

  • Data Transformation: Develop, maintain, and optimize transformation pipelines within our Delta Lake on Databricks.

  • Data Modelling: Design and implement efficient and reliable data models to store and retrieve data.

  • Collaboration: Work closely with data scientists, analysts, and stakeholders to understand data requirements and deliver optimal solutions.

  • Data Quality: Ensure the reliability, integrity, and timeliness of data by implementing best practices and quality checks.

  • Performance Optimization: Optimize queries and improve performance of data retrieval operations.

  • Technology Stewardship: Stay updated with the latest advancements in AWS, Databricks, and the data engineering field in general. Provide recommendations on the adoption of new tools and technologies.

Requirements:

  • AWS Services: Proficiency in AWS services like Lambda, Kinesis, and Glue.

  • Databricks & Delta Lake: Hands-on experience with Databricks and Delta Lakehouse architectures.

  • Programming: Proficient in Python, Scala, and SQL for data engineering tasks.

  • ETL Processes: Demonstrated expertise in designing, building, and maintaining ETL processes.

  • Data Modelling: Experience in logical and physical data modelling with large datasets.

  • Problem Solving: Strong analytical and problem-solving skills, with a focus on troubleshooting data issues.

Preferred Qualifications:

  • Certification in AWS and/or Databricks.

  • Experience in a similar role in online retail industry.

  • Knowledge of best practices in data governance and data security.

Benefits:

  • 22 days holiday rising to 25

  • Staff discounts & Friends and Family discounts

  • Cycle to work scheme and Tech Scheme

  • Breakfast and drinks provided

  • Charity day per annum supported

  • Summer and Christmas Parties

  • Street food days

  • Access to Perkbox portal

Apply now to find out more!!

Apply Now Chat on WhatsApp Chat on Messenger

 

Back to Jobs

</Follow Us>