Azure Data Engineer

Azure Data Engineer
  • £60,000 - £80,000 per Year
    YEAR
  • Permanent
  • London, England, UK EC3A 4AF London London GBR EC3A4AF
Job Ref: 50209795
Sector: Data and Analytics
Date Added: 23 September 2020

Azure Data Engineer - Azure / Databricks / Datalake / Data Pipelining / Python - £60,000 - £80,000 + Benefits

I am currently working in partnership with a global leading consultancy that is on the look out for a high performing Azure Data Engineer to develop, maintain and support all tools that will allow the business to achieve its ambitious growth targets in 2020 and beyond.

You will be working on greenfield projects where you will work alongside other dedicated Azure/Microsoft BI Engineers/Developers and be part of industry leading projects that use cutting edge technology. The organisation are a Microsoft Gold partner and will enable you to benefit from access to the latest software soon as it becomes available, e.g. Visual Studio 2019.

KEY OUTCOMES

  • Design, develop and maintain scalable data pipelines
  • Develop data ingestion and integrations (REST, SOAP, SFTP, etc.) processes
  • Actively engage in technology discovery and implementation in Azure to build solutions for future systems
  • Develop high performance scripts in SQL/Python/etc. to achieve objectives of enterprise data, BI and analytics need.
  • Incorporate standards and best practices into engineering solutions
  • Solve complex data issues around data integration, unusable data elements, unstructured data sets, and other data processing incidents
  • Works with system owners to resolve source data issues and refine transformation rules
  • Partner with enterprise teams, data scientist, architects to define requirements and solution
  • CAPABILITIES
  • Experience deploying modern data solutions leveraging components like Azure functions, Azure Data Factory, Data Flows, Azure Data Lake, Azure SQL, Azure Synapse, Streaming Analytics and more.
  • Experience with one or more languages: Python & Pyspark, T-SQL, SparkR & R, Scala.
  • Experience with agile/scrum methodologies
  • Build processes supporting data transformation, data structures, metadata, dependency and workload management.
  • Experience with data pipelining into Azure.
  • Experience with code deployment in Azure Databricks environment.
  • Familiarity with DevOps tool like Azure DevOps
  • Experience working with Azure data integration techniques & self-service data preparation.
  • Assist business users on functional and data requirements to enhance data models and pipelines.
  • Experience in requirements analysis, design and prototyping.
  • TECHNICAL STACK
  • Developing, deploying, and testing data pipelines in Azure Data Factory.
  • Programming with SQL, Python, Scala or R.
  • Data engineering with Spark, Databricks, SSIS or other data integration tool.
  • Azure SQL, Postgres, Monet and other Cloud Data Services.
  • Working experience with SQL Server, data warehousing and data analytics projects.

Azure Data Engineer - Azure / Databricks / Datalake / Data Pipelining / Python - £60,000 - £80,000 + Benefits

OneZeero is acting as an Employment Agency in relation to this vacancy.

Onezeero
23/10/2020 08:35:41
GBP 60000 60000
Contact Consultant:
Max Mosley

Submitting application, please wait..

Share location?

Do you want to share your location for better user experience ?