Data Engineering / Azure Consultant

  • Job typeJob type: Remote
  • Job DurationPermanent
  • Project LevelMedium Level
  • Project deadlineExpired

Project detail

You have a proven track record to leverage technology to deliver business objectives that yield efficiencies in improved business processes and long-term sustainable growth related to architecture, scalability, performance, cost savings, and better end user experience. You are also comfortable with collaboration amongst technical and business stakeholders to educate and train them about the positive impact of the changes being implemented in technologies. The right candidate can work independently in a fast-paced environment and have the initiative to drive constant optimization and improvements in the business.

Job Duties and Responsibilities

  • Create data pipelines for data ingestion and ETL from Big Data technologies
  • Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc…
  • Lead and assist technical teams and discuss business impact with senior management
  • Project management and business analyst skills to gather requirements, manage and lead projects, and deliver in a timely manner
  • Develop data sets by consolidating data from various resources and preparing data sets for reporting related to data mining, staging, production
  • Conduct assessment, discovery, identification of bottlenecks and find gaps in infrastructure – recommend areas of improvements, implement changes
  • Develop AI/ML models in Azure
  • Create test cases and coordination of UAT with stakeholders
  • Capable of explaining technical projects and the business impact to management and non-technical stakeholders
  • Manage service and delivery of technical engagements
  • Ensure high quality standards for delivery of business proposals and technical documentation
  • Create analytics dashboards and automate reports with KPIs to support data-driven business decisions


Required Skills, Education, Knowledge and Experience

  • 5 to 8 years’ experience in a Data Engineering/Architect type role
  • Hands-on technical expertise required related to Big Data & Azure Modern Data Warehouse technologies
  • Formal Education in IT/Computer Science/Computer Engineering related fields
  • Solid SQL Server practical experience; familiarity with logic SQL statements, functions, triggers and stored procedures
  • Experience with Spark, Hadoop/EMR, SQL
  • Expertise in modeling data
  • Ability to optimize data access for speed/reliability/velocity as needed by the business
  • Solid experience implementing and leading multiple cloud migration engagements
  • Azure VPN Configurations experience – Site to site, express route
  • Cloud deployment models – IaaS, PaaS, Hybrid
  • Intermediate to Expert level experience with Azure Data Factory, Azure Databricks, Azure Analysis service, HD Insight, Azure SQL Data Warehouse, Logic Apps, Azure Stream Analytics, Microsoft Power BI
  • Familiarity with licensing options on Cloud platforms to recommend optimal solutions for clients related to VMs or Azure services
  • Scripting and automating repetitive day to day tasks to optimize efficiencies
  • Proficient in Python/R scripting
  • Solid communication skills both written and verbal, including ability to communicate to various stakeholders


Desirable Skills and Experience

  • Microsoft Azure Cloud Solutions Architect certification (70-535)
  • Agile experience or Certification
  • Powershell scripting; ArcGIS
  • Experience in modifying an existing job to add a new field and get it into production within a day
  • Experience creating a new data pipeline/job within a few days’ deadline

Industry Categories

Languages required

Freelancer type required for this project