Data Engineer

Job responsibilities

Assist with the design, development, and implementation of data architecture of BI platforms

Assess client’s current BI model and offer suggestions for enhanced performance, data handling, and more efficient development process

Lead developers to integrate new data quality components within the client’s platform

Develop and support detailed dimensional data models and multi-dimensional databases

Assist in data extraction from the source system into the data warehouse staging area

Ensure data validation, data accuracy, data type conversion, and business rule application

Prepare documentation of the ongoing maintenance and operations for future reference

Design, develop, refactor, and support web service to consume stored data

Minimum requirements

Bachelor’s/Master’s degree in Engineering, Computer Science, Mathematics, Statistics (or equivalent experience)

At least 3+ years of hands-on experience as a data engineer (rare exceptions for highly skilled developers)

Excellent knowledge and expertise in SQL and Python

Experience with Microsoft SQL Server, SSIS, SSAS, SSRS, PPS, including knowledge of customer systems

Proficient with developing and calling web service APIs

Knowledge of Microsoft Visual Studio and Team Foundation Server

Expertise in collecting and analyzing data requirements

Knowledge of integrating data quality tools, like Experian, Trillium, Informatica, etc.

Experience working with multi-dimensional (OLAP) databases

Clear idea about database administration concepts, principles, and data management

Experience working with ETL tools for data extraction, cleansing, optimization, and loading

Fluency in English language for effective communication

Ability to work full-time (40 hours/week) with a 4 hour overlap with US time zones

Preferred skills

Grasp of Data Lake and Cloud Data Warehousing platforms

Working experience with Amazon Web Services

Experience working in Agile environments

Excellent organizational and interpersonal skills