Data Engineer

Responsibilities:

Develop, construct, test, and maintain data architectures in AWS
Align architecture with business requirements.
Design and implement ETL processes (connectors, ingestions, transformations, data pipelines) and unified data models;
Data acquisition via extraction from diverse data sources;
Use programming language and tools;
Identify ways to improve data reliability, efficiency, and quality;
Prepare data for predictive and prescriptive modeling;
Deploy sophisticated analytics programs, machine learning, and statistical methods;
Use data to discover tasks that can be automated.
Deliver updates to stakeholders based on analytics.
Present key findings and recommendations based on the results of testing.
Investigate new and applicable technologies;
Write documentation on the system workflow and conduct training on the proper use and maintenance of the data platform.

Requirements and Skills:

Proven working experience in designing, developing, and executing data pipelines - data solutions building and development is a must.
Experience in implementing and delivering data solutions and pipelines on AWS Cloud Platform:

A strong understanding of data transformation, data structures, databases, and ETL processes;
An in-depth understanding of large-scale data sets, including both structured and unstructured data;
Proven experience with AWS cloud services, such as CDK, SAM, EC2, ECS, RDS, S3, Lambda, ApiGateway, Cognito, IAM, EventBridge, Step Functions, CloudWatch, VPC, networking in AWS VPC, Glue, and Lake Formation;
Development of data pipelines in Apache Airflow;
Familiarity with CI/CD development practice and Docker containers;
Ability to understand risk implications of products, cost minimization on Cloud solutions, and their financial impact;
Experience with the scripting language Python.
Experience working with APIs, including an understanding of requests, responses, and data formats such as JSON or XML
Experience in integrating data solutions with web and mobile applications;
Strong project management, business acumen, and decision-making skills;
Ability to explain complex issues and other technical aspects in a clear and concise manner;
Great attention to detail and high level of commitment and organization;
Awareness of current issues affecting the industry and its technologies;
Excellent communication and critical thinking skills focusing on significance, depth, and breadth;
Team player, willing to collaborate and seek assistance outside their vertical;
Ideally, 3 - 5 years of experience;
BPO experience is not required, but good to have.