Data Engineer

Job Description

Amana is seeking a highly motivated data engineer with Microsoft Azure & Databricks engineering background to join our Data Science team. Primary Responsibilities: Use knowledge to architect data warehousing and BI solutions that solve problems that cut across multiple business functionsInteract with business customers, gathering requirements and delivering complete Data Engineering, Data Warehousing, and Analytics solutions.Interface with other technology teams to extract, transform, and load data from a wide variety of data sources

Job Requirements

• Minimum 5 years of end-to-end data engineering development experience
• 4 to 5 years of hands-on experience with Azure (ADF, Synapse Workspace, Databricks, Azure Functions, Logic Apps)
• Experience working with both batch and streaming data
• Strong professional experience in Python and SQL
• Hands on experiences with CI/CD implementation in ADF & Azure Data Bricks and manage it
• Experience with dimensional modeling, including dimension/fact and snapshot fact tables
• Hands-on experience with Databricks (optimization techniques, DLT, Unity Catalog)
• Hands-on experience with Power BI (DAX queries, data modeling, RLS)
• Microsoft Certified: Azure Data Engineer Associate (DP-203) is required
• Experience working with Synapse Dedicated and Serverless Pools
• Hands-on experience implementing privacy database solutions
• Experience working with multiple source and target systems, such as Oracle Database, SQL Server, Blob Storage, and Azure Data Lake Storage using Azure Data Factory
• Experience with Azure services for storage and data transfer
• Hands-on experience with data pipelines and data flows in ADF
• Ability to read data from sources using APIs and web services
• Experience performing data transformations during ETL processes
• Experience with data cleanup, data cleansing, and performance optimization
• Experience working with unstructured and semi-structured data in Azure is an advantage
• Experience with analytics tools such as Power BI and Azure Analysis Services is an advantage
• Experience with both private and public cloud architecturesExcellent written and verbal communication skills.

Qualifications

M.Tech / B.E. / B.Tech (Computer Science, Information systems, IT) / MCA / MCSKey Requirements:Azure (ADF, Synapse Workspace, Databricks, Azure Functions, Logic Apps)Databricks (Unity Catalog, Declarative Pipeline, PySpark)Working Experience with Azure DevOps (CI/CD), Power BICertification - Microsoft Certified: Azure Data Engineer Associate (DP-203)