Data & AI Architect
Sonata Software · Melbourne, Victoria, Australia
قدّم وتابع مع أبلاي إيدجData Solution ArchitectAI/MLShould be able to work with structured and unstructured data should be transformed (ETL/ELT) using Fabric pipelines connected via Data Agents.Create Data agents from Lakehouse and Train and deploy theEnsure compatibility with AI model inputs (like normalized tabular data, image files, etc.).Fabric Data Engineer:Design and Implement Medallion Architecture on OneLakeAbility to design and develop Medallion architecture in Fabric onelake (Bronze, Silver, Gold) pattern.Work with Structured and Unstructured dataCreate unified data platformArchitect and implement data pipelines using Microsoft Fabric Dataflows and Pipelines to support raw to refined data transitions.Ensure modularity, reusability, and performance of layered data transformations.Establish Fabric Platform Best PracticesDefine and enforce naming conventions, folder structures, and workspace strategies to support scalable data development and governance.Implement data quality checks, monitoring, and alerting using Data Quality rules and metrics in Fabric.Configure and maintain security best practices, including role-based access control (RBAC), OneLake item-level security, and integration with Azure AD.Create documentation and templates to standardize development across teams.Support Semantic Data Model Design and EnhancementsWork closely with analysts and business stakeholders to translate reporting needs into optimized semantic models.Enhance existing models for performance, usability (e.g., calculated measures), and self-service capabilities.Ensure alignment with Microsoft Fabric best practices for Power BI datasets and Direct Lake modes.CI/CD and DevOps EnablementSet up and maintain CI/CD pipelines using Azure DevOps for Fabric artifacts (Dataflows, Pipelines, Datasets, Reports).Automate deployment processes across dev, test, and prod workspaces.Ensure version control and change tracking for semantic models and pipelines.Integrate Dynamics 365 (CE and F&O) as a Data SourceConfigure and optimize ingestion pipelines from Dynamics 365 (Dataverse and Finance & Operations).Use OneLake shortcuts and pipelines to bring in near real-time data with incremental loads.Ensure consistent schema mapping and data lineage tracking.Modernize and AI-Enrich Existing BI ReportsMigrate legacy reports to Microsoft Fabric and Power BI using Direct Lake/Hybrid models.Introduce AI capabilities like Copilot, natural language Q&A, Smart Narratives, and anomaly detection visuals.Optimize report performance and accessibility for self-service users.Desirable Skills and ExperienceStrong hands-on experience with Microsoft Fabric, Power BI, Python/PySpark scripts and Dataflows Gen2.Proficient in Azure DevOps, Git-based source control, and YAML pipelines.Knowledge of Medallion architecture principles and implementation patterns.Experience with Dynamics 365 data structures and integration tools.Familiarity with Power BI advanced features including Dataflows, Direct Lake, DAX, RLS/OLS, and AI visuals.Design and provide solutioningMicrosoft Copilot StudioFabric AI FunctionsAI SkillsThe role requires strong expertise in enterprise data architecture, Microsoft Fabric, Dynamics 365 data models, Azure AI, Power BI, and modern data engineering practices.