What I Love & Do in Data
Data Engineering & Architecture | | DataOps | Data Products & Platforms | Business Intelligence & Analytics
I’m an experienced data professional based in Auckland, NZ. I build quality Data Platforms and Data Products for customers and help enable organizations leverage their data assets. I love solving problems both big and small.
Understanding business needs, translating requirements into Technical Solutions and Design, stakeholder interactions, problem solving, building and exploring new tech or collaborating on a new idea, process or solution - these are the challenges and stimulations I enjoy most.
​
Microsoft BI Stack (SSIS, SSRS, SSAS, SQL Server, PBI) and Azure ecosystem are my home base. I've worked and loved Snowflake (on Azure) as well for a few months standing up a solution that was adopted for data science exploration that started as a PoC. More recently I've built, delivered and supported end to end Delta Lakehouse implementations in Azure Synapse Ecosystem (which uses the same underlying tech-stack as the Databricks on azure such as Delta lake, Apache Spark, Python).
Whether you need someone for a short-term project, or a long-term collaboration, I’d love to hear from you. You’re invited to explore my work & interests and contact me to discuss how we can do some great work together.
​
You can download a copy of my resume here if you would like to give it a quick scan before reaching out.
Tech Stack and Skills Breakdown
Tech Stack: Microsoft BI Stack - SQL Server 2005 - 2016, TSQL, SSIS/RS/AS, Multidimensional Cubes, Tabular Models, MDX and DAX
Reporting and Visualization: SSRS (on sharepoint/reporting server/PBI premium), Power BI (build, admin using UI and powershell, gateways), PBI Dataflows,
Power BI: Dashboards, Reports, Datasets, Workspace Management, License Management.
​
ETL/ELT development and orchestration: SQL Server Jobs, SSIS (server, cloud), ADF, Synapse Integration Pipelines, Pyspark Notebooks in Synapse
​
Azure Ecosystem: Azure SQL DBs, Azure DataLake Gen2 and Storage Accounts (lifecycle, ACLS), Infrastructure (VMs for - servers, jumphosts, AD, SQL DBs, PBI gateways, SHIRs for ADF and Synapse), and Networking (VNETs - using IaC), IaC for data platform deployments, CI/CD and Azure DevOps (YAML, Powershell), Role Based Access Controls, Azure AD and Service Accounts, Integration using Event Grids, Message Queues, Azure Functions (Python), Synapse Serverless Analytics (Serverless SQL, Lake DBs, Synapse Spark, Synapse Queries, Pipelines, Notebooks with Pyspark, Spark SQL)
​
Data Modelling and Analytics: Data warehousing using Star and Snowflake Schema, DataMarts and Data products, Hybrid Data Vault (exposure), Synapse Serverless Delta Lakehouse - Microsoft Intelligent Data Platforms, Metadata Framework (Capgemini IP - Accelerators)
​
Sources: Oracle (PL/SQL), D365 BC APIs, D365 F&O (BYOD, Export to Datalake and Synapse Links), D365 CE Synapse Link, Nav DBs, Ungerboeck APIs, Ticketmaster APIs, Asana APIs, Sharepoint APIs, Sharepoint Lists and others, SQL Server DBs, Event Grid and Messages.
​
Snowflake Cloud Datawarehouse: Azure Snowflake Setup and PoC including ADF ELT into Snowflake (using SnowPipes and Event Grid staging in ADLS before native connector was available), SnowSQL, Tasks, Streams, JS Storedprocedures, Account and User Access Control.
​
Databricks and Fabric Lakehouse - Learning and Exposure, Applicable relative experience in Synapse Delta Lakehouse Experience working with Spark Cluster, Pyspark Notebooks, Delta tables and optimisation. Databricks Foundation V2 Certified.
Generic IT Skills
Domains: Finance (US), Food and Beverages (NZ), Utilities (NZ), Government (NZ), Automotives (NZ), Telematics (NZ), Parcels and Transport (NZ), Health (NZ)
ITIL V3 Foundation Certified (2011): Incident, Problem, Process, Risk and Change Management, SLA, MSA, Support Frameworks
​
​
​
Incident and Problem Management Tools' Expertise: ServiceNow, JIRA Service Management, FreshDesk, Zendesk
​
​
​
SDLC: Agile Scrum, Kanban, Waterfall using Azure DevOps, JIRA Core, Trello, Notion, Slack, Confluence, Sharepoint
​
​
​
BA, Product, Change & Backlog Management
​
DataOps and DevOps: Azure DevOps pipelines and release pipelines, JIRA Core, BitBucket, SQL RedGate, Visual Studio Code, Professional and Community (GIT and SSDT)
