Data Platform EngineerToronto, Canadamanyueinfo@gmail.com
I'm a data platform engineer in the Greater Toronto Area, working at CIBC through Jarvis Consulting Group. I work across Azure infrastructure and Databricks, setting up environments, managing access, automating operations, and building self-service tools for business teams.
I started in Java backend development before moving into Big Data and Applied AI. What draws me to platform engineering is understanding how the pieces fit together and making them work reliably for other people.
AzureDatabricksPythonSQLApache SparkUnity CatalogDelta Lake
Experience
2026 - now
Data Platform Engineer
CIBC
via Jarvis Consulting Group
Governed self-service apps, Unity Catalog access, and platform automation on Azure Databricks.
80%+lower Databricks Apps compute cost
More about this role
Joined Jarvis in November 2025. Deployed to CIBC in August 2026.
Built scheduled start/stop automation for Databricks Apps, with a measured reduction of over 80% in associated compute costs.
Built a file-explorer app that respects each user's existing Unity Catalog permissions through on-behalf-of-user authorization.
Develop reusable ETL operators and automate secret-scope access to help business teams work safely on a shared platform.
2021 - 2023
Junior Software Engineer
Cognizant
Insurance technology · India
Java enterprise applications, SQL integrations, and production support. Migrated 15+ applications from SVN to GitHub and supported CI/CD adoption.
Streaming orders and SQL data brought together in a governed lakehouse, with sales dashboards and customer insights.
Event HubsLakeflowPySparkDelta Lake
Behind the build
The problem
Combine streaming orders with customer, menu, and review data so reporting can use a consistent set of business tables.
What I built
Bronze, Silver, and Gold pipelines with order validation, sales aggregates, customer views, and AI-assisted review analysis. The repository includes deployment bundles, dashboard definitions, and an operating runbook.
Worth a look
The Silver-layer quality rules and environment-aware deployment configuration show the engineering behind the dashboard.
A learning app for data engineering foundations, with lessons, quizzes, flashcards, and progress tracking.
Next.jsReactLearning by buildingIn progress
Behind the build
Why I made it
I wanted a structured way to connect concepts and check my understanding as I learned.
Current scope
The first learning floor contains lessons, a quiz, a glossary, and flashcards. It is a work in progress, with content separated from the interface so it can grow over time.
Azure
Databricks
Python
Apache Spark
Unity Catalog
Delta Lake
