RAW TO RELIABLEby Lee YaoData Engineer & Analytics Systems Builder
Menu

01

Hero

RAW TO RELIABLEby Lee Yao

Data Engineer & Analytics Systems Builder

I turn fragmented inputs into validated systems and decision-ready data.

Reliable pipelines, tested models, and analytics-ready outputs built with Python, SQL, Snowflake, dbt, and modern orchestration.

Raw inputs → Validated systems → Trusted decisions

Based in New York.

Python / SQL / Snowflake / dbt / Airflow

View Selected WorkView Resume
RAW TO RELIABLE / SYSTEM PATH / FIG. 01
Raw inputs become validated systems, trusted outputs, and usable decisions.

02

Currently Building

Systems in motion.

A current ledger of platform work, product development, and focused technical study.

  1. 01Active Build

    Job Search OS

    A local-first workflow for job ingestion, evidence-based scoring, duplicate detection, and application tracking.

  2. 02Current Study

    Snowflake Engineering Practice

    Deepening Snowflake platform knowledge and preparing for the SnowPro Core certification.

03

Selected Work

RAW TO RELIABLE / ARCHITECTURE AS EVIDENCE

Selected Systems, documented.

Three data engineering studies organized around flow, modeling, quality, and useful outputs.

01

Financial Data Platform

COMPLETED OCT 2026

PROJECT 01 / Financial Data Platform

SEC Financial Data Platform

Real SEC company facts move through Python ingestion, validation, Snowflake and dbt marts into anomaly flags and a Tableau dashboard; a Kafka and Spark stream processes filing events.

PythonSnowflakedbtAirflowGreat ExpectationsTableau

Focus: Financial ingestion · Validation · Modeling · Anomaly analysis

SEC PLATFORM / ARCHITECTURE / FIG. 02
Validated company facts become modeled financial marts and a Tableau dashboard.
View Case StudyView on GitHub
02

Streaming Architecture

APR – MAY 2026

PROJECT 02 / Streaming Architecture

CMS Medicare Streaming Data Pipeline

Kafka and Spark Structured Streaming process public Medicare hospital charge records into Snowflake snapshots and dbt models for DRG charge-to-payment analysis.

KafkaSpark Structured StreamingSnowflakedbtAirflow

Focus: Streaming ingestion · Aggregate snapshots · DRG charge analysis

View Case StudyView on GitHub
CMS PIPELINE / STREAMING / FIG. 03
Keyed public records become refreshed DRG snapshots and rule-based analytical models.
03

Analytics Engineering

MAR – APR 2026

PROJECT 03 / Analytics Engineering

Olist Supply Chain & AI Reviews Intelligence

An e-commerce analytics project connecting Snowflake and dbt models, Cortex-enriched Portuguese reviews, Power BI reporting, and a separate Neo4j graph investigation.

PythonSnowflakedbtPrefectPower BISnowflake CortexNeo4j

Focus: Dimensional modeling · Seller performance · Customer analytics

OLIST ANALYTICS / MODELING / FIG. 04
Warehouse SQL and dbt models support the recorded BI output; graph loading reads staging separately.
View Case StudyView on GitHub

04

Job Search OS

RAW TO RELIABLE / LOCAL-FIRST WORKFLOW / HUMAN REVIEW

Job Search OS

A local-first job-search workflow for importing job descriptions, reviewing duplicates, scoring role fit against stored evidence, and tracking applications.

JOB SEARCH OS / INTERFACE / FIG. 05
A restrained workspace for ingestion, evidence review, and application tracking.

One workflow, with human review at every step.

Human review remains part of every decision. The system does not automatically submit job applications.

View Case Study

05

Engineering Notes

RAW TO RELIABLE / DEBUGGING / SYSTEMS / DOCUMENTATION

Debugging systems, documenting the reasons.

Practical notes on data pipelines, Docker, Spark, Kafka, orchestration, and the failures that reveal how systems actually work.

View All Writing

06

Let’s Connect

RAW TO RELIABLE / OPEN CHANNEL / NEW YORK

Have a data engineering role, technical problem, or project worth discussing?