Ho Chi Minh Air Quality & Weather Monitor
Near-real-time air quality and weather intelligence dashboard for Ho Chi Minh City, powered by scheduled data ingestion, Supabase, and Open-Meteo APIs.
Scheduled Open-Meteo air quality and weather ingestion
Supabase PostgreSQL schema for observations and pipeline runs
Embedded khangdo.dev dashboard with live and fallback states
PythonGitHub ActionsSupabasePostgreSQLReact/Next.jsOpen-Meteo API
FinFlow
Lambda Architecture Fintech Platform
Real-time fraud detection with Kafka + Spark Structured Streaming
Batch analytics pipeline with Airflow + dbt (Bronze/Silver/Gold layers)
Self-monitoring observability: schema drift detection + freshness SLA alerts
KafkaPySparkAirflowdbtRedisFastAPI
Vietnam Market Pulse
Real-time Financial Data Platform
Live BTC/ETH/BNB prices in VND via Supabase Realtime WebSocket
USD/VND exchange rates updated every 15 minutes via GitHub Actions pipeline
VN-Index tracking with pipeline health monitoring dashboard
PythonSupabaseGitHub ActionsNext.jsRecharts
Enterprise Data Sync Pipeline
End-to-end data synchronization pipeline for employee, member roles, and account management with comprehensive failure logging.
Designed Role/Member-Role Entity schema
Built Employee & Account Role sync pipeline
Implemented failure logging system
ETLDatabase DesignData Sync
ELT Pipeline with DBT
Modern Data Stack implementation with containerized ELT system, automated workflows, and real-time data quality monitoring.
100% automated daily workflows via Airflow
Star Schema transformation with DBT
Data Quality Framework (6 dimensions)
DBTAirflowDockerStar Schema
CMS Migration Automation
Test automation framework for CMS migration using SeleniumBase, enabling automated QC and content verification.
Automated login & page creation flows
QC scripts for CMS migration
Content consistency verification
SeleniumBasePythonQA Automation
Legal Data Platform
Backend development and refactoring for EU legal data platform, including web crawlers, authentication, and subscription systems.
Refactored EU legal web crawlers
Improved authentication & billing
Role-based access control system
PythonWeb ScrapingBackendRBAC
Cloud Analytics Audit
Data stack audit and optimization for analytics infrastructure, including BigQuery, Fivetran, and BI tool evaluation.
Audited data architecture
Resolved cloud data warehouse connectivity issues
Hex vs Looker Studio comparison
BigQueryFivetranLookerMixpanel
Azure Data Lakehouse for Wood Import & Export
End-to-end modern data lakehouse architecture on Microsoft Azure for tracking and analyzing wood supply chain operations.
Architected Medallion (Bronze/Silver/Gold) layer
Automated ETL workflows via Azure Data Factory
Optimized data transformations using Databricks
AzureDatabricksADFMedallion Architecture