Load Data

Save Data

Personal Information

Social Media

Summary

Passionate developer with 15+ years of experience in designing and developing data ETL project and full stack web application in most popular languages.Recent 5 years focused on Python based data project on IoT and finacial industry.

Education

Work Experience

Deisgn and implement data feed pipelines which transfer internal financial data to external partnersEngineered and delivered a second-generation Python data feed pipeline within a 4-months, 30% reduction in dev cycle time compared to its predecessor Successulfy handled the data source migration from ANZ CashActive to ACMC Achieved exceptional production stability, 0 critical incidents until now(8 Months) and ensuring high data integrity and availability. Architected and built a next-generation data feed platform to support multiple data domains and diverse export targets As the first Python developer in the team, pioneered Python development standards includes project structure, coding conventions, deployment, package registry, observability and testing guidelines

Provide Wetstock asset management and IoT data analysis to 20k+ fuel stations globally. Modernised outdated Python2 Cronjobs to Python3 Airflow ecosystem, unified 6 copies of untracked code base into a single repo Lead architect to convert wetstock analysis IP in Excel/VBS to AWS serverless service which includes Lambda, SQS, Kinesis, Glue and Redshift Restructured data lake on AWS S3, refined data mapping/validation logic and created data archiving plan Established and maintained a series of CICD pipelines on Jenkins and Github Action Created an AWS Cloudformation automated pipeline for duplicating the QA environment from production data fragments Integrated Auth0 to the whole product lines in various languages including Java, PHP, C# and Python Maintained data ingestion Docker images across various operating systems and architectures and assisted clients in deploying them to fuel stations worldwide Managed and monitored 80+ Linux EC2 servers using Prometheus, Grafana, Icinga, Ansible, AWS CloudFormation, and Terraform. Created Rest APIs and frontpage in FastAPI and Flask to support BI platform Yellowfin

Develop solutions and implement high-value international web applications as the lead backend developer Participate in the end-to-end process of SDLC, including business analysis, coding, testing, continuous ntegration/continuous deployment (CI/CD), and hotfixes in a cloud-based environment Support the whole team as expert in Python and backend development Maintain and manage reusable libraries and a standard initialization repository Acted as a "Firefighter" for urgent deadlines and challenging projects

Developed and operated IPTV middleware providing multimedia content management and delivery across devices. Focused on service-side architecture design and programming.

Projects

Airflow migration, Auth0 integration, CI/CD pipeline modernization, Linux server management, and Wetstock IoT analysis.

Official website including blog, e-commerce, course enrollment and certification process. 2018 Melbourne Design Awards gold winner.

Automated audio/video pipeline using AI (ChatGPT, Stable Diffusion, Whisper) to publish YouTube videos.

ETL pipeline for ASX HOLC data with Monte Carlo Simulation ranking model for trading strategy.

Programming Languages

Data ETL

Web & API

DevOps

Databases

Languages

Certifications