About Me
An evolving Software Engineer
Amazon, LiveRamp and Huawei
Java, Python, C/C++, React, Angular
Big data, ML, Middlewares, Web, AWS & GCP
Experience
Software Engineer
Amazon Lab126 • Full-time
Jun 2021 – Today
Device org
Software Engineer Intern (Bigdata & ML)
LiveRamp • Full-time
Sep 2020 – Jan 2021
Worked on Identity Data Graph Engineering:
- Explored ways to apply practical ML to Data Graph build process, designed with Data Scientist/Engineers.
- Developed against GCP Bigdata services. Including Apache Beam Dataflow, BigQuery, Storage, Airflow, etc..
- Embedded Classification & Clustering models into pipeline jobs and evaluated results at NMI (above 0.9).
- Constructed periodic Jenkins job to kick off Dataflow Pipeline.
- Co-developed Angular & Sprint Boot Web App to visualize subcomponents of Identity Graph.
Software Engineer Intern
Amazon Lab126 • Full-time
May 2020 – Aug 2020
Developed on smarthome device:
- Developed Python Backend system for pre-setting, updating device and exposed Restful API to consume device information.
- Retrieved data from Amazon S3 and deploy functions on AWS Lambda.
- Implemented internal Python/shell tool to analyze source code and resolve dependencies recursively in 1s.
- Designed and implemented UI elements and business logics on Android smartome App.
Software Engineer
Huawei • Full-time
Jul 2018 – Jun 2019
Developed a Big data software with Hadoop and Java.
- Constructed uniformed file system interfaces for Local and HDFS storage.
- Implemented 3 Java Clients to submit Spark tasks in Local, Standalone, and Yarn mode.
- Developed “remote driver” that distributed million-size HBase tasks to 10+ Yarn nodes and got results in 5 minutes.
- Developed 5 layered Docker images in 5 days, optimized Container launching time from 5min to 20s, and reduced the overall image size from 7GB to 2GB.
- Scheduled Docker cluster with Helm and Kubernetes.
Software Engineer Intern
Huawei • Full-time
Jun 2017 – Nov 2017
Implemented a Full-Stack Platform that executed 200+ workflows in parallel.
- Developed 3 Executors using Java, C++ and Ruby.
- Integrated executors into Java main program with Java Native Interface.
- Applied ReactJS, JSX to draw the UI and Python Flask, Oracle DB to build a light-weight server.
Education
Northeastern University
Master of Science - MS, Computer Science (2019 Fall), Grade: 4.0
2019 – 2021
Course: Algorithm, Program Design Pattern, Foundation of AI, Machine Learning, Computer System, Building Scalable Distributed Systems, Web Development, Building Game Engines
Nanjing University
Bachelor's degree, Computer Software Engineering
2014 – 2018
Courses: Discrete mathematics, Data Structure and Algorithms, Java Coding, C++ Programming, Operating system, Database System, Computer Network, Linux Programming, Web Programming, Software Testing and Quality, Multi-core Based Parallel Programming, Andrioid App Dev, Computer Graphics, .NET Programming.