Me looking at a kaleidoscope
"Shapes and colors the likes of which I've never seen."

About Me

An evolving Software Engineer

Amazon, LiveRamp and Huawei

Java, Python, C/C++, React, Angular

Big data, ML, Middlewares, Web, AWS & GCP


Experience

Software Engineer

LiveRamp Logo

Amazon Lab126 • Full-time

Jun 2021 – Today

Device org

Software Engineer Intern (Bigdata & ML)

LiveRamp Logo

LiveRamp • Full-time

Sep 2020 – Jan 2021

Worked on Identity Data Graph Engineering:

  • Explored ways to apply practical ML to Data Graph build process, designed with Data Scientist/Engineers.
  • Developed against GCP Bigdata services. Including Apache Beam Dataflow, BigQuery, Storage, Airflow, etc..
  • Embedded Classification & Clustering models into pipeline jobs and evaluated results at NMI (above 0.9).
  • Constructed periodic Jenkins job to kick off Dataflow Pipeline.
  • Co-developed Angular & Sprint Boot Web App to visualize subcomponents of Identity Graph.

Software Engineer Intern

Amazon Lab126 icon

Amazon Lab126 • Full-time

May 2020 – Aug 2020

Developed on smarthome device:

  • Developed Python Backend system for pre-setting, updating device and exposed Restful API to consume device information.
  • Retrieved data from Amazon S3 and deploy functions on AWS Lambda.
  • Implemented internal Python/shell tool to analyze source code and resolve dependencies recursively in 1s.
  • Designed and implemented UI elements and business logics on Android smartome App.

Software Engineer

Huawei

Huawei • Full-time

Jul 2018 – Jun 2019

Developed a Big data software with Hadoop and Java.

  • Constructed uniformed file system interfaces for Local and HDFS storage.
  • Implemented 3 Java Clients to submit Spark tasks in Local, Standalone, and Yarn mode.
  • Developed “remote driver” that distributed million-size HBase tasks to 10+ Yarn nodes and got results in 5 minutes.
  • Developed 5 layered Docker images in 5 days, optimized Container launching time from 5min to 20s, and reduced the overall image size from 7GB to 2GB.
  • Scheduled Docker cluster with Helm and Kubernetes.

Software Engineer Intern

Huawei

Huawei • Full-time

Jun 2017 – Nov 2017

Implemented a Full-Stack Platform that executed 200+ workflows in parallel.

  • Developed 3 Executors using Java, C++ and Ruby.
  • Integrated executors into Java main program with Java Native Interface.
  • Applied ReactJS, JSX to draw the UI and Python Flask, Oracle DB to build a light-weight server.

Education

Northeastern University

Northeastern University

Master of Science - MS, Computer Science (2019 Fall), Grade: 4.0

2019 – 2021

Course: Algorithm, Program Design Pattern, Foundation of AI, Machine Learning, Computer System, Building Scalable Distributed Systems, Web Development, Building Game Engines

Nanjing University

Nanjing University

Bachelor's degree, Computer Software Engineering

2014 – 2018

Courses: Discrete mathematics, Data Structure and Algorithms, Java Coding, C++ Programming, Operating system, Database System, Computer Network, Linux Programming, Web Programming, Software Testing and Quality, Multi-core Based Parallel Programming, Andrioid App Dev, Computer Graphics, .NET Programming.