Projects

Focused areas:

Software Engineering, Robotics, Data Analysis, Machine Learning, Game Development, VR/AR

Cloud-based layout editor

Machine Learning Intern at Unity Technologies

ML Artistry Team, Summer 2022

Along with the tremendous growth of virtual worlds in games and movies, scene arranging has always been a time-consuming issue that takes a group of technical artists months to complete a high-quality scene.

Our goal is to implement layout(set-dressing) tools that greatly boost this process by providing functions, including an optimized placement tool, a physic-based transform tool, and a intelligent assets palette. It can also be compatible with future XR devices.

It is an early staged project. During the 13 weeks internship, we started by collecting critical needs and started by making system designs, then followed by prototyping UI features and implemented them. Also we experimented with different physics methods for one of the UI features as well.

tool.gif
pasted image 0.png
Screen Shot 2022-08-05 at 12.06.39 PM.png
rocks.gif

AIPI: AI and self-driving car

Main Programmer

Collaborated with CMU Machine Learning & Computer Sciences Departments, Spring 2022

This is a project that cooperate with Boys and Girls Club of America and is currently put in use. See project website

trAIn&gAIn is a WebGL game to assist 14-16-year-old AIPI (Artificial Intelligence Pathways Institute) students understand the

concepts of neural networks through interactive visualization of the self-driving car. 

cropped-cropped-cropped-WeChat-Image_20220407160357-1.jpg
spreadsheet.png

16-726 Learning-Based Image Synthesis, Course project

This course taught by Jun-Yan Zhu start from Computer Vision basics and then go further into content generation with machine learning methods. The primary focus for this course is Generative Adversial Network(GAN), but it take advantage of deep learning methods and digital image processing as well.

See the course page and my project writeups: proj1 | proj2 | proj3 | proj4

Motion capture and emotion modeling

Algorithm Engineer Intern, Lilith Games, Summer 2021

 

Our algorithm team researched making the automatic workflow from a normal video containing human dancing to an avatar with the same body movement. 

Besides, we have implemented a virtual pet with an emotion model backend by Python Flask.

Cotton picking robot

Research Assistant, ShanghaiTech School Lab & Xinjiang Esquel, 2020-2021

After college graduation, I worked as Research Assistant in the ShanghaiTech robotics lab and worked in a research team with Xinjiang Esquel Group. We aim to develop a mobile cotton-picking platform, with the robot arm and precise cotton sense with the 3D camera and computer vision object detection algorithm. My main focus is the suction device on the end of the robot arm. We altogether iterated several versions of the suction device and I coded on the control part of the suction device. The device is a prototype based on Arduino and Raspberry Pi, and is connected to the ROS robot platform. Besides, I helped with developing and deploying detection methods on the robot.

e763cdbe-cc6f-4851-bcef-65ed5be9d430_rw_600_edited.jpg

Venture capital data analysis project

During my senior year in ShanghaiTech, I became a student research assistant in School of Entrepreneurship and management, ShanghaiTech University. My contribution is to analysis venture capital investment data collected by pitchbook.com and run machine learning methods on them, aiming to find mechanism of how it is related with an important index: Economy Policy Uncertainty Index. Besides, we found this vary between investors depends on their education level, gender and some other personal attributes. 

snapshot.png