Projects

Areas

Software Engineering, Robotics, Data analysis in Finance, Machine Learning, Unity game engine

UI Tools for set-dressing

we develop tools to help creators create.

This project started when I was the intern at Machine Learning Artistry Lab, Unity Technologies. My manager is Scott Peterson.

Along with the tremendous growth of virtual worlds in games and movies, scene arranging has always been a time-consuming issue that takes a group of technical artists months to complete a high-quality scene.

Our goal is to implement layout(set-dressing) tools that greatly boost this process by providing placement tool, physic-based transform tool and intelligent assets palette.

16-726 Learning-Based Image Synthesis, Course project

This course taught by Jun-Yan Zhu start from Computer Vision basics and then go further into content generation with machine learning methods. The primary focus is Generative Adversial Network(GAN). See the course page and my project writeups: proj1 | proj2 | proj3 | proj4

Motion capture and emotion modeling

As an algorithm engineer intern in Lilith Games, our team researched on making the automatic workflow from a normal video containing human dancing to an avatar with same body movement. 

Besides, we have implemented a virtual pet with emotion model backend by python.

Cotton picking robot

After college graduation, I worked as Research Assistant in ShanghaiTech robotics lab and worked in research team with Xinjiang Esquel Group. Our aim is to develop a mobile cotton picking platform, with robot arm and precise cotton sense with 3D camera and computer vision object detection algorithm. My main focus is the suction device on the end of robot arm. We altogether iterated several version of suction device and I coded on the control part of suction device, which is based on ROS robot platform and Python/C++ script language. Besides, I helped with developing and deploying detection methods on robot.

Venture capital data analysis project

During senior year in ShanghaiTech, I became a student research assistant in School of Entrepreneurship and management, ShanghaiTech University. My contribution is to analysis venture capital investment data collected by pitchbook.com and run machine learning methods on them, aiming to find mechanism of how it is related with an important index: Economy Policy Uncertainty Index. Besides, we found this vary between investors depends on their education level, gender and some other personal attributes.