Hello, my name is Quanxiang Liu(刘权祥), an undergraduate student majoring in software engineering at Northwestern Polytechnic University. I have been a member of the Northwestern Polytechnic University V5++ robotics team (an undergraduate team focused on simulating 5 vs 5 soccer game, RoboMaster University AI Challenge and UAV) since March 2020 and became the leader of the V5++ robotics team SLAM technology group since March 2021.
I am interested in computer vision, SLAM and UAV.
You can contact me with firstname.lastname@example.org.
- No news at present……
We originally designed this logistics UAV for 2020 China Robot Competition Logistics UAV Project.
This UAV is lightweight and can carry three standard small courier boxes weighing less than 500 grams and place them in specific locations based on visual information. It has a tracking camera to help locate itself indoor, in version 1.0 it had a depth camera to provide obstacle information to the navigation program, and in version 2.0 we replaced it with the Rplidar A3.
But there are some problems with this UAV:
The precision of localization is not enough.
The scale after SLAM initialization is not good, for example, calculating 5 meters as 3 or 6 meters. This somewhat affects the accuracy of UAV delivery.
Only the drop target was identified, and the position of the drop target center relative to the UAV was not calculated.
In order to ensure the accuracy of delivery, we ensure that the UAV can deliver express to the delivery target center by keeping the delivery target center in the down view image center. Although this can solve the problem, it is too difficult to control (it is difficult to determine which direction and how many meters the UAV should move), which also affects the accuracy of UAV delivery.
The design of UAV is too bulky and difficult to control in flight.
When the target is detected, we want to control the drone to drop a certain height to complete a more accurate drop, but when the weight of the courier carried by the drone is too heavy, the drone will be far more than expected in the drop height, only by reducing the weight of the courier to ensure that the drone works properly.
- Learn about open-vins visual-inertial system, and other famous visual slam systems.
- Install the realsense D435i camera and the realsense T265 camera for the UAV and calibrated both cameras.
- Deploy open-vins on the UAV to ensure that the drone can locate itself indoor.
- Learn docker and build docker containers to reduce the effort of environment configuration while speeding up the deployment of algorithms on different UAVs.
This is our second-generation logistics UAV. We have made great improvements on the basis of the first generation UAV, trying to solve some problems we have encountered before.
For the problem of low localization accuracy:
- Previously I just calibrated the camera and used the default values for the imu parameter in open-vins. But this time I did a joint calibration of the camera and imu, which allows the UAV to get more accurate localization.
- open-vins is only able to obtain the pose in the camera coordinate system, and a coordinate transformation is required for the UAV. So I created a ROS program called “pose remap” for converting a pose into the desired pose for the robot.
For the problem of low accuracy of UAV delivery:
Our previous scheme was difficult to guarantee the accuracy of the delivery, so this time I designed a program to calculate the position of the center of the falling target relative to the UAV. As long as the height of the drone relative to the ground is known, the program can accurately calculate this relative position.
This is a national college student innovation and entrepreneurship training program starting in 2021 and I am the leader of this project.
The aim of this project is to design a cave exploration UAV based on multi-sensor fusion. This UAV will be equipped with a variety of sensors, including infrared cameras, solid-state lidars, GPS, IMU, etc., and can detect the outside world even in complete darkness. It does not require human intervention, and can perform 3D mapping of the cave in real time and return autonomously.
We hope that this UAV will be able to enter caves for preliminary exploration before humans enter them, effectively reducing the risk of cave exploration accidents.
My main work is as follows:
- Manage this project.
- Select and calibrate the sensors.
- Select the appropriate VIO system and deploy it to the UAV.
- Select the appropriate LIO system and deploy it to the UAV.
- Merging VIO system with LIO system (in progress).
My main work is as follows:
- Learning about SLAM (Simultaneous Localization and Mapping).
- Familiar with SLAM System.
- Learning about Map2DFusion (paper and source code).
- Learning about Pi-SLAM (source code only).
- Combining Pi-SLAM and Map2DFusion into one program.
- Resolve the conflicting prerequisites in Pi-SLAM and Map2DFusion.
- Insert the RANSAC algorithm into the Pi-SLAM code for fitting the ground plane in the point cloud (default camera-to-ground shot).
- Map2DFusion is merged in as a thread of Pi-SLAM. After PI slam is started, it will calculate the pose and point cloud of a certain number of frames, and use RANSAC algorithm to fit the ground plane in the point cloud. After fitting, it will send the result to map2dfusion thread to start it. After that, Map2DFusion will receive the frame calculated by pi-SLAM and start the image mosaicing .
This is a Qt-based LIDAR simulation mapping software that helps people visualize how LIDAR scans things around them. This software also supports adding and removing obstacles from the simulated environment, as well as creating maps, which makes the software even more interesting.
I developed this software alone, and here is what I learned from the development process:
- Qt programming
- 2D collision detection algorithm
This project was initiated by the NWPU Soccer Robot Base SLAM Group, and I am the main leader.
We made this tutorial for better and more standardized recruiting training at the base, and of course we hope to help students who are interested in SLAM technology. Through the tutorial, we hope to give the team members an overall knowledge of SLAM, and to quickly master the basic positioning techniques so that they can be used in the base’s competitions or projects.
PS: This project is still in the development stage and there are some tutorials that are not yet completed.
- 2021.09 2021 Northwestern Polytechnic University Special Scholarship (rank 4.2%)
- 2021.09 2021 Northwestern Polytechnic University First Class Scholarship (rank 4.2%)
- 2021.09 2021 Northwestern Polytechnic University Outstanding Undergraduate Student
- 2021.09 2021 Northwestern Polytechnic University Academic Advanced Undergraduate Student
- 2020.09 2020 Northwestern Polytechnic University Second Class Scholarship (rank 10.9%)
- 2020.09 2020 Northwestern Polytechnic University Outstanding Undergraduate Student
- 2021.11 Third Prize in Developer Testing, National University Software Testing Competition Finals, 2021
- 2021.09 Second Prize of the 7th CCB Cup China International “Internet+” Student Innovation and Entrepreneurship Competition Intra-college Competition
- 2021.08 First Prize of the 23rd China Robotics and Artificial Intelligence Competition (Shaanxi Region)
- 2021.05 2021 Northwestern Polytechnical University E-Commerce “Innovation, Creativity and Entrepreneurship” Challenge Third Prize
- 2021.05 Third Prize of Innovation Track of the 19th “SanHang Cup” Extra-curricular Academic Science and Technology Works Competition for College Students
- 2021.05 Second Prize of the 2021 Northwestern Polytechnic University C Programming Experimental Skills Competition
- 2021.01 Second prize of the 2021 Northwestern Polytechnical University “Programming Star” programming challenge
- 2020.12 The first prize of the 22nd National Robotics Championship in the category of practical application of aerial flying robots
- 2020.11 Third runner-up (second prize) in the 2020 China Robotics Competition Drone Challenge
- 2020.05 Second prize in the 2020 Northwestern Polytechnic University Programming Competition
- 2019.09 - present, Undergraduate, School of Software, Northwestern Polytechnic University, Xi’an, Shaanxi Province, China.