A Semantic Slam System Based on Visual-Inertial Information and around View Images for Underground Parking Lot
- Delivery
- Provide download link
- Format
- Price
- Non-members (tax incl.)：￥6,600 Members (tax incl.)：￥5,280
- Paper/Info type
- SAE Paper
No.2021-01-0078
- Pages
- 1-9(Total 9 p)
- Date of publication
- Apr 2021
- Publisher
- SAE International
- Language
- English
- Event
- SAE WCX Digital Summit 2021
Detailed Information
| Author(E) | 1) Wei LI, 2) Chaohui Li, 3) Dongjie Xiao, 4) Dong Zhou, 5) Tao Wang, 6) Libo Cao |
|---|---|
| Affiliation(E) | 1) Hunan University, 2) Hunan University, 3) Hunan University, 4) Hunan University, 5) CSLZQC. Co., Ltd, 6) Hunan University |
| Abstract(E) | As one of the most challenging driving tasks, parking is a common but particularly troublesome problem in large cities. Recently, an excellent solution-automated valet parking (AVP) has become a hot research topic, which allows the driver to leave the vehicle in a drop-off area, while the vehicle driving into the parking slot by itself. For AVP, the precise localization is an indispensable module. However, the global positioning system (GPS) cannot be used in the underground parking lot and the localization method based on lidar is too expensive. In response to solve this problem, we propose a simultaneous localization and mapping system with the semantic information of parking slots (PS-SLAM), which is based on visual-inertial and around view images. First, the calibration of multi-sensors is conducted to obtain their intrinsic and extrinsic parameters. In this way, the around view image and transformation matrices between sensors can be acquired. Then, the ORB-SLAM3 based on visual-inertial information is used to acquire the pose of the vehicle and sparse point cloud map. Next, the parking slot in the around view image is detected by the deep convolutional neural network (DCNN) model called VPS-Net. Finally, a parking-slot association method is devised to associate the detected parking slots with the point cloud map to generate a semantic map. The field experiments are conducted using a wire control chassis with 4 fisheye cameras, an inertial measurement unit (IMU), and a monocular camera. The results show that the proposed visual semantic SLAM system not only can achieve centimeter-level localization in the indoor parking lot but also generate a semantic map with parking slots. |
