Next Article in Journal
Statistical Approaches Based on Deep Learning Regression for Verification of Normality of Blood Pressure Estimates
Next Article in Special Issue
The Influence of Satellite Configuration and Fault Duration Time on the Performance of Fault Detection in GNSS/INS Integration
Previous Article in Journal
A Two-Stage Localization Scheme with Partition Handling for Data Tagging in Underwater Acoustic Sensor Networks
Previous Article in Special Issue
Experimental Evaluation of UWB Indoor Positioning for Indoor Track Cycling
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Rubber-Tapping Robot Forest Navigation and Information Collection System Based on 2D LiDAR and a Gyroscope

College of Engineering, China Agricultural University, Qinghua Rd.(E) No.17, Haidian District, Beijing100083, China
*
Author to whom correspondence should be addressed.
Submission received: 31 March 2019 / Revised: 23 April 2019 / Accepted: 6 May 2019 / Published: 8 May 2019
(This article belongs to the Collection Positioning and Navigation)

Abstract

:
Natural rubber is widely used in human life because of its excellent quality. At present, manual tapping is still the main way to obtain natural rubber. There is a sore need for intelligent tapping devices in the tapping industry, and the autonomous navigation technique is of great importance to make rubber-tapping devices intelligent. To realize the autonomous navigation of the intelligent rubber-tapping platform and to collect information on a rubber forest, the sparse point cloud data of tree trunks are extracted by the low-cost LiDAR and a gyroscope through the clustering method. The point cloud is fitted into circles by the Gauss–Newton method to obtain the center point of each tree. Then, these center points are threaded through the Least Squares method to obtain the straight line, which is regarded as the navigation path of the robot in this forest. Moreover, the Extended Kalman Filter (EKF) algorithm is adopted to obtain the robot’s position. In a forest with different row spacings and plant spacings, the heading error and lateral error of this robot are analyzed and a Fuzzy Controller is applied for the following activities: walking along one row with a fixed lateral distance, stopping at fixed points, turning from one row into another, and collecting information on plant spacing, row spacing, and trees’ diameters. Then, according to the collected information, each tree’s position is calculated, and the geometric feature map is constructed. In a forest with different row spacings and plant spacings, three repeated tests have been carried out at an initial speed of 0.3 m/s. The results show that the Root Mean Square (RMS) lateral errors are less than 10.32 cm, which shows that the proposed navigation method provides great path tracking. The fixed-point stopping range of the robot can meet the requirements for automatic rubber tapping of the mechanical arm, and the average stopping error is 12.08 cm. In the geometric feature map constructed by collecting information, the RMS radius errors are less than 0.66 cm, and the RMS plant spacing errors are less than 11.31 cm. These results show that the method for collecting information and constructing a map recursively in the process of navigation proposed in the paper provides a solution for forest information collection. The method provides a low-cost, real-time, and stable solution for forest navigation of automatic rubber tapping equipment, and the collected information not only assists the automatic tapping equipment to plan the tapping path, but also provides a basis for the informationization and precise management of a rubber plantation.

1. Introduction

As an essential strategic resource, natural rubber and its products are universally applied in industry, transportation, national defense, and medical treatment. At present, the excellent properties of natural rubber cannot be exceeded by synthetic materials [1,2,3,4]. The demand for natural rubber products keeps increasing with the development of economies and industries [5]. Currently, the rubber-tapping activity is still dominated by manual work both at home and abroad [6]. Due to the labor’s intensity and technical difficulty, the poor working environment, the shortage of workers, and aging in the working population, there is a sore need for intelligent rubber-tapping devices [7,8]. The autonomous navigation technique is of great importance to make rubber-tapping devices intelligent, especially in night-time operation.
In addition, the diameter, plant spacing, and row spacing of trees are important parameters for evaluating orchards or forests. The same is true of rubber plantations. These parameters reflect the growth status, water consumption, and biomass of rubber trees. Accurate and up-to-date mapping and monitoring of a rubber plantation are challenging [9,10].
To date, many technologies, such as sensors, RTK-GPS (RTK: Real-time kinematic; GPS: Global Positioning System), machine vision, LiDAR, and ultrasonic geomagnetic position, have been developed to study the autonomous navigation of robots [11,12]. However, machine vision is affected by the working environment and lighting conditions to a large extent, and technologies involved in it, such as image processing, image analysis, camera calibration, and the extraction of navigation parameters, make it rather difficult to apply in agriculture [13,14,15,16]. The application of GPS is affected by interruptions in the satellite signal [11,17]. For example, when a vehicle travels through a forest with too many trees, the crown often blocks the signals sent by satellites to GPS receivers, while RTK-GPS, with higher precision, is too expensive to be widely used [9,18]. Rubber-tapping techniques require this activity to be carried out at night. LiDAR can not only provide a large amount of accurate information with high frequency, but also can meet the accuracy and speed requirements. Moreover, with great performance compared to cost, it provides all-weather services regardless of lighting conditions [19]. Therefore, it has been widely applied to robot navigation and positioning as well as map construction in non-agricultural fields [20,21,22,23], and is becoming increasingly popular in the navigation of agricultural vehicles [24,25,26,27].
Benet [18] and his colleagues employed LiDAR, an Inertial Measurement Unit (IMU), and a camera sensor in their study. The environmental–geometric data collected by the IMU are obtained with the color camera’s data in order to improve the efficiency of object recognition. Then, by sorting the colors, objects in front of the vehicle, such as crops, grass, leaves, and soil, are inspected and recognized. Thus, agricultural vehicles can detect obstacles and navigate along crop rows autonomously. Similarly, in the paper of [24,25], by fusing data from LiDAR, a camera, and an IMU, the trunks of trees were detected and a partial map of an orchard was thus constructed. The Kalman Filter algorithm was also used to estimate the robot’s position in this orchard, so as to make it navigate autonomously among tree rows. Shalal [26] et al. proposed a new method for local-scale orchard mapping based on tree trunk detection and utilizing modest-cost color vision and laser-scanning technologies. The image segmentation and data fusion methods were used for feature extraction, tree detection, and orchard map construction. The map is composed of the coordinates of the individual trees in each row as well as the coordinates of other non-tree objects, and it can be used as an a priori map to realize robot positioning and path planning and navigation in the orchard. However, the application of the camera increases the complexity and the amount of calculation of the system. In the papers of [27,28], taking LiDAR as the navigation sensor, Barawid et al. have made it possible for the robot to navigate autonomously along a particular tree row of the orchard. Due to the lack of attitude information, the number of navigation errors will increase if the robot walks on uneven ground. Additionally, the turning performance of the robot has not been studied. Therefore, the key to increasing the precision and robustness of a navigation system lies in the combination of LiDAR and Inertial Measurement Units (IMUs) [19,29]. Bayar [30] et al. have made full use of the data from LiDAR, wheels, and the steering encoder. A motion model, including wheel side slip, was constructed to calculate the vehicle’s speed and its steering instructions. It can not only autonomously navigate among rows in the orchard, but also can generate the turning path and turn at the end of the row. Compared with the expensive RTK-GPS, this low-cost sensor suite is of much more commercial value. However, turning at the end of the rows is probabilistic, so the success of each turn cannot be guaranteed. Moreover, the automatic rubber-tapping operation requires the robot navigation platform to safely walk along one row in a rubber forest, to turn from one row into another, and to stop within a fixed range for tapping. Freitas [31] et al. have applied LiDAR, an IMU, a steering wheel, and wheel encoders to assess the position of offline obstacles based on the classification and clustering of three-dimensional (3D) point obstacles. Finally, obstacles, such as pedestrians and boxes, on the route of the vehicle have been detected successfully. To predict the biomass, growth, yield, water consumption, and health conditions of trees so as to provide bases for tree management, Lee [32] et al. have successfully adopted LiDAR to measure the geometric characteristics of tree crowns. The results show that LiDAR can better measure the geometric characteristics of the tree.
In summary, due to the excellent comprehensive performance of LiDAR, a method of forest navigation and information collection based on low-cost LiDAR and a gyroscope, which does not rely on GPS, is proposed in this paper. The sparse point cloud data of tree trunks are extracted by LiDAR and the gyroscope through the clustering method. The point cloud is fitted into circles by the Gauss–Newton method to obtain the center point of each tree. These center points are threaded through the Least Squares method to obtain the straight line, which is regarded as the navigation path of the robot in this forest. The Extended Kalman Filter (EKF) algorithm is adopted to obtain the robot’s position. The Fuzzy Controller is applied for the following activities: walking along one row with a fixed lateral distance, stopping at fixed points, turning from one row into another, and collecting the information of plant spacing, row spacing, and trees’ diameters. Then, according to the collected information, each tree’s position is calculated, and the geometric feature map is constructed. The aim of the method proposed in this paper is to provide autonomous navigation for intelligent tapping devices and collect information on a rubber plantation to benefit the informatization and precision management of the rubber plantation.

2. Materials and Methods

2.1. System Composition

This study takes a tracked robot as the basic platform, the system of which is shown in Figure 1. The program runs on Windows 7 Visual Studio 2013. The length of the robot platform is 76 cm and the width is 62 cm. The distance between the LiDAR’s installation site on the robot platform and the ground is 95 cm. The type of this LiDAR is A2M6; it is made by SLAMTEC Company, and has a scanning frequency of 10 Hz, a scanning angle of 360 degrees, an angle resolution that is adjustable from 0.45 to 1.35 degrees, a maximum scanning distance of 18 m, and a relative scanning accuracy of 1%. The gyroscope used in this study is of type JY901 and produced by Shenzhen Witt Intelligent Technology Co., Ltd. Its frequency is 10 Hz, and its angular resolution is 0.1 degrees. Two caterpillar driving wheels are driven by two HLM480E36LN brushless direct current (DC) motors made by MOTEC Company. The role of the trace device: white wheat flour is placed in the tracing device, so when the robot walks, the white line left on the ground should be the actual walking path of the robot. As shown in Figure 2, the motor is directly controlled by the industrial computer (IC) through its driver. The Industrial Computer is the control core of the robot.

2.2. Navigation Strategy

For targeting under specific conditions of rubber-tapping, mobile robots are required to be able to stop in front of trees and work. So, the robot platform set should achieve the following goals in the forest:
  • Autonomously navigate along one row with a fixed lateral distance;
  • Stop at the designed spot in front of trees;
  • Turn from one row into another;
  • Information collection.
According to the trend of trees, the spot that crosses the tree’s center and is perpendicular to the tree row is regarded as dead ahead of a tree. As required by the rubber-tapping operation of the mechanical arm, the robot’s ideal stopping spot should be 125 cm right ahead the rubber tree. Therefore, the ideal navigation path for the robot in a rubber forest should be the line chart that connects the dead ahead spot of each tree. In order to fit tree rows better, the segmentation fitting method is thus proposed. At the same time, the LiDAR scanning distance is set to be twice the maximum plant space to make full use of the tree data closest to the robot. If there are no data scanned within 0~90° of the LiDAR, it is supposed that the robot has reached the boundary of this rubber forest, and then a turn will be performed immediately. As shown in Figure 3, the green circles represent trees; black points stand for the ideal stopping spots; and the red dotted line is regarded as the robot’s ideal navigation path.

2.3. Navigation Phases

According to the data applied to the robot’s navigation and the corresponding movements, the navigation is divided into three phases: “straight phase”, “turning phase”, and “row-changing phase”.
As shown in Figure 3, at the A-B stage of the straight phase, the sparse point cloud data of tree trunks are extracted based on data offered by LiDAR and the gyroscope. Then, the point cloud is fitted though the Gauss–Newton method to obtain the coordinates of each tree’s center. The straight line connecting tree centers is fitted by the Least Squares method and then regarded as the robot’s navigation path. According to the navigation path, the robot would walk along one row with a fixed lateral distance and stop at the designated spot in front of each tree.
At the B-C stage of the turning phase, after finishing the rubber tapping at point B, the robot will walk straight to point C (the distance between B and C is controlled by setting the straight-walking time). Then, the data of the gyroscope’s Z-axis and differential driving are employed to make a 90-degree turn.
At the C-D and E-F stages of the row-changing phase, the navigation of C-D is similar to that of the “straight phase”. Their difference lies in that C-D has no fixed-point stopping, and it will use the gyroscope to turn right again when it goes through a complete row space. The E-F stage is similar to the B-C stage: when finishing the tapping, the robot will go straight toward point E, make a 90-degree left turn with the help of the gyroscope, walk straight to point F (the distance of E-F is controlled by setting the straight-walking time), make another 90-degree left turn using the gyroscope, and enter the next cycle.
The above three phases constitute the whole cycle of the robot’s navigation. When the robot encounters situations beyond the above three phrases, it will stay put. On one hand, this can ensure the safety of the robot. On the other hand, after finishing all of the operations in the rubber forest, it can stop automatically.

2.4. Calibration of the Installed Location of LiDAR

It is important to calibrate the installed location of the vehicular LiDAR [27]. Whether the axis of the LiDAR, i.e., the 0–180° axis, is parallel to the center line of the robot platform or not directly influences the navigating performance of the robot and the accuracy of information collection. When installing, the vertical wall is utilized to calibrate the center line of the LiDAR, so as to make the center line of the LiDAR parallel to the center line of the robot. As shown in Figure 4, the robot is put at the place 100 cm away from the wall and the center line of the robot is parallel to the wall. Then, on the wall, two points that can form the 45° and 135° angles are extracted from the LiDAR’s scanned data, and the distance between these two points and the Lidar’s central point are set as l45 and l135, respectively. Finally, the LiDAR’s installation position should be calibrated until l45 = l135.

2.5. Navigation Path Generation

Firstly, all scanned data are sorted according to angles, and then data within 0~180°, i.e., the robot’s right-side data are extracted. In order to make full use of the tree data closest to the robot and to fit the tree row better, the LiDAR scanning distance is set to be twice the maximum plant spacing. All scanned points on the tree are extracted using the clustering method [31,33]. If two points meet the following requirements, they fall into the same category:
(1)
The distance difference between two points and the LiDAR is less than the threshold δ1 (δ1 is determined by the diameter), i.e.,
| l 1 l 2 | < δ 1 ;
(2)
The angle difference between two points and the LiDAR is less than the threshold δ2 (δ2 is determined by the diameter and the distance between the robot and the tree row), i.e.,
| α 1 α 2 | < δ 2 ;
(3)
The distance difference between two points and the center line of the robot is less than the threshold δ3 (δ3 is determined by the row spacing), i.e.,
| l 1 s i n α 1 l 2 s i n α 2 | < δ 3 .
After clustering, if the number of elements in a cluster is larger than the given threshold N (N is determined by the number of points scanned on the tree with the smallest diameter), it can represent a tree:
Num(classi) > N ➞ classi = TreeTrunk.
In the same way, other tree trunk information of the nearest tree row from the robot can be obtained. If there are small trees or stumps that do not need to be operated on, the robot can automatically ignore them by setting the threshold N. All data used in the navigation come from the tree row closest to the robot, so different row spacings and plant spacings in the forest are permitted.
Due to the uneven terrain in the forest, slight tilt may occur. This will lead to an increase in the distance error. Therefore, the gyroscope should acquire attitude information of the robot in real time to correct the LiDAR data based on the roll and pitch angles.
As shown in Figure 5, plane 1 is horizontal, and the attitude information of the robot is acquired in real time by the gyroscope, including the left and right tilt angle ε1, the front and rear tilt angle ε2 to plane 1, and the rotation angle around the Z axis. The tilt angle is utilized to compensate for the scanning distance error of the LiDAR when the robot walks on uneven ground. When the robot tilts to the left or right, l and l’ represent the scanning distance of the LiDAR on plane 1 and plane 2, respectively, while the cylinder represents the tree. The actual distance between the robot and the tree is:
l = l c o s ε 1
Similarly, when the robot tilts to the front or rear, the actual distance between the robot and the tree is:
l = l c o s ε 2
When the robot has both left–right tilt and front–rear tilt, the total tilt angle of the robot should be the combination of these two parts:
l = l c o s ε 1 c o s ε 2
After the clustering is completed, all point cloud data on the trunk for navigation can be extracted then round-fitted through the "Gauss–Newton method" to obtain the center coordinates of C1, C2, C3, and C4, as shown in Figure 6. Then, the Least Squares method is adopted to fit the straight line of the center, which shall be the navigation path.

2.6. Design of the Fuzzy Controller

The advantage of Fuzzy Control [34] is that it does not need to establish an accurate control model. We only need to define effective input and output control variables and appropriate Fuzzy Control rules [35]. In this paper, the lateral error E and the heading error θ are used as the input of the Fuzzy Controller. The forward direction of the robot is taken as the reference. If E is positive, it means that the robot’s position deviates from the left side of the ideal navigation path. If E is negative, it means that the robot position deviates from the right side of the ideal navigation path. At the same time, the positive heading angle error indicates the counterclockwise deflection, and the negative angle indicates the clockwise deflection.
The PWM (Pulse-Width Modulation) control difference, U, of the DC motors on both the left and the right sides is selected as the output variable, so as to control the differential steering of the robot. The heading angle error θ, lateral error E, and output quantity U are divided into seven levels: negative big (NB), negative medium (NM), negative small (NS), zero (Z0), positive small (PS), positive medium (PM), and positive big (PB). The basic fields of θ, E, and U are respectively [−6°, 6°], [−250 cm, 250 cm], [−120, 120]. Their corresponding fuzzy fields are all {−3, −2, −1, 0, 1, 2, 3}. The membership function adopts a triangle. Then, the distribution of this fuzzy variable membership function can be seen in the following Figure 7.
The MIN-MAX-gravity method is selected for defuzzification. According to experience and the test conditions, the table of fuzzy control rules is shown in Table 1. Figure 8 shows the three-dimensional surface diagram of the fuzzy control rules.

2.7. Location of the Robot

The feature-based Extended Kalman Filter (EKF) [36] provides an effective method for mobile robot pose estimation, so it was adopted in this study for robot localization in the forest. It is stipulated that, when the robot stops in front of each tree, the exact spot is regarded as the initial position of the robot, (x’0, y’0). The pose of the robot in the forest can be expressed by its coordinates (x’, y’) and the attitude angle φ relative to the trunk. Assuming that the robot is moving at a constant speed between the two trees, the pose of the robot should be:
{ x ( k + 1 ) = x ( k ) + u x ( k ) T y ( k + 1 ) = y ( k ) + v y T + 1 2 u y ( k ) T 2 v y ( k + 1 ) = v y ( k ) + u y ( k ) T φ ( k + 1 ) = φ ( k ) + u φ ( k ) T
In the above formulas, T is the sampling time; u(k) the random perturbation in motion; and vy’ the speed of the car in the y’-axis direction.
For sake of convenience, the equation of the state of the robot system should be:
x ^ k = f ( x k 1 , y k 1 , y k 1 , φ k 1 )
Then, the error covariance matrix should be:
P k = A k P k 1 A k T + W k Q k W k T
In the above formula, A k = f X stands for the Jacobian matrix of the system state, W k = f U the Jacobian matrix of process noise, and Qk the covariance matrix of process noise.
The Kalman Gain can be calculated as:
K k = P k H k T ( H k P k H k T + V k R k V k T ) 1
In the above formula, H k = h X is the Jacobian matrix for measuring the state of the model, V k = h U the Jacobian matrix for measuring model noise, and Rk the covariance matrix of process measurement noise.
Since the robot’s initial position (x‘0, y’0) is already known, the position at time k should be (x‘(k), y’(k)). Distances between the tree and the LiDAR can be measured by the LiDAR, while the heading angle of the robot can be measured by the gyroscope. Therefore, the measurement model should be:
h ( x k , y k , φ k ) = [ r k ϕ k ] = [ ( x ( k ) x 0 ) 2 + ( y ( k ) y 0 ) 2 arctan ( y ( k ) y 0 x ( k ) x 0 ) + φ k ]
Using actually measured data to correct the robot’s attitude estimation:
x ^ k = x ^ k + K k ( Z k h ( x ^ k ) )
In the above formula, Zk stands for the actually measured data.
Finally, the error covariance matrix is updated as follows:
P k = ( I K k H k ) P k
Extended Kalman Filter (EKF) is a recursive estimation process, and the updated pose and error covariance matrix are used to predict the new estimates in the next time step. Figure 9 is the flow chart of the system algorithm.

2.8. Information Collection

The information collected on the forest includes tree diameters, plant spacing, row spacing, and position information, among which tree position derives from plant spacing and row spacing recursively. The specific methods can be seen as follows.

2.8.1. Calculation of Tree Position

As shown in Figure 10, the absolute coordinate system XOY is established according to the position of tree P1 and the trend of the entire forest. The absolute coordinate of tree P1 is (x1, y1). When the robot stops in front of tree P1 to carry out the operation, the center of its LiDAR is taken as the origin point O1. Then, the dead-ahead direction of the robot is taken as the N-axis, and the line connecting O1 and the tree is taken as the M-axis, so as to establish the robot’s coordinate system MO1N. The distance between P1 and O1 is L1; the distance between P2 and O1 is L2; and the angle between P2 and the N-axis is γ. The coordinate system MO1N is rotated by β degrees (counterclockwise is positive; the β angle is measured by the gyroscope), so that the newly obtained coordinate system M1O1N1 is parallel with the absolute coordinate system XOY. Thus, the coordinate of tree P2 in the M1O1N1 coordinate system should be:
( L 2 s i n ( γ + β ) , L 2 c o s ( γ + β ) )
The coordinate of P2 in the absolute coordinate system XOY should be:
[ x 2 y 2 ] = [ x 1 + L 2 s i n ( γ + β ) L 1 c o s β y 1 + L 2 c o s ( γ + β ) + L 1 s i n β ]
Therefore, the absolute coordinate of tree P3 can be deduced from the absolute coordinates of tree P2. In the same way, the coordinate of all trees in the same row in the absolute coordinate system can be calculated, and coordinate calculation formulas for different rows can be inferred. Tree rows in the actual experiment are so straight that the X-coordinate of each row is regarded as the same. The coordinate formula of tree position in the forest is obtained as follows:
The coordinate formula of odd tree rows should be:
[ x 1 n y 1 n ] = [ x 11 y 11 + i = 1 n 1 ( L i + 1 c o s ( γ i + β i ) + L i s i n β i ) ] .
The coordinate formula when the robot turns:
[ x 21 y 21 ] = [ x 1 n + L 2 c o s ( γ 2 + β ) L 1 c o s ( γ 1 + β ) y 1 n + L 2 s i n ( γ 2 + β ) L 1 s i n ( γ 1 + β ) ] .
The coordinate formula of even tree rows should be:
[ x 2 n y 2 n ] = [ x 21 y 21 i = 1 n 1 ( L i + 1 c o s ( γ i + β i ) L i s i n β i ) ] .

2.8.2. Calculation of Tree Radius

In order to improve the accuracy of the measurement of a tree’s diameter as much as possible, when the robot stops in front of the tree for operation, the LiDAR’s position is closest to the tree and the robot pauses. At this time, the scanned point set of this tree and the coordinate of the next tree’s relative position are collected and circularly fitted using the Gauss–Newton method [37]. Thus, the diameter of the obtained circle is regarded as the diameter of the tree.
The curvilinear equation of the circular is supposed to be:
x 2 + y 2 + a x + b y + c = 0 .
C, D, E, G, and H are assumed as follows:
{ C = N x i 2 ( x i ) 2 D = N ( x i y i ) x i y i E = N x i 3 + N ( x i y i 2 ) ( x i 2 + y i 2 ) x i G = N y i 2 ( y i ) 2 H = N y i 3 + N ( x i 2 y i ) ( x i 2 + y i 2 ) y i
Then a, b, and c should be:
{ a = ( H D E G ) / ( C G D 2 ) b = ( H C E D ) / ( D 2 G C ) c = ( ( x i 2 + y i 2 ) + a x i + b y i ) / N
Thus, the tree’s radius R should be:
R = 1 / 2 a 2 + b 2 4 c .
After obtaining each tree’s position and diameter according to the above method, in order to help users have a better understanding of the collected information, the position of the tree is embodied by the position of the circle’s center and the diameter of the tree by the diameter of the circle. The geometric feature map of the forest is thus graphed.

3. Results

3.1. Navigation Results Analysis

In order to test the navigation performance and the accuracy of information collection of the LiDAR–gyroscope-based navigation system, a forest about 800 m2 in area is selected as the test area south of the Agricultural Science and Technology Park in Tongzhou District, Beijing (116° 49’ 13’’ E, 39° 51’ 29’’ N). This test area is composed of three rows of trees, with 15 trees in each row, so there are 45 trees altogether. As shown in Figure 11a, the absolute coordinate system XOY is established by taking tree P1 as the reference, with moving backward and left 2 m as the origin O. In the absolute coordinate system, the actual position of the tree is measured by hand with a tape measure. Then, we can obtain the plant spacing and row spacing. In Figure 11b, the circumference of the trunk at the same height as the LiDAR (95 cm from the ground) was measured with a tape measure in the test forest, and data on the diameter of the tree were obtained. The specific parameters are shown in Table 2. Because the distance between the test forest and adjacent forests is 1000 cm, to guarantee the integrity of this test and make the robot turn at the boundaries, the scanning radius of the LiDAR was set to be 900 cm, and the initial speed 0.3 m/s.
In this test, white wheat flour is placed in the tracing device, so, when the robot walks, the white line left on the ground should be the actual walking path of the robot. The heading direction of the robot is regarded as “front”, and the difference between the actual stopping site and the ideal site is regarded as the “front and back error”, just as what is shown by the yellow dot in Figure 3. If the robot stops in front of the ideal stopping site, the error is positive. If the robot stops at the back of the ideal stopping site, the error is negative.
Three repeated tests have been conducted in this forest. When measuring lateral errors, the points at 125 cm in front of each tree are connected in turn as the ideal navigation path for the robot. In the test, white wheat flour is placed in the tracing device, so, when the robot walks, the white line left on the ground should be the actual walking path of the robot. As shown in Figure 12a, the lateral error is measured between the ideal navigation path and the actual walking path of the robot. When the robot stops in front of the tree (the robot stops for 3 seconds), the position of the LiDAR relative to the tree is marked with white wheat flour. As shown in Figure 12b, the distance between the actual and ideal stopping spots is measured as the front and back errors. After each experiment, the lateral error data were sampled in front of each tree (data are represented by solid circles in Figure 13) and in front of the midpoint of the connection between two trees (data are represented by hollow circles in Figure 13). The front and back error data were sampled in front of each tree.
Table 3 shows the result of lateral errors when the robot walked along one row and turned at the end of the row, while Table 4 shows the result of the front and back errors. Figure 13 suggests the lateral error of the robot at each separate measurement point in the second test. The solid blue line represents the lateral error when the robot walked along one row, and the red dotted line represents the lateral error when turning. The root mean square (RMS) lateral errors with the three repeated tests are 10.31 cm, 10.32 cm, and 9.37 cm, respectively, which shows that the method has great path tracking performance. In the three repeated tests, the average values of the front and back errors are all positive, mainly because the inertia makes the robot move forward for a distance after receiving the stop command.
In order to describe the robot’s stopping range around each tree, the stopping error is prescribed as:
S t o p p i n g E r r o r = ( L a t e r a l E r r o r ) 2 + ( F r o n t A n d B a c k E r r o r ) 2 .
Table 5 shows the result of the stopping errors. In Figure 14, the abscissa represents the range of stopping errors, and the ordinate represents the number of data elements within the range of errors. Figure 14 suggests that the stopping error follows a normal distribution. Most of the errors are within the range of 5~15 cm, and the average stopping error is 12.08 cm, which meets the requirements of forest navigation for a rubber-tapping robot.

3.2. Mapping Results Analysis

In order to help users have a better understanding of the collected information, a geometric feature map [38] of the test forest is constructed to show the plant spacing, row spacing, diameter, and position of trees. On the basis of the above results, the point set of each tree is fitted into a circle by the "Gauss–Newton method". According to the above method of measuring plant spacing, row spacing, tree position, and tree diameter as well as the method of graphing a geometric feature map, the position of a tree is represented by the center of the circle, and the diameter of the tree by the diameter of the circle. The map of the forest and an enlarged partial detail can be seen in Figure 15.
To evaluate the accuracy of the constructed geometric feature map, the tree’s position error Pe is defined as follows:
P e = ( x t x i ) 2 + ( y t y i ) 2 .
In the above formula, (xt, yt) stands for the actual position of the tree, and (xi, yi) the calculated position of the tree according to collected data. The tree’s radius error re is defined as follows:
r e = r i r t .
In the above formula, rt represents the actual radius of the tree while ri represents the calculated radius of the tree according to collected data. Similarly, the plant spacing error he is defined as follows:
h e = h i h t .
Table 6 shows the position error, radius error, and plant spacing error of trees.
Figure 16 and Figure 17 show the position error and radius error of trees, respectively. After analyzing Table 6, it can be seen that all average values of plant spacing errors in these three tests are negative, which indicates that the tree distance measured by the robot is shorter than the actual condition on the whole. This is mainly because the robot is regarded as stopping at the ideal position by the default setting when measuring tree spaces, just as what the black dot shows in Figure 3. Table 4 shows that the average front and back error in these three tests is positive and similar to the average value of the plant spacing error. It shows that, due to the inertia of the robot, where the robot stops is generally in front of the ideal spot, just as what is shown by the yellow dot in Figure 3. Therefore, the measured plant spacing is shorter than the actual condition.
Figure 18 shows a comparison between the front and back errors and the plant spacing errors in the second test. It can be seen that the front and back error and the plant spacing error are generally distributed symmetrically, which proves the previous inference to be right. This indicates that the plant spacing error mainly derives from the front and back errors.
As shown in Figure 16, from the first tree to the fifteenth tree, i.e., in the first tree row, the tree position error increases gradually. This is mainly because the tree position is the recursion of plant spacing; a smaller plant spacing leads to a plant spacing error, the accumulation of which leads to the growth of the tree position error. From the 16th tree to the 30th tree, i.e., in the second tree row, when the robot returns, a part of the error will be compensated for, so the tree position error decreases gradually. However, in the third tree row, the tree position error gradually increases again.
Figure 17 shows that the radius error of the tree fluctuates within a small range around 0, and the RMS radius errors are 0.49 cm, 0.51 cm, and 0.66 cm, respectively, which shows that the measured radius reflects the true radius of the tree very well. The tree radius error is mainly caused by longitudinal cracks in trees and the unevenness of the ground. Among the information collected on the forest during the tests, the maximum radius error is 1.26 cm, while the maximum plant spacing error is 26.19 cm. The results show that the collected data could reflect the true parameters of the forest well.
Figure 19 shows a comparison between the actual map of the forest and the graphed map. In this figure, the red stands for the actual geometric feature map, the green stands for the constructed geometric feature map, and the number in parentheses is the tree number. In the constructed geometric feature map, the average position errors are 43.00 cm, 46.48 cm, and 40.40 cm, respectively, indicating that the map containing information on the forest not only benefits the informatization and precision management of trees, but also provides references for navigating a robot based on prior maps.

4. Conclusions

  • A method for forest navigation for an automatic rubber tapping platform was proposed in this paper. Instead of relying on GPS and prior maps, the method makes the robot walk along one row at a fixed lateral distance, stop at a fixed point, and turn from one row into another, only using low-cost two-dimensional (2D) LiDAR and a gyroscope. The root mean square (RMS) lateral errors with three repeated tests are 10.31 cm, 10.32 cm, and 9.37 cm, respectively, which shows that the method has great path tracking performance. The method provides better fixed-point stopping with average stopping errors of 12.62 cm, 11.98 cm, and 11.64 cm, respectively, which meets the requirements of forest navigation for a rubber-tapping robot.
  • A method of collecting forest information in real time during navigation was developed. Among the information collected on the forest during the tests, the RMS radius errors are less than 0.66 cm, and the RMS plant spacing errors less than 11.31 cm. The results show that the collected data could reflect the true parameters of the forest well.
  • A method for constructing a geometric feature map based on the collected information was introduced. In the constructed geometric feature map, the average position errors are 43.00 cm, 46.48 cm, and 40.40 cm respectively, indicating that the map containing information on the forest not only benefits the informatization and precision management of trees, but also provides references for navigating a robot based on prior maps.

Author Contributions

C.Z. analyzed the feasibility of the scheme, supervised the work, and provided the major direction of the research; L.Y. conceived and designed the experiments, analyzed the data, and wrote the paper; S.Z. contributed algorithm materials, experimental equipment support, and useful discussion; S.W. helped with performing the field tests; Y.C., L.G., and W.L. reviewed the paper and gave constructive advice.

Funding

This work was supported by The National Key Research and Development Program of China (2016YFD0701501) and The National Science Foundation Program of China (31601217).

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Wu, C.; Ban, S.; Gao, X.; Li, W. Correlation between DNA methylation status and rubber yield and related characteristics in Hevea brasiliensis tapped at different heights. Ind. Crop Prod. 2018, 111, 563–572. [Google Scholar] [CrossRef]
  2. Ahrends, A.; Hollingsworth, P.M.; Ziegler, A.D.; Fox, J.M.; Chen, H.; Su, Y.; Xu, J. Current trends of rubber plantation expansion may threaten biodiversity and livelihoods. Glob. Environ. Change 2015, 34, 48–58. [Google Scholar] [CrossRef]
  3. Tang, C.; Yang, M.; Fang, Y.; Luo, Y.; Gao, S.; Xiao, X.; An, Z.; Zhou, B.; Zhang, B.; Tan, X.; et al. The rubber tree genome reveals new insights into rubber production and species adaptation. Nat. Plants 2016, 2, 16073. [Google Scholar] [CrossRef]
  4. Li, D.; Wang, X.; Deng, Z.; Liu, H.; Yang, H.; He, G. Transcriptome analyses reveal molecular mechanism underlying tapping panel dryness of rubber tree (Hevea brasiliensis). Sci. Rep. 2016, 6, 23540. [Google Scholar] [CrossRef]
  5. Kou, W.; Xiao, X.; Dong, J.; Gan, S.; Zhai, D.; Zhang, G.; Qin, Y.; Li, L. Mapping Deciduous Rubber Plantation Areas and Stand Ages with PALSAR and Landsat Images. Remote Sens. 2015, 7, 1048–1073. [Google Scholar] [CrossRef]
  6. Yan, X.; Liao, Y. Exploration of Rubber Tree Tapping Technology. In Proceedings of the 3rd National Association of Local Mechanical Engineering Academic Annual Meeting and Cross-Strait Machinery Technology Forum, Sanya, China, 11–14 October 2013; pp. 129–132. [Google Scholar]
  7. An, F.; Zou, Z.; Cai, X.; Wang, J.; Rookes, J.; Lin, W.; Cahill, D.; Kong, L. Regulation of HbPIP2;3, a Latex-Abundant Water Transporter, Is Associated with Latex Dilution and Yield in the Rubber Tree (Hevea brasiliensis Muell. Arg.). PLoS ONE 2015, 10, e125595. [Google Scholar] [CrossRef]
  8. Wei, F.; Luo, S.; Zheng, Q.; Qiu, J.; Yang, W.; Wu, M.; Xiao, X. Transcriptome sequencing and comparative analysis reveal long-term flowing mechanisms in Hevea brasiliensis latex. Gene 2015, 556, 153–162. [Google Scholar] [CrossRef] [PubMed]
  9. Tang, J.; Chen, Y.; Kukko, A.; Kaartinen, H.; Jaakkola, A.; Khoramshahi, E.; Hakala, T.; Hyyppä, J.; Holopainen, M.; Hyyppä, H. SLAM-Aided Stem Mapping for Forest Inventory with Small-Footprint Mobile LiDAR. Forests 2015, 6, 4588–4606. [Google Scholar] [CrossRef]
  10. Fan, H.; Fu, X.; Zhang, Z.; Wu, Q. Phenology-Based Vegetation Index Differencing for Mapping of Rubber Plantations Using Landsat OLI Data. Remote Sens. 2015, 7, 6041–6058. [Google Scholar] [CrossRef]
  11. Keicher, R.; Seufert, H. Automatic guidance for agricultural vehicles in Europe. Comput. Electron. Agric. 2000, 25, 169–194. [Google Scholar] [CrossRef]
  12. Wu, J.; Yang, Q.; Bao, G.; Gao, F. Algorithm of Path Navigation Line for Robot in Forestry Environment Based on Machine Vision. Trans. Chin. Soc. Agric. Mach. 2009, 40, 176–179. [Google Scholar]
  13. Juman, M.A.; Wong, Y.W.; Rajkumar, R.K.; Goh, L.J. A novel tree trunk detection method for oil-palm plantation navigation. Comput. Electron. Agric. 2016, 128, 172–180. [Google Scholar] [CrossRef]
  14. Radcliffe, J.; Cox, J.; Bulanon, D.M. Machine vision for orchard navigation. Comput. Ind. 2018, 98, 165–171. [Google Scholar] [CrossRef]
  15. Bengochea-Guevara, J.; Conesa-Muñoz, J.; Andújar, D.; Ribeiro, A. Merge Fuzzy Visual Servoing and GPS-Based Planning to Obtain a Proper Navigation Behavior for a Small Crop-Inspection Robot. Sensors 2016, 16, 276. [Google Scholar] [CrossRef] [PubMed]
  16. Liu, L.; Mei, T.; Niu, R.; Wang, J.; Liu, Y.; Chu, S. RBF-Based Monocular Vision Navigation for Small Vehicles in Narrow Space below Maize Canopy. Appl. Sci. 2016, 6, 182. [Google Scholar] [CrossRef]
  17. Reid, J.F.; Zhang, Q.; Noguchi, N.; Dickson, M. Agricultural automatic guidance research in North America. Comput. Electron. Agric. 2000, 25, 155–167. [Google Scholar] [CrossRef]
  18. Benet, B.; Lenain, R. Multi-sensor fusion method for crop row tracking and traversability operations. In Proceedings of the Conférence Axema-Eurageng 2017, Paris, France, 25 February 2017. [Google Scholar]
  19. Liu, S.; Atia, M.M.; Karamat, T.B.; Noureldin, A. A LiDAR-Aided Indoor Navigation System for UGVs. J. Navig. 2015, 68, 253–273. [Google Scholar] [CrossRef]
  20. Emter, T.; Petereit, J. Stochastic Cloning and Smoothing for Fusion of Multiple Relative and Absolute Measurements for Localization and Mapping. In Proceedings of the 2018 15th International Conference on Control, Automation, Robotics and Vision (ICARCV), Singapore, 18–21 November 2018; pp. 1508–1513. [Google Scholar]
  21. Oliveira, F.G.; Santos, E.R.S.; Alves Neto, A.; Campos, M.F.M.; Macharet, D.G. Speed-invariant terrain roughness classification and control based on inertial sensors. In Proceedings of the 2017 Latin American Robotics Symposium (LARS) and 2017 Brazilian Symposium on Robotics (SBR), Curitiba, Brazil, 8–11 November 2017; pp. 1–6. [Google Scholar]
  22. Zhang, X.; Shi, H.; Pan, J.; Zhang, C. Integrated navigation method based on inertial navigation system and Lidar. Opt. Eng. 2016, 55, 44102. [Google Scholar] [CrossRef]
  23. Zhou, B.; Tang, Z.; Qian, K.; Fang, F.; Ma, X. A LiDAR Odometry for Outdoor Mobile Robots Using NDT Based Scan Matching in GPS-denied environments. In Proceedings of the 2017 IEEE 7th Annual International Conference on CYBER Technology in Automation, Control, and Intelligent Systems (CYBER), Honolulu, HI, USA, 31 July–4 August 2017; pp. 1230–1235. [Google Scholar]
  24. Shalal, N.; Low, T.; McCarthy, C.; Hancock, N. Orchard mapping and mobile robot localisation using on-board camera and laser scanner data fusion—Part B: Mapping and localisation. Comput. Electron. Agric. 2015, 119, 267–278. [Google Scholar] [CrossRef]
  25. Astolfi, P.; Gabrielli, A.; Bascetta, L.; Matteucci, M. Vineyard Autonomous Navigation in the Echord++ GRAPE Experiment. IFAC-PapersOnLine 2018, 51, 704–709. [Google Scholar] [CrossRef]
  26. Shalal, N.; Low, T.; McCarthy, C.; Hancock, N. A preliminary evaluation of vision and laser sensing for tree trunk detection and orchard mapping. In Proceedings of the Australasian Conference on Robotics and Automation (ACRA 2013), Sydney, Australia, 2–4 December 2013. [Google Scholar]
  27. Barawid, O.C., Jr.; Akira, M.; Kazunobu, I.; Noboru, N. Development of an Autonomous Navigation System using a Two-dimensional Laser Scanner in an Orchard Application. Biosyst. Eng. 2007, 96, 139–149. [Google Scholar] [CrossRef]
  28. Xue, J.; Zhang, S. Navigation of an Agricultural Robot Based on Laser Radar. Trans. Chin. Soc. Agric. Mach. 2014, 45, 55–60. [Google Scholar]
  29. Niu, X.; Yu, T.; Tang, J.; Chang, L. An Online Solution of LiDAR Scan Matching Aided Inertial Navigation System for Indoor Mobile Mapping. Mob. Inf. Syst. 2017, 2017, 1–11. [Google Scholar] [CrossRef]
  30. Bayar, G.; Bergerman, M.; Koku, A.B.; Konukseven, E.I. Localization and control of an autonomous orchard vehicle. Comput. Electron. Agric. 2015, 115, 118–128. [Google Scholar] [CrossRef]
  31. Freitas, G.; Hamner, B.; Bergerman, M.; Singh, S. A Practical Obstacle Detection System for Autonomous Orchard Vehicles. In Proceedings of the International Conference on Intelligent Robots and Systems, Vilamoura, Algarve, Portugal, 7–12 October 2012; pp. 3391–3398. [Google Scholar]
  32. Lee, K.H.; Ehsani, R. A laser scanner based measurement system for quantification of citrus tree geometric characteristics. Appl. Eng. Agric. 2009, 25, 777–788. [Google Scholar] [CrossRef]
  33. Khot, L.R.; Tang, L.; Blackmore, S.B.; Norremark, M. Navigational context recognition for an autonomous robot in a simulated tree plantation. Trans. ASABE 2006, 49, 1579–1588. [Google Scholar] [CrossRef]
  34. Zadeh, L.A. Fuzzy Sets. Inf. Control 1965, 8, 338–353. [Google Scholar] [CrossRef]
  35. Canning, J.R.; Edwards, D.B.; Anderson, M.J. Development of a fuzzy logic controller for autonomous forest path navigation. Trans. ASAE 2004, 47, 301–310. [Google Scholar] [CrossRef]
  36. Kalman, R.E.; Bucy, R.S. New Results in Linear Filtering and Prediction Theory. J. Basic Eng. 1961, 83, 95–108. [Google Scholar] [CrossRef]
  37. Hartley, H.O. The Modified Gauss-Newton Method for the Fitting of Non-Linear Regression Functions by Least Squares. Technometrics 1961, 3, 269–280. [Google Scholar] [CrossRef]
  38. Whyte, H.F.D. Uncertain Geometry in Robotics. IEEE J. Robot. Autom. 1988, 4, 23–31. [Google Scholar] [CrossRef]
Figure 1. The Robot System. 1. Car body; 2. Gyroscope; 3. LiDAR; 4. Shading board; 5. Display screen; 6. Tracing device.
Figure 1. The Robot System. 1. Car body; 2. Gyroscope; 3. LiDAR; 4. Shading board; 5. Display screen; 6. Tracing device.
Sensors 19 02136 g001
Figure 2. The principle of the system.
Figure 2. The principle of the system.
Sensors 19 02136 g002
Figure 3. The navigation path.
Figure 3. The navigation path.
Sensors 19 02136 g003
Figure 4. Calibration of the LiDAR’s installed location.
Figure 4. Calibration of the LiDAR’s installed location.
Sensors 19 02136 g004
Figure 5. Attitude compensation of the robot.
Figure 5. Attitude compensation of the robot.
Sensors 19 02136 g005
Figure 6. Fitting the navigation path.
Figure 6. Fitting the navigation path.
Sensors 19 02136 g006
Figure 7. The distribution of the membership function of θ, E, and U.
Figure 7. The distribution of the membership function of θ, E, and U.
Sensors 19 02136 g007
Figure 8. The surface schematic diagram of the fuzzy control rules.
Figure 8. The surface schematic diagram of the fuzzy control rules.
Sensors 19 02136 g008
Figure 9. The flow chart of navigation control.
Figure 9. The flow chart of navigation control.
Sensors 19 02136 g009
Figure 10. The transformation of a tree’s coordinates.
Figure 10. The transformation of a tree’s coordinates.
Sensors 19 02136 g010
Figure 11. Actual parameter measurement in the test forest. (a) Position measurement. (b) Circumference measurement.
Figure 11. Actual parameter measurement in the test forest. (a) Position measurement. (b) Circumference measurement.
Sensors 19 02136 g011
Figure 12. Error measurement. (a) Lateral error measurement; (b) Front and back error measurement.
Figure 12. Error measurement. (a) Lateral error measurement; (b) Front and back error measurement.
Sensors 19 02136 g012
Figure 13. The change in lateral error in the second test.
Figure 13. The change in lateral error in the second test.
Sensors 19 02136 g013
Figure 14. Stopping error distribution.
Figure 14. Stopping error distribution.
Sensors 19 02136 g014
Figure 15. The geometric feature map of the forest.
Figure 15. The geometric feature map of the forest.
Sensors 19 02136 g015
Figure 16. The position error of the tree.
Figure 16. The position error of the tree.
Sensors 19 02136 g016
Figure 17. The radius error of the tree.
Figure 17. The radius error of the tree.
Sensors 19 02136 g017
Figure 18. Comparisons of the front and back error and the plant spacing error.
Figure 18. Comparisons of the front and back error and the plant spacing error.
Sensors 19 02136 g018
Figure 19. Comparison of forest maps.
Figure 19. Comparison of forest maps.
Sensors 19 02136 g019
Table 1. The fuzzy control rules.
Table 1. The fuzzy control rules.
UE
NBNMNSZ0PSPMPB
θNBNBNBNMNSNSNSZ0
NMNBNMNSNSNSZ0PS
NSNBNMNSZ0Z0PSPM
Z0NBNMNSZ0PSPMPB
PSNMNSZ0Z0PSPMPB
PMNSZ0PSPSPSPMPB
PBZ0PSPSPSPMPBPB
Table 2. The parameters of the tested forest.
Table 2. The parameters of the tested forest.
CategoryParameterAverageStandard Deviation
Plant Spacing Range /cm348.5~490.7402.826.6
Diameter Range /cm8.4~15.913.81.4
1, 2 row spacing /cm405.0//
2, 3 row spacing /cm322.0//
1st row length /cm5810//
2nd row length /cm5850//
3rd row length /cm5859//
Table 3. Lateral error.
Table 3. Lateral error.
Test Number123
Walking along one row (cm)Maximum29.023.027.0
Average2.252.29−0.78
Standard Deviation10.0710.069.34
RMS10.3110.329.37
Turning (cm)Maximum14.0−11.09.0
Average4.33−5.672.67
Standard Deviation10.345.568.26
RMS11.217.948.68
Table 4. Front and back error.
Table 4. Front and back error.
Test Number123
Maximum /cm25.020.527.0
Average /cm4.103.913.74
Standard Deviation /cm9.537.829.13
RMS/cm10.378.749.87
Table 5. Stopping error.
Table 5. Stopping error.
Test Number123
Maximum /cm27.7328.6428.79
Average /cm12.6211.9811.64
Standard Deviation /cm6.516.456.30
Table 6. Map errors.
Table 6. Map errors.
Test Number123
Position error (cm)Maximum95.6193.1994.64
Average43.0046.4840.40
Standard Deviation20.0219.0626.96
Radius error (cm)Maximum−1.151.161.26
Average−0.130.03−0.06
Standard Deviation0.470.510.66
RMS0.490.510.66
Plant spacing error (cm)Maximum−26.19−23.16−25.89
Average−4.47−3.41−4.23
Standard Deviation10.517.8010.28
RMS11.318.4311.00

Share and Cite

MDPI and ACS Style

Zhang, C.; Yong, L.; Chen, Y.; Zhang, S.; Ge, L.; Wang, S.; Li, W. A Rubber-Tapping Robot Forest Navigation and Information Collection System Based on 2D LiDAR and a Gyroscope. Sensors 2019, 19, 2136. https://0-doi-org.brum.beds.ac.uk/10.3390/s19092136

AMA Style

Zhang C, Yong L, Chen Y, Zhang S, Ge L, Wang S, Li W. A Rubber-Tapping Robot Forest Navigation and Information Collection System Based on 2D LiDAR and a Gyroscope. Sensors. 2019; 19(9):2136. https://0-doi-org.brum.beds.ac.uk/10.3390/s19092136

Chicago/Turabian Style

Zhang, Chunlong, Liyun Yong, Ying Chen, Shunlu Zhang, Luzhen Ge, Song Wang, and Wei Li. 2019. "A Rubber-Tapping Robot Forest Navigation and Information Collection System Based on 2D LiDAR and a Gyroscope" Sensors 19, no. 9: 2136. https://0-doi-org.brum.beds.ac.uk/10.3390/s19092136

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop