TLDR: Results . Lessons learned . Summary & Conclusions . Quick-start guide
I am building an autonomous lawnmower which needs to know its position precisely – in the order of centimetres. Standard GPS is an order of magnitude too coarse and until recently, all flavours of differential GPS were very expensive. This changed last year when UBlox released the C94-M8P with a price tag of €359 for a complete solution. The announcement said:
The NEO-M8P module series introduces the concept of a “Rover” and a “Base Station”. By using a correction data stream from the Base Station, the Rover can output its relative position with stunning cm-level accuracy in good environments.
An old dog, I was wary of “in good environments”. That RTK is capable of centimeter accuracy when stationary and with a horizon-to-horizon view of the sky, I have no doubt; but what about in a less GPS-friendly environments? This article is the result of real-life testing in my garden, cluttered by surrounding buildings and vegetation..
Objectives
My aim was to establish whether or not the UBlox solution would be sufficiently accurate for my mower,
in particular how would it perform in less-than optimal conditions, so I devised a series of experiments, which I have named for the purposes of this discussion.
- Open. Stationary for 24 hours in the middle of the lawn, with a decent view of the sky. A base-line test to determine the system performance.
- Sky270. The receiver is next to the corner of a building, 90° of sky are obscured.
- Sky180. The receiver is close to a wall of a building, 180° of sky are obscured.
- Sky090. The receiver is in a corner of a building, 270° of sky are obscured.
- Canyon. The receiver is between two buildings with a heavy tree canopy, most of the sky is obscured.
- Mobile. The receiver is moved around the garden, stopping for 10 seconds at a known location in each of the previous tests.
Tests 2-6 are performed for an hour. As described later, I discovered that the receiver needs 25-30 minutes to settle on a solution and these data were removed.
All the tests are made with the antenna 54cm from the ground.
Test setup
I built a rooftop base station
powered by a solar cell with an MPP charger, the DC1621A evaluation board based on the LTM8062 chip from Linear Technology. As I had no idea how much power the C94-M8P would need – after all it has a UHF transmitter – I opted for a 10Ah 2S Lipo. On the left we have the DC1621A, on the right the UBlox board and the battery below. There’s a cell-balancer and packets of silica gel tucked behind the DC1621A. After verifying that every was working correctly, I mounted it on my roof:
My rover was simply a low table in the garden, with the antenna 54cm off the ground.
The rover’s signature is
In what follows, I am focussed solely on horizontal position – the X, Y values; I ignore altitude as it is only relevant for surveying and aviation.
All my calculations were performed in 64-bit floating point which gives ~15 decimal digits of precision.
The raw GPS data from the receiver contains latitude/longitude values. To convert these into distances I use Vincenty’s formula. I validated my implementation against 500’000 known distances, which are precise to 0.1µ metre.
Outputs
Each test produces 5 results.
1. Summary statistics
Quality (the NMEA term) is the type of Fix that the GPS currently has. Possible values are:
- Autonomous GNSS
- Differental GNSS
- 3D fix
- RTK Fixed
- RTK Float
It is worth noting that the ‘best’ fix is 4.
SVs is the number of satellites in view. I configured the rover UBX-CFG-NMEA to high precision mode (to output 9 digits of precision on latitude and longitude) and as a result considering mode is disabled. It is unclear whether satellites-in-view is those seen or those actually used.
hDop is the horizontal dilution of precision created by the constellation geometry.
ErrorLat is the distance in millimetres from the average centre of all the readings. Similarly ErrorLon.
ErrorLatLon is Euclidean distance from the measured point and the averaged centre of all the readings.
The ErrorX values are calculated using Vincenty’s Formulæ.
2. Error statistics
Limit is simply a reminder of the percentages associated with the number of standard deviations.
σ is the standard sigma calculation, the square root of the variance.
Out is the actual number of measurements that exceed the CEP below.
CEP is obtained by finding the number of samples ‘Out’ which exceed the limit %.
The difference between σ (a statistical calculation) and CEP (the true value for the data set in question) is readily explained: The statistical σ is valid only when the data are normally distributed (a Gaussian). Even over 24 hours, GPS readings are not Gaussian because the average is not stationary. Disraeli’s quip remains as true as ever.
3. Deviation map
An X-Y plot of ErrorLat horizontally against ErrorLon vertically:
A point’s colour indicates its age as hue corrected for the human eye. First blue, then green, yellow, orange and finally red.
4. ErrorLatLon over time
The Euclidean distance from the average centre to the measured point, in mm, over time:
5. Histogram
The number of errors at each bucket of the Euclidean distance from the average centre:
Test results
Open test
Sky visibility is typical for a residential area. To the north and west a single-storey building
The receiver, antenna and PC are on a low table in the foreground.
To the east, a 4-storey building (actually 3-storey but on higher ground)
To the south and west, mature oak trees and 2-storey houses
The receiver is in Fixed mode 71% of the time.
The 3σ CEP of 712 mm is surprisingly high and this is visible both in the deviation map:
and in the histogram (I have added log(Count) overlayed on Count to show the long tail more clearly):
The problem occured mid-morning and early afternoon:
The cause appeared to be due to receiver occasionally losing the RTK solution. To analyse this I zoomed in on the first occurrence and plotted the absolute error along with the Fix. 3D=2, Fixed=4 and Float=5. To highlight the differences, Fixed errors are green, Float errors are blue and 3D errors are red. Notice that the vertical scale is logarithmic:
At 10:28:18 and 10:32:52 the receiver switches for one measurement from Float to 3D. The same thing happens at 11:21:18:
and in both cases takes some 20 minutes before settling down.
The replay in ucentre shows nothing untoward at the instant of the loss:
I note that 20 minutes is the time that it takes the receiver to lock on cold start (details in Lessons Learned below) and postulate that momentary interference can cause a complete loss of the solution.
There were 4 such events in the 24-hour test. 4 in 86’400 = 1 in 21’600; a frequency less than 4σ, so I sought an explanation.
On the weekend of the tests there was an airshow nearby with several passes of military aircraft in formation. One can reasonably assume that 6 fighters at low altitude produce vast quantities of electromagnetic radiation and I imagine that military RF applications care little about the interference that they generate. Furthermore, the dropouts only occurred during the day, when the aircraft were flying, so I decided that they were the most likely cause. Consequently I decided to use a subset of the data with these events excluded. I also excluded the noisier data as of 04:32 in the morning, on ‘benefit of the doubt’ reasoning, for want of an explanation. The results then become:
Which is what I expected and much more reasonable.
Sky270 test
The receiver is against the NW corner of the house, 90° of obscured sky.
The receiver is slightly more in Float rather than Fixed (4.63 average quality). The 3σ CEP is 54 mm.
There is significantly more longitude error than latitude.
Sky180 test
The receiver is near the NW wall of the house, half the sky is obscured.
The receiver is continuously in Fixed mode. The 3σ CEP is 43 mm.
The histogram has longer tails due to the less favourable constellation geometry (practically no SVs to the SE):
The CEP is better than the Sky270 test, where only 90° of sky were obstructed. I attribute this to the fact that due to the lay of the land, the angle of the apex of the house is much larger when viewed from a corner. Additionally the sky view away from the house in this position is a little more cluttered.
Sky90 test
The receiver is in a corner of a building, facing SW, 270° of sky are obscured.
The receiver is in Fixed mode for the whole hour. The 3σ CEP is 185 mm.
The deviation shape clearly reflects the SW direction of the corner.
Canyon test
The receiver is in a NE-SW canyon between two houses with heavy canopy:
The wide-angle lens gives the impression that there is a wide view towards the camera. This is not the case, the two houses’ walls are almost parallel, some 12 metres apart and the canopy almost reaches to above the camera.
The receiver never achieves Fixed mode. The 3σ CEP is 135 mm.
The error and histogram are noisier and the canyon effect is clear in the deviation map, where the longitude errors are double the latitude errors, again due the the constellation geometry (few SVs NE and SW):
Mobile test
I walked around the garden, pausing 10 seconds at each of the SKYNNN points to hold the GPS at a marked position.
The red points are the 9 nearest points to the average of each location.
The receiver was in Fixed mode 7% of the time.
The average position error when moving is 19 mm.
Lessons learned
Here are some tips which might be useful to those envisaging the C98-M8P solution.
Status
The status bar at the bottom-right of U-Centre is very helpful:
From left to right:
- Version of connected GPS
- Port, if a GPS is connected
- File currently open (recording or replay)
- The last message-type received. This is particularly useful to confirm that you are receiving RTCM messages, where you will see the field display UBlox-NMEA-RTCM in quick succession.
- Elapsed time
- TOD
Antennæ
UBlox stress repeatedly that the solution’s accuracy depends on the antenna quality. I verified this and was unable to get the receiver to converge to ‘fixed’ mode (the highest accuracy) with the supplied patch antennas, so I bought a pair of Garmin GA38.
Startup accuracy
I was disappointed with my initial tests, until it dawned on me that the receiver needs quite a while to converge on the optimal solution. Here is an error plot on power-up:
After 52 seconds the error is momentarily down to 24 mm, but it quickly rises to 1’400 mm, thereafter gradually getting close to zero over the next 13 minutes. It again wanders up to 200 mm over 5 minutes and achieves first Fix at 25:54. It finally alternates between Fix and Float for a couple of minutes before permanently settling to Fixed at 26:47. All this is perfectly reasonable, given the calculations involved.
The takeaway is that you should give the receiver half an hour to warm-up before you can expect accurate results. Note also that seeing it switch to Fixed is not a guarantee that it has completely settled.
Fixed .vs. Float
It is apparent from the Sky090 test results that Fixed mode is an indicator of better quality but not a guarantee. All that can be said is that if the quality is 4 or 5, it’s RTK; lower values are standard GPS.
Power
On a 7.45 V battery, the base station consumes ~0.077 A = 0.573 W.
At 12.58 V, the rover consumes 0.066 A = 0.83 W.
So the evaluation board seems to use a linear regulator and I imagine that a non-negligible amount of that power goes to the blinking LEDs.
At closer to 3.5 V, you can assume a power consumption base or rover << 0.5 W.
Interference
As I discovered in the Sky360 test, unexpected interference can cause the unit to lose the RTK solution. The application can detect when this occurs by observing a Quality < 4; the consequence is that the position accuracy will be significantly degraded for the following 20 minutes.
Baseline & Radio range
Although not relevant for my use-case, I nonetheless tested the maximum baseline distance by driving away from the base station with the unit on my dashboard.
The receiver was never in Fixed mode in the car and lost Float mode (falling back to a 3D fix) between 576 and 745 metres away from the base. The distances to the loss points are in red:
(The terrain in my area is almost perfectly flat.)
This limitation is certainly not due to the (amazing) UHF radio, I drove 13 kilometres away from the base and the RTCM stream arrived faultlessly during the whole journey.
Survey-In
There seems to be some confusion about precision and accuracy of the base station. Given the non-Gaussian nature of GPS measurements, acquiring a TRUE position (whatever that means) by averaging would take weeks (months?) simply because the precision of the average depends on the ‘Gausian-ness’ of the data. The base station’s absolute coordinates, insofar as they are within metres of the truth, are irrelevant because the base transmits only satellite relative errors to the rover. The rover uses these relative numbers to adjust it’s solution; the accuracy of the result is not contingent on the precision of the base. Given that the satellites are ~20’000 Km away, a rover-base distance < 100 KM means that they both see identical distortions and this is why RTK baselines are generally recommended to be less than 50-100 Km.
If follows that it is perfectly acceptable to perform a Survey-In in 1 minute with an error of 5 metres, your accuracy will be no better than surveying for an hour with a 30cm error. That said, expect a survey-in of 1 metre to take about 10 minutes.
Deviation Map
You can scroll in and out with the mouse-wheel, but the minimum is 1 metre. To scroll in more, hold the Shift key, whence you can scroll in to a diameter to 20 cm.
Radio baud rate
The default baud rate is 19’200. Initially, I couldn’t get the RTCM messages to flow and finally discovered an error message: “GNTXT More than 100 frame errors, UART RX was disabled”. Reducing the baud rate to 9’600 fixed this, with no apparent consequences.
Summary
What does all this mean in layman’s terms?
Assuming the following conditions:
- Urban environment
- Reasonable antenna
- 50 cm off the ground
- During one hour, from a known truth position
I can make the following assertions about the accuracy and precision:
Accuracy. The error of the reported position will be less than 28 mm from the truth 99.73% of the time. In an urban canyon the error rises to 68 mm and with only 25% of the sky visible 93mm:
On average, you will get one reading worse than these values every 6 minutes.
Precision. Will never be worse than the precision of your base station ±356 mm (the radius of the 24-hour CEP).
Conclusions
The promised accuracy is indeed ‘stunning’.
When combined with a TOF camera, the accuracy of a few centimetres is more than adequate for the mower I am building, so I’m perfectly satisfied with it.
That said, the limitations I discovered preclude this solution in some other use-cases that come to mind. Both UAV and farming applications require a much longer baseline and the inability to maintain Fixed mode accuracy is a handicap for those needing consistent high accuracy.
If UBlox can fix the baseline limitation and significantly improve the unit’s ability to stay in Fixed mode, this GPS will become a truly amazing feat of engineering.
In the spirit of openness, you are welcome to use the data that gathered, for whatever purpose you see fit. Download here.
I am indebted to my local surveyors, JC Wasser, for explaining the finer points of their art and their advice on how to present my results.
Appendix: Quick Start
If you’d like to try this solution, here’s a summary of the user guide, along with a few tips.
The user guide is clear and setting-up the two stations is easy once you get the hang of u-centre (a nice piece of software, by engineers, for engineers). Assuming a classic setup with a fixed base station, here’s a quick-start guide:
- Download the latest firmware. When you install it (Tools-Firmware Update), it’ll ask for the FIS file which nobody talks about; it’s is hidden away in the u-centre program files, called flash.xml.
- Download the latest version of u-center
Setting up the Base
- The base station needs power. It’ll take if from USB but you’re going to need a source of external power once you’ve finished configuring it. It needs to be between 3.7 and 20 VDC, the + and – signs are on each side of the power connector, you’ll need a magnifying glass to read them.
- Fire up u-centre and connect the card you’ve chosen as base station to a USB port (the cards are identical, it’s your parameters that make them base or rover). Don’t try connecting more than one station to your PC at the same time!
- In what follows, you need to click ‘Send’ in the toolbar at the bottom to transmit you settings over USB to the base station.
- In Message view-UBX-CFG-GNSS, make sure GPS and GLOSSNAS are enabled.
- The base station also needs to know its own location, which it can figure out itself. Expand UBX-CFG-TMODE3, select Mode=1-Survey-In; this is what makes it a base station. The Maximum Observation Time and Required Position Accuracy are actually quite unimportant, because it doesn’t matter what the true latitude and longitude are, so 300 seconds and 3 metres are fine. Assuming you’ve got a good sky view it’ll finish the survey easily in the 5 minutes. If you really insist on better precision, it takes about 10 minutes for an RPA of 1 metre.
- UBX-CFG-MSG and enable F5-05 RTCM3.2 1005, 1077, 1087 and 1230 for UART1. They should all be set to 1 Hz except 1230 where 10 seconds is enough for the GLOSSNAS Code-phase biases.
- UBX-CFG –> PRT set the target=1-UART1, Protocol-in=none, Protocol-out=5-RTCM3 and the baud rate to 9’600. This is saying: Send all RTCM messages to UART1, where they’ll get transmitted on the UHF radio link. I couldn’t get the recommended 19’600 baud rate to work, I kept getting “GNTXT More than 100 frame errors, UART RX was disabled” messages.
- UBX-CFG-CFG and save the configuration. That way, when you power-cycle the base, it will resume operation normally. If you forget this and lose power, go to step 2.
- After a while, perhaps up to half an hour, in the Data View, you’ll see the base station switch to TIME. If it doesn’t, don’t worry, it’ll get there eventually and FLOAT mode already gives good results.
Setting up the Rover
- Unplug the base station and connect the other, rover, station.
- UBX-CFG-PRT set the target=1-UART1, Protocol-in=5-RTCM3, Protocol-out=none and the baud rate to 9’600. This is saying: RTCM messages will coming in on UART1, the UHF radio link.
- After a moment, the rover should start receiving RTCM messages. You won’t see them by default, UBX-CFG-Messages right-click on RTCM and ‘Enable child messages’. Then open the packet console to see them (you won’t see anything in the Text Console).
- Once they’re flowing in, time for a beer, the rover has to converge on the solution and this can also take a while, for me 20 minutes at minimum. You can monitor the convergence progress with UBX-NAV-RELPOSNED, click the ‘Poll’ button bottom-left to update the display if it isn’t enabled. The N and E Relative accuracies will fall gradually and eventually reach 0.01 = 10 centimetres.
- After some time it should switch to Fixed mode. If it doesn’t, don’t worry, as I mentioned in Lessons Learned, Fixed mode is better but not a pre-requisite for decent results.
- Now, and only now, can you make meaningful observations. Restart u-centre (the only way I found to reset the Deviation Map) and View-Deviation Map (F12). Yellow dots = last value, green dots = previous values. To zoom in closer than 1 metre, press Shift whilst scrolling the mouse wheel, the minimum is 20 centimetres.
You’ll only get an RTK fixed with a relatively good view of the sky and my experience is that a cold-started RTK receiver will take 30 minutes to acquire the solution.
This is due to the method – successive approximation – which takes time. Under a tree canopy you’ll stay in float, simply because of the physics, so yes, tree-felling is your only option.
That said, I didn’t find float to be significatly less precise than fixed (I have no way to assess the accuracy).
My application needs precision, the accuracy is irrelevant because everything is relative only to my garden. You are surveying and so looking for accuracy, which is a much harder subject.
The 7th decimal place represents about 11mm, which is better than what chartered surveyors expect (mine said that precision better than 2cm is simply unrealistic). From a legal standpoint, every country has it’s own reference system which uses fixed points from which to make measurements; in Switzerland the reference is the Pierre du Niton. If you wanted survey with a GPS in Switzerland, you would take your GPS onto that rock, calibrate your GPS by telling it that it’s at 46°12′20″N,6°09′15″E and then work relatively to that point.
Assuming your requirement is to differentiate your property from your neighbour’s, consider this: You erect a fence with the wire exactly (sub-mm accuracy) on the boundary. If the wire is in the middle of the fence post and the post is 5cm in diameter, 2.5cm of your fence post is infringing on your neighbour’s property. The point I’m trying to make here is that in real-world applications, accuracy below some 10cm starts to lose meaning. In addition, for accuracy better than that, you’ll need to take into account the altitude, gravity, tectonic plate movements, possibly tides and so on.
This lively discussion is well worth reading and xkcd’s tongue-in-cheek definition puts it rather well:
Now, like you, I find the intellectual exercise of getting your own personal sub-cm accuracy as very interesting and the question is: how to determine the base station’s true location? You have no way of knowing this truth factually because you cannot verify it, however you can make a good approximation. Let us assume that the entire GPS system is accurate. We know that it’s precision wanders due to ionospheric/tropospheric delays, etc. By averaging many measurements (using UBlox’s Survey-In function), we can reduce the accuracy error. In turn, for this to work, the measurements must have a Gaussian distribution. Over short periods (hours) the readings are not gaussian due to the changing geometry of the constellation during a 24-hour period. However, over days, they do become gaussian and the method becomes valid. So, run a Survey-In setting the survey time to several days, and the required accuracy to 10cm (don’t set it lower, because both have to be satisfied for the survey to succeed). When it finishes you’ll get an estimate of the accuracy, which will hopefully by sub-mm.
A word of warning: I tried this and there seems to be a bug: If the number of survey readings exceeds 65’535, it wraps to zero. Let me know if you have more success?
Great post. The hardware is pretty awesome. The sheer number of option is a bit intimidating at first, but after reluctantly consulting the great User Guide, setting up the BASE/ROVER was easy. But to those still struggling, “There is nothing to fear, but fear itself”. My remedy was read the manual and watch a lot of Youtubes.
Beware if you ever change something, it may take a month of looking at the millions of combinations to fix it.
I use my units for surveying our property with a UI on the ROVER provided by an Arduino. Just getting the Arduino and C94 to talk was a long journey, but once you get it, the hardware is very reliable. Getting 7 decimal place accuracy on an Arduino (single point floating precision) was kinda interesting. I also have a solar powered BASE station with the ROVER on-a-pole. I also changed both GPS antennas to GARMIN GA-38 too, and also the UHF on the BASE to a LORA. With an RTK FIX, the accuracy was better than 1cm.
(BTW, I used very short COAX with the GA-38’s. Even though they are active antennas, using the mile of COAX that came with the antennas is not good for L-Band).
My only knock on the system is how long it takes to get an “RTK FIX”, if at all. Some of the locations on the property are shrouded by trees and this often results in a FLOAT.
Short of cutting down the trees, does anyone have a strategy for improving this ?
I use Google Earth to create WAYPOINTS which I can then go and find with the ROVER, but it’s not very accurate. One probem i do have is to accurately (7 places) locate the BASE. Any help there would be much appreciated.
No, I reviewed a C94-M8P, the simpleRTK2B is a ZED-F9P, a more recent model.
Your report is really awesome. I am just at the beginning of RTK journey and would like to know if you tested simpleRTK2B and how it compared to the current report findings…
I don’t know, but the UBlox forum has some experts that might be able to help
https://forum.u-blox.com/index.php/7182/how-to-get-raw-data-for-rinex-from-neo-m8p
Thank you for an excellent post. I am interested in getting raw-data from the board. It is mentioned in your article that,
“The raw GPS data from the receiver contains latitude/longitude values.”
I was more interested in getting raw data as in code-phase, carrier-phase and raw Doppler measurements. Is the board capable of providing them as well
Using the supplied puck antennas, I never managed to get an RTK fix, even in ideal conditions.
Using the GA38 I get consistently good results, so yes, the GA38 makes a big difference *for RTK*.
Thank you for an excellent and helpful article. I hope the lawnmower is doing good work for you. I am setting up a C94-M8P for local surveying.
I bought pair of GA38s but did not really find much improvement when compared to the UBlox puck antenna with ground plane, both in an open sky situation. Both antennas were used on my base station module so not attempting to do an RTK fix.
Results were:
GA38: TTFF 23 seconds, 18 of 22 satellites used, average signal strength 43dB, HDop 0.7
Puck : TTFF 18 seconds, 19 of 23 satellites used, average signal strength 44dB, HDop 0.7.
I wondered why you concluded that the GA38 was better. Did you do a comparison like this?
Ah! I missed that, great new, thank you.
Hi all,
You might want to retry your tests with the new u-blox ZED-F9P, which solves most of the limitations you have seen with M8P. There’s an easy to use evaluation board “simpleRTK2B”.
Best regards.
Thanks for the excellent post. I’m working on a mower project too (large area, almost 20000sqm without much obstruction so I think the solution will be great compared to a fence wire).
Could you give some hints on what you use for the rest of the system? Mapping, control, sensor fusion setup etc. My current approach is based on ardumower, but I’m unsure how to merge the gps solution with the ardumower (arduinobased) setup.
Thanks!
The purpose of a ground plane is to minimise reflections from the ground. Typically this happens in vehicles on roads, the tarmac reflects radio waves. My test were performed in a garden; grassy soil doesn’t reflect radio waves so I don’t think a ground plane would improve things.
The C8P DOES use other constellations, in this case GLONASS and this is visible in the screenshots. As you rightly observe, Beidou is of little use in Europe and Galileo is not yet functional (it’s supposed to come online in 2020). The C8P already has full support for Galileo builtin, see page 11 of the User Guide.
I’m not sure what ‘clearly defined obstructions’ could be, but if you perform such tests, I’d love to see the results.
Hi. i’m Matias from Chile, i just want to thank you because i’m developing the same kind of project, an autonomous mower, i was looking for this kind of information about the rtk gps specifically from the ublox mp8p that you posted but i was thinking, nah, nobody is going to take the time to upload all this tests, but you did! thank you very much! i owe you a beer!
Thanks for the great post. However it seems like you have not use any ground plane for your base station’s antenna and the Garmin GA 38 does not seem to have one integrated. May it be the reason for the quite long time to fix (about 30 minutes is quite long even for L1 system)?
I very much appreciate the test with obscured sky. Another GNSS constellation like Galileo (or even Beidou has partial Europe coverage – about 40% of the time) could probably help even more. Pitty M8P can not do at least Galileo.
It is interesting that the FIX mode does not really seems to guarantee much better solution then float – latlon mean of your Sky180 is better than both Sky270 and updated Sky360. Would be interesting to re-run the tests in open field with clearly defined obstructions (your garden was not 100% ideal in obstructions).