How to Read RTK Quality Indicators: Practical Explanation of HDOP / PDOP / RMS

Table of Contents

• What are "quality indicators" in RTK positioning?

• What is HDOP (Horizontal Dilution of Precision)?

• What is PDOP (Position Dilution of Precision)?

• What is RMS (Root Mean Square)?

• Practical checkpoints for using RTK quality indicators

• Achieving simple, high-precision surveying with LRTK

• FAQ

What are "quality indicators" in RTK positioning?

In GNSS surveying using RTK positioning (Real-Time Kinematic), it is possible to determine position coordinates with centimeter-level accuracy. However, high precision is not always guaranteed. At survey sites, several indicators are displayed to evaluate the "quality" of the obtained position information. Typical indicators include the DOP values such as HDOP and PDOP, and the RMS value (standard deviation of error). By correctly reading these quality indicators, you can judge in real time whether "the data being measured now is trustworthy," and on-site you can exclude or mitigate positioning results with large errors.

For example, GNSS receivers and dedicated apps display solution types (solution status) such as `FIX` or `FLOAT` together with numerical DOP and RMS values. Although these look like technical abbreviations at first glance, understanding their meanings lets you intuitively grasp the quality of the positioning. This article explains the RTK positioning quality indicators HDOP, PDOP, and RMS from a practical perspective and summarizes how to use them to perform high-accuracy surveying.

What is HDOP (Horizontal Dilution of Precision)?

HDOP (Horizontal Dilution of Precision) is an indicator representing the "horizontal precision degradation" in GNSS positioning. Simply put, it quantifies how the satellite geometry affects horizontal position accuracy. As with DOP values in general, a smaller value is better, and a larger value indicates degraded positioning accuracy.

The HDOP value is determined by the configuration (geometric spread) of the satellites visible in the sky. The more evenly satellites are distributed across the sky, the stronger the geometric configuration and the lower the HDOP value. Conversely, if satellites are biased to one direction or concentrated overhead, the geometry is weaker and HDOP increases. In extreme cases—satellites clustered near the zenith or very few satellites visible—HDOP can spike and horizontal position errors can become large.

As a guideline for HDOP values, the general evaluation is as follows:

• HDOP ≤ 2.0: Satellite geometry is good; high-precision positioning is expected

• HDOP around 2–5: Reasonable accuracy, but caution may be needed depending on the use

• HDOP ≥ 5: Unfavorable satellite geometry; accuracy degradation is a concern

For example, if HDOP exceeds 5 during RTK surveying, it is recommended to look for a more open area or wait for a different time when satellite geometry improves. Especially for surveys that require high precision, measuring at times and in environments with low HDOP will yield more stable results.

What is PDOP (Position Dilution of Precision)?

PDOP (Position Dilution of Precision) indicates the "position (3D) precision degradation." While HDOP is an indicator for horizontal precision only, PDOP represents the impact of satellite geometry on the accuracy of the full three-dimensional position, including height. Like HDOP, smaller PDOP values are preferable and larger values indicate degraded overall position accuracy.

Strictly speaking, PDOP is calculated from HDOP and VDOP (vertical dilution of precision), and there is the relationship PDOP² = HDOP² + VDOP². Therefore, PDOP is generally larger than HDOP (because it also includes height-direction error components). For example, even if horizontal satellite geometry is very good and HDOP is about 1.5, PDOP will generally be roughly √(1.5² + VDOP²) because the vertical geometry tends to be weaker.

The desirable PDOP value depends on the application, but for high-precision positioning PDOP < 3–4 is generally preferred. Many RTK receivers and positioning software allow you to set an upper PDOP limit (mask value) and refrain from positioning when this is exceeded. On-site, it may be necessary to temporarily suspend surveying when PDOP increases significantly. Causes of high PDOP are similar to those of HDOP—insufficient number or poor distribution of usable satellites. Be especially careful in places with restricted sky views such as near buildings or in mountain shadows, where PDOP may deteriorate temporarily.

As a practical relationship between HDOP and PDOP, for daily quality control it is useful to remember: check HDOP for horizontal precision and PDOP for overall positioning precision. While horizontal position is often most important in surveying, monitor PDOP when 3D accuracy including height is required.

What is RMS (Root Mean Square)?

The RMS (Root Mean Square) value is an indicator representing the standard deviation of error in GNSS positioning. Simply put, it quantifies the spread (precision) of the estimated position, and is often displayed as a reliability indicator for positioning results. RTK receivers and positioning software may show something like "Current accuracy: horizontal ±○○ cm (RMS)."

RMS is equivalent to the statistical standard deviation and corresponds to the 1σ (one sigma) of positioning errors. For example, "horizontal ±1 cm (RMS)" theoretically means there is about a 68% probability that the true position lies within 1 cm (assuming the error distribution is normal). In RTK positioning, when a FIX solution is obtained, an RMS value below a few centimeters indicates high-precision positioning. Conversely, in FLOAT solutions or when there are too few satellites, RMS values increase and position uncertainty grows.

Note that a small RMS value does not guarantee absolute correctness. RMS is an internally estimated error by the receiver; when error sources that are hard to model—such as multipath or signal blockage—are present, actual errors can exceed the RMS estimate. For example, in an "urban canyon" surrounded by tall buildings, the receiver may report an RMS of a few centimeters while multipath causes actual errors of several tens of centimeters. Thus, RMS is useful as a current solution precision indicator, but it should not be trusted blindly and must be considered together with the environment.

As a practical rule of thumb in RTK surveying, horizontal RMS within a few centimeters is a sign of good conditions. For example, if you consistently see "horizontal RMS = 0.01 m (0.03 ft) (1 cm (0.4 in))" or "vertical RMS = 0.02 m (0.07 ft) (2 cm (0.8 in))", the system is performing well in practice. Conversely, large RMS values (for example horizontal 0.1 m (0.3 ft) = 10 cm (3.9 in) or more) indicate potential problems.

Practical checkpoints for using RTK quality indicators

When performing RTK surveying on-site, you can ensure data quality by comprehensively checking the quality indicators described above. The main practical checkpoints and countermeasures are summarized below.

• First, check the solution type (FIX/Float): In RTK, obtaining a "FIX solution" is the fundamental prerequisite for high precision. Always ensure the receiver or app indicates the solution is `FIX`. If it temporarily shows `FLOAT`, `DGPS`, or `SINGLE` and accuracy is degraded, you should promptly eliminate the cause (e.g., move away from surrounding obstructions, re-receive correction data from the base station).

• Monitor DOP values (HDOP/PDOP): During positioning, DOP values change as satellite geometry changes. Be cautious when HDOP rises above 5 or when PDOP grows larger than usual. This can indicate temporary deterioration or reduction in satellite geometry; if necessary, it may be effective to temporarily suspend surveying and wait for improvement. For example, rather than forcing measurements under building shadows where satellite numbers are reduced, moving to a more open spot or waiting a few minutes for better satellite geometry can yield higher-quality data.

• Check RMS values and verify with known points: Even with a FIX solution and low DOP, environmental factors can still cause large errors, so monitor the RMS. If displayed RMS is obviously large or fluctuates, be cautious about data accuracy. If possible, measure a known control point on-site (a point with accurately known coordinates) to see the actual error. If the measured coordinates deviate from the known true values by only a few centimeters, that is reassuring evidence the system is functioning correctly. Another method is to measure the same point multiple times and observe coordinate scatter. If repeated measurements of the same point differ by more than a few centimeters, some problem (environmental factor or device setting) may be present.

• Optimize satellite count and GNSS configuration: DOP values and maintaining a FIX solution are greatly affected by the number and distribution of usable satellites. Use multi-GNSS (not only GPS but also GLONASS, Galileo, QZSS, etc.) capable receivers and settings to increase the total number of satellites and reduce DOP. Also, do not set the receiver’s elevation mask too high. Generally, using satellites down to about 15° elevation helps balance horizontal accuracy (HDOP). Setting the mask angle too high reduces satellite count and can worsen DOP.

• Be mindful of distance from the reference station: Although not a single quality indicator, in RTK the baseline length from the reference station is known to gradually degrade accuracy as distance increases. Roughly speaking, being within 10 km (6.2 mi) of the reference station is ideal; beyond that, it can take longer to obtain a fixed solution and errors may more easily expand to several centimeters. Network RTK (VRS) automatically provides a nearby virtual reference station, but if you set up your own reference station, choose a location as close to the work area as possible.

• Countermeasures for multipath and signal blockage: In urban areas or forests, multipath (reflections) from building facades or trees and signal blockage are common causes of accuracy degradation. Place the antenna in as open a location as possible, and keep it away from reflective objects such as metal fences, vehicles, or large machinery. This helps stabilize DOP and RMS values and leads to more reliable data acquisition.

Based on the above points, make a habit during RTK surveying of always asking: "Is the solution FIX? Are DOP values acceptable? Are RMS values within tolerance?" Monitoring quality indicators in real time and taking immediate countermeasures on-site greatly reduces the risk of returning with data that is less accurate than expected.

Achieving simple, high-precision surveying with LRTK

High-precision RTK surveying requires attention to satellite geometry and device settings as described above. However, recently tools that make RTK positioning easier to use have emerged. A representative example is the next-generation compact RTK solution called the LRTK series. LRTK was developed to enable centimeter-level positioning anytime, anywhere, and by anyone, and its devices significantly miniaturize and simplify traditional RTK equipment.

Features of LRTK

• Pocket-sized integrated RTK terminals: LRTK series terminals integrate receiver, antenna, battery, and communication module into a compact design. For example, the smartphone-mountable "LRTK Phone" contains a high-precision GNSS receiver in a device weighing about 125 g and with a thickness of about 13 mm (0.51 in). This small, lightweight form factor enables a "one-person, one-unit" surveying tool that can be carried and used whenever needed.

• Simple operation: LRTK pairs with a dedicated smartphone app and is designed to perform RTK positioning with intuitive operation. Connect to the phone via Bluetooth, follow the app guidance, and you can go from starting positioning to recording points without complex GNSS settings or specialist knowledge. For example, tapping a button at the point you want to measure acquires and saves coordinates, and results are displayed in real time.

• Stable high-precision positioning: LRTK devices incorporate the latest GNSS technologies and are engineered to consistently achieve centimeter-grade `Fix` solutions. Multi-frequency receivers reduce ionospheric delays and multipath effects, and some models support Japan’s QZSS centimeter-class augmentation service (CLAS). This allows high precision to be maintained even in mountainous areas where the internet is unstable, relying solely on satellite augmentation signals. Some models also include tilt compensation, automatically correcting coordinates when the pole tip is tilted. The dedicated app lets users monitor `FIX`/`FLOAT` status and DOP values, allowing beginners to check quality indicators and survey with confidence.

The advent of LRTK has made centimeter accuracy surveying—previously achievable only by expert surveyors with expensive equipment—much more accessible. On-site positioning work becomes dramatically easier, and quality indicator monitoring and data sharing are seamless via app and cloud integration. For beginners and experts alike, LRTK enables stable high-precision surveying and represents a new, simplified surveying style.

As RTK positioning demand and field adoption grow, solutions like LRTK are expected to greatly contribute to improving the efficiency and quality of surveying work. Making high-precision positioning more accessible—LRTK is a key technology to that end.

FAQ

Q1: What do HDOP and PDOP each mean, and how do they differ? A1: HDOP stands for Horizontal DOP and indicates the horizontal position precision degradation due to satellite geometry; PDOP stands for Position DOP and indicates the overall 3D position precision degradation. HDOP is an indicator for the horizontal plane, while PDOP includes height. PDOP is calculated from HDOP and VDOP (PDOP² = HDOP² + VDOP²), so PDOP is generally larger. Both are better when smaller; check HDOP for horizontal-precision-focused tasks and PDOP for overall precision management.

Q2: What are "FIX solution" and "FLOAT solution"? A2: In RTK positioning, `FIX` (fixed solution) means the integer ambiguity of carrier-phase cycles has been resolved. When `FIX` is obtained, centimeter-level accuracy can be expected. `FLOAT` (floating solution) means the ambiguity is not fully resolved and the solution is unstable; accuracy is typically on the order of tens of centimeters to about 1 m, and centimeter accuracy is not achievable. In practice, ensuring measurements are taken with a FIX solution is a prerequisite for high precision. During measurement, always monitor the solution status and, if it becomes `FLOAT`, check satellite conditions and correction-data reception to restore `FIX`.

Q3: What does RMS mean, and what values indicate high precision? A3: RMS represents the standard deviation of positioning errors and quantifies the spread (precision) of measured coordinates. Smaller RMS values indicate more stable and higher-precision results. In RTK surveying, horizontal RMS below a few centimeters is considered high precision. For example, a stable horizontal RMS of 0.01 m (0.03 ft) (1 cm (0.4 in)) is excellent. However, RMS is a theoretical value estimated by the receiver, so in some environments actual errors can be larger despite a small RMS. Therefore, treat RMS as a guideline and evaluate it together with DOP values and the surrounding environment.

Q4: Up to what DOP values is it acceptable to continue RTK surveying? A4: There is no strict universal standard; it depends on measurement objectives. For high-precision tasks, HDOP should be ≤ 5, preferably ≤ 2–3. For PDOP, which includes vertical, keeping it roughly ≤ 6 (preferably ≤ 4) is ideal. If HDOP exceeds 5 or PDOP worsens to 6–8 or more, accuracy degradation is a concern. In such cases, do not continue forcing measurements—either wait for satellite geometry to improve or change the measurement environment. Most GNSS receivers allow you to set limits such as "measure only when PDOP < ○○", so configure these according to your quality standards.

Q5: What should I do when RTK does not achieve the expected accuracy? A5: First, isolate the cause. (1) Check satellite reception conditions: ensure the number of usable satellites has not dropped significantly and that there are no obstructions around the antenna. Moving the antenna slightly to a position with a clearer sky view can sometimes restore `FIX`. (2) Check reception of correction data from the base station (radio/NTRIP). If communication is interrupted, try reconnecting or moving to a location with better reception. (3) Reset device settings: switch once back to single positioning and then back to RTK, restart the receiver, or switch the base station to a public service. (4) Consider hardware faults: inspect antenna cables for looseness or breaks, clean and reconnect connectors—this can often resolve issues. If nothing improves, consider moving the measurement location; relocating to a more open sky may readily restore `FIX`. The important point is not to stand idle for long—try potential countermeasures in sequence. The more options you have, the calmer you can be when problems occur.