Smartphone RTK Makes It Possible! Easily Record Rail Deformation with On-the-Spot Point Cloud Measurement

Thanks to rail point cloud measurement using a smartphone combined with RTK-GNSS, an era is approaching in which slight rail deformations, settlements, and track alignment deviations can be detected and recorded on site instantly. In track maintenance, early detection and repair of rail distortions is key to safe operations, but traditionally inspections have relied on periodic runs of track inspection vehicles or visual checks and measurements by workers. Large inspection vehicles can only be deployed between train services, and manual patrol inspections require significant time and manpower. For example, measuring the track alignment (lateral deviation) traditionally required a craftsman’s method such as stretching a 10 m (32.8 ft) line along the rail side and measuring the gap at the center with a ruler. Furthermore, because such periodic inspections are limited in frequency, there is a risk of missing minute deviations that occur between inspections.

In recent years, point cloud data has attracted attention as a new method to solve these problems. By acquiring the shapes of rails and surrounding track structures as point clouds (many 3D coordinate points) using laser scanners or cameras, the overall distortion can be understood in detail. Moreover, with the combination of smartphones and compact RTK-GNSS receivers, anyone can increasingly perform high-precision rail point cloud measurement easily. Aligned with DX initiatives such as the Ministry of Land, Infrastructure, Transport and Tourism’s i-Construction, expectations for smart maintenance using 3D point cloud data in the railway sector are rising. This article clearly explains the mechanism of centimeter-level point cloud measurement with smartphone RTK, its application to rail deformation detection, and the flow of data utilization and on-site support using AR technology, covering the latest trends in railway maintenance DX.

Rail Point Cloud Measurement with Smartphone + RTK-GNSS for Centimeter-Level Precision

By combining a smartphone with RTK-style GNSS positioning, you can easily 3D-scan the area around rails and generate point clouds with centimeter-level precision (half-inch accuracy). RTK-GNSS is a technique in which both a base station (reference point) and a rover perform satellite positioning simultaneously, and the correction information from the base station dramatically improves positioning accuracy. Previously this was only available with expensive surveying equipment, but the emergence of ultra-compact RTK receivers in recent years has made RTK positioning possible with smartphones. By attaching an external small antenna module (e.g., an RTK-GNSS receiver) to the smartphone and receiving reference station data via network, the smartphone itself can perform real-time high-precision positioning with errors of only a few centimeters.

Separately, some of the latest smartphones are equipped with an optical sensor called LiDAR. LiDAR uses infrared laser reflections to rapidly measure distances around the device, and on some models such as the iPhone it can continuously scan the environment up to several meters (several ft) away. If you hold up the smartphone and walk along the rails, sleepers, and ballast, their shapes will appear on the screen in real time as a collection of countless points (a point cloud). While the smartphone’s 3D scanning function itself is intuitive and easy to use, by itself it cannot assign absolute coordinates (latitude/longitude or map coordinates) to the captured point cloud, leaving the data’s spatial location ambiguous. Also, small accumulated errors during smartphone movement can produce distortion across the entire point cloud.

By linking the smartphone’s LiDAR scan with RTK positioning, these issues are resolved. Attaching an RTK-GNSS receiver to the smartphone and continuously measuring its position with centimeter accuracy while scanning the rails with LiDAR allows each captured point in the point cloud to be given precise 3D coordinates in real time. For example, coordinates based on the World Geodetic System can be assigned instantly to each point on the rail surface. As a result, even if you scan while walking around, the point cloud data does not become distorted, and the whole dataset is obtained aligned to the real geodetic coordinate system. Even in situations where satellite signals are temporarily interrupted (under bridges or near tunnel entrances, for example), there are measures to maintain data consistency using the smartphone’s built-in inertial sensors and scan-data registration. There is no need to worry about complex post-processing or coordinate transformations; anyone can obtain precisely georeferenced point clouds without specialized knowledge.

A black cylindrical device attached to the top of the smartphone is the RTK receiver. When you launch a dedicated app in this configuration, the smartphone screen displays the LiDAR scanning view. The point cloud being captured on site is shown in real time, allowing you to confirm shapes such as bridge railings or road surfaces as collections of points. After capture, you can measure the distance between any two points or calculate areas and volumes right on the same smartphone. The convenience of completing everything from point cloud capture to various calculations on site without bringing a laptop or specialized software is a major advantage. This smartphone + RTK point cloud measurement is truly a “3D surveying instrument that fits in your pocket.” It is easy to carry because it requires only a smartphone and a receiver weighing just a few hundred grams, so you can take measurements whenever needed. Without preparing expensive laser scanners or surveying drones or hiring a professional survey team, you can create 3D data of the site with your own hands.

Workflow to Instantly Detect Rail Deformation and Settlement with Point Clouds

With smartphone RTK-based rail point cloud measurement, abnormalities in the track can be found directly from the scanned data. Below is the overall flow from scanning to detecting rail distortion with point clouds.

• Preparation for Measurement: Attach the RTK-GNSS receiver to the smartphone and launch the dedicated app. Connect to base station data (network RTK services, etc.) and ensure the positioning state is Fix so centimeter-level precision (half-inch accuracy) is achievable. If you will align to known points such as the start point of the section to be inspected, perform that reference alignment at this stage.

• Scanning the Rails: Walk along the track section you want to measure while scanning the area around the rails with the smartphone’s LiDAR. The smartphone screen will render the rails, sleepers, and ballast (trackbed) as a point cloud in real time. Adjust your walking speed as needed and orient the smartphone to capture the entire rail area evenly. Be careful when scanning sections with large elevation changes or curvature to ensure continuous data capture.

• Real-Time Detection: While scanning, check the point cloud data on site. The point cloud being acquired can be viewed from arbitrary viewpoints on the smartphone, allowing intuitive understanding of rail height changes and track displacement. For example, if a rail has settled near a certain sleeper, that portion of the rail will display lower on the point cloud, making the anomaly obvious at a glance. If you overlay the app with the design height or alignment line of the reference rail, you can immediately determine whether deviations exceed allowable limits. Simple analysis functions such as color-coded heat maps can visually indicate elevation differences or alignment deviations on the point cloud.

• Data Saving and Comparison: After scanning is complete, save the point cloud data on the smartphone. By uploading it to internal systems or GIS via cloud integration, you can quickly compare it with past inspection data and drawings. On site you can overlay current and previous data to quantify settlement amounts or distortion progression since the last inspection. Such immediate comparisons allow on-the-spot understanding of anomaly trends and help prioritize repair work.

Labor Reduction Achieved by On-Smartphone Field Measurement

Smartphone and point cloud measurement promise significant labor savings for rail inspections. Track surveys that once required specialized teams or heavy equipment can be completed with a single smartphone, reducing on-site burden. The labor-reduction effects of smartphone RTK point cloud measurement are summarized below.

• Completable by Few Personnel: With only a smartphone and a compact RTK receiver, one person can measure track conditions. Tasks that formerly required backup from a surveying team can be performed by the on-site staff alone, reducing personnel coordination. Measuring multiple locations in parallel also becomes easy, improving personnel efficiency.

• Time Savings with Immediate Processing: Measurement data can be analyzed and saved on site, eliminating the need to bring it back to the office for processing. Because displacement calculation can be done on the spot from point cloud capture, report creation that used to take several days can be completed the same day. Faster feedback of measurement results accelerates the PDCA cycle of repair planning.

• No Special Skills Required: Intuitive operation of smartphone apps makes point cloud measurement accessible even to non-expert surveyors. Complex coordinate calculations and device settings are automated, so with brief training anyone can perform high-precision measurements. This is effective as a countermeasure against workforce shortages due to a decline in veteran technicians.

• Improved Safety: Reduced equipment setup and shorter durations of on-track work lower risks for maintenance personnel. Short-duration, small-team inspections allow necessary data to be collected while minimizing impacts on train operations. Shortening nighttime work hours also reduces worker burden and enhances safety.

• Cost Reduction: Initial investment costs are dramatically lower compared to conventional 3D surveying equipment. (Traditional track inspection vehicles and 3D laser scanners required equipment investments in the tens or hundreds of thousands of dollars, whereas smartphone surveying equipment can be obtained at a small fraction of that cost.) Because it is extremely inexpensive, providing “one per person” to field staff is also realistic. By reducing outsourcing to external surveying companies, further cost savings can be expected, leading to significant mid- to long-term cost benefits.

In these ways, smartphone-complete point cloud measurement greatly contributes to on-site labor reduction and efficiency. Promoting DX (digitization) will provide a tailwind for work-style reform even in railway maintenance.

Improving Maintenance Efficiency by Comparing with Existing Drawings/Models and Cloud GIS

Captured point cloud data becomes even more useful when compared with existing design information and past data. For example, if you have drawing data (CAD drawings or BIM models) indicating the design position and height of the rails, overlaying those with the point cloud allows quantitative evaluation of deviations from the design. Color-coding deviations on the point cloud reveals the distribution of misalignment at a glance, enabling efficient prioritization of repair locations under limited resources.

Storing point cloud data in a cloud GIS (geographic information system) or maintenance management system also makes it easy to monitor changes over time and share data across departments. If a section of rail is gradually settling, comparing periodically captured point clouds can produce a graph of settlement progression. Trends that were easy to overlook with paper records or numeric data can be intuitively grasped with 3D data. Because you can measure dimensions and extract cross sections from the point cloud, track gauge (distance between left and right rails) or cant differences (height difference between left and right rails) at arbitrary locations can be readily calculated digitally. Detailed assessments can be made from the desk without visiting the site.

Sharing point cloud data within a railway operator allows not only the track department but also civil engineering and equipment departments to have a common understanding of current conditions. For example, if you scan surrounding structures and catenary positions together with the rail area, you can consider track displacement in conjunction with other equipment conditions. Such data linkage promotes cross-departmental collaboration and speeds up maintenance planning and response during abnormalities. By combining rail point clouds acquired with a smartphone with existing drawings and cloud platforms, the entire flow from inspection to planning and construction can be digitally connected, contributing to efficiency and sophistication in railway infrastructure maintenance. Accumulating such point cloud data also leads to the construction of a digital twin of track facilities, forming the foundation for initiatives such as preventive maintenance and remote monitoring.

Utilizing AR Technology for On-Site Guidance

When smartphone RTK point cloud measurement is combined with AR (augmented reality) technology, on-site task guidance becomes more intuitive. Digital information can be overlaid onto the real track view through the smartphone screen, strongly supporting inspection and repair work. Major use cases include:

• Coordinate Navigation: AR display can navigate you to points identified on the point cloud or drawings. For example, if you select coordinates of a section with significant settlement, the smartphone screen shows the direction and distance to that point with arrows or lines. Even spots that are difficult to locate by eye can be found accurately by on-site personnel using AR guidance.

• Overlay with Design Values: Virtual lines showing the ideal rail position and height can be superimposed on the camera image displayed on the smartphone. By comparing with the actual rail visually, you can instantly see how much lifting is required to meet the design or which direction to tighten to restore alignment. Tasks that used to rely on craftsmanship based on drawings or spirit levels can now be adjusted to millimeter precision with AR visual assistance.

• Visualization of Inspection Results: Parts of the point cloud where anomalies were detected can be marked and displayed in the real world. For example, sections where alignment deviation exceeds thresholds can be highlighted in red on the camera image, enabling reliable on-site confirmation of problem areas. After repair, re-scanning and AR display allow immediate verification of repair effectiveness.

By combining AR with high-precision positioning, you get on-site support that makes issues “visible at a glance.” Adjustment work that relied on experience and intuition becomes based on numerical data, shortening work time and improving quality.

Field Implementation Example: Rapid Detection of Track Settlement with Smartphone Point Clouds

A regional railway trialed smartphone RTK point cloud measurement for post-heavy-rain track inspections. Normally this work would require several people and half a day using visual checks and levels, but one person conducted a 3D scan along the track during nighttime suspension of service. They captured point cloud data for approximately a 200 m (656.2 ft) section in just about 15 minutes.

Checking the smartphone on site revealed that the left and right rails were gently settling at a certain point on the point cloud. On-site analysis showed a maximum settlement of about 20 mm (0.79 in) around the 50 m (164.0 ft) mark—an amount slightly exceeding management criteria. This was a minute displacement that would have been difficult to notice by eye, but the point cloud cross section clearly visualized the rail deflection.

The on-site staff shared the data with headquarters engineers via the cloud and immediately discussed whether repair was necessary. The following morning, train speed reductions for that section and temporary ballast filling were implemented, allowing response before serious consequences occurred. Traditional methods might have delayed discovery of the settlement and affected train operations, but this is an excellent example in which rapid anomaly detection using smartphone point clouds helped prevent damage escalation.

In this case, high-precision data captured with a single smartphone linked real-time on-site judgment with headquarters support. Field staff experienced the effectiveness of smartphone RTK point cloud measurement, and full-scale adoption in regular patrol inspections is now being considered.

Conclusion: A New Era of Rail Inspection Opened by Smartphone RTK Point Cloud Measurement

Rail point cloud measurement using smartphones and RTK-GNSS is set to bring major change to railway maintenance. With anyone now able to easily acquire and analyze the track’s 3D data, benefits are emerging not only for safety but also for operational efficiency and cost. Inspections for track misalignment, previously dependent on the experience of a limited number of specialists, are shifting toward objective, data-driven decisions. There have been reports of early detection of track settlement on the order of a few centimeters (a few inches) using smartphone point cloud measurement—displacements that were previously overlooked by visual inspection—leading to prompt repairs.

In response to this trend, smartphone RTK solutions known as LRTK have recently appeared. Consisting of a small device attached to a smartphone and a dedicated app, they provide an all-in-one system for centimeter-level positioning, point cloud measurement, cloud recording, and AR composite display on site. Adoption is progressing in construction and infrastructure inspection fields, and railway companies are also taking notice.

DX in rail maintenance will accelerate further. With smartphone RTK, easy high-precision inspections can capture anomalies without fail and enable prompt response—this new maintenance style is beginning to become reality. As technology advances further, AI-driven automatic analysis and integration with AR glasses will enable even smarter and more advanced track management. For the sake of railway safety and efficiency, please pay attention to this cutting-edge method of rail point cloud measurement using smartphone RTK. The day when you can monitor track conditions with a smartphone in hand may not be far off.