How Smartphones × Photogrammetry Are Changing Field Work: Instantly Checking Point Clouds with AR

Digital technology is advancing in the construction industry, bringing innovations to on-site measurement and management methods. Among these, the use of point cloud data from a smartphone × photogrammetry and the ability to perform immediate checks with AR (augmented reality) are dramatically changing traditional field work. Three-dimensional measurement that once required specialized 3D scanners and advanced skills can now be achieved with a handheld smartphone and simple devices. This article explains the basics of photogrammetry and point cloud data, and presents the latest workflow for capturing point clouds with a smartphone and displaying them in AR on site. We introduce use cases such as as-built verification, construction navigation, maintenance management, and infrastructure inspection, and explain the benefits of adoption including convenience, prevention of construction errors, faster decision-making, and improved safety.

What are Photogrammetry and Point Cloud Data? Their Value on Construction Sites

Photogrammetry, also called photographic surveying, is a technology that reconstructs the three-dimensional shape of an object from multiple photographic images. By photographing a subject from various angles and analyzing common points, it generates point cloud data and 3D models. Point cloud data are collections of many points that make up the surface of an object or terrain, with each point having X, Y, Z coordinates (and color information) in real space. In other words, it is “a digital copy of real space,” and unlike photos or plans it records depth and shape information that cannot be captured otherwise.

Point cloud data are increasingly used across construction and civil engineering. For example, in current-condition surveys, where surveyors used to painstakingly measure points one by one with a total station, laser scanners and drone photogrammetry can now acquire large areas of terrain in a short time. In as-built management, the entire structure can be recorded as a point cloud after construction and verified/saved in 3D to confirm compliance with design. Drawings and photos only capture key points, but point clouds allow a digital archive of the completed object as-is, which is useful for future renovation planning. In construction management, regularly scanning the site during work and tracking progress with point clouds can streamline quantity management and shape deviation checks. For maintenance management, periodic point cloud measurements of bridges and tunnels make it easy to compare aging changes and objectively detect signs of cracking or deformation. In this way, point cloud data are becoming an increasingly important “3D record of the site” that powerfully complements traditional drawings and photos.

There are many advantages to using point cloud data. First is intuitive 3D visualization. A colorized point cloud displayed on a screen gives a photo-like realistic three-dimensional view, allowing immediate understanding of site conditions including depth. New staff or clients unfamiliar with reading drawings can more easily share spatial images by viewing a 3D model. Next is the ability to perform high-accuracy measurements. On a point cloud, distances, areas, and volumes between arbitrary points can be measured freely, offering greater accuracy and fewer human errors than tape measures or manual calculations. Another major benefit is comprehensive information coverage. Once acquired, a point cloud contains data of every nook and cranny of the site, reducing worries like “we forgot to measure that part,” and making it easy to extract cross-sections or perform additional analyses later for secondary use. Against this backdrop, the Ministry of Land, Infrastructure, Transport and Tourism’s promotion of 3D technologies under “i-Construction” is a tailwind, and point cloud data are becoming key to on-site DX.

Easily Obtaining 3D Point Clouds with a Smartphone

In the past, high-precision point clouds required expensive laser scanners or special surveying equipment. Recently, however, smartphone performance improvements have made it possible to perform 3D scans easily with a smartphone. For example, some of the latest iPhone models include a small LiDAR sensor; by waving and walking with it, you can obtain point clouds of several million points. It’s truly a revolutionary feature that lets you digitally record site shapes with the same ease as shooting video on your phone. Even without LiDAR, a smartphone can create 3D models using photogrammetry by taking multiple photos with the camera. Recently, apps that automatically generate 3D models from photos on the smartphone itself have appeared, and what used to require PC processing for photogrammetry can now be completed on site.

However, point clouds captured solely by a smartphone have had accuracy issues. Because built-in GPS can have positioning errors of several meters, a scanned site’s entire point cloud can be shifted, preventing accurate comparison with design drawings or other survey results. Also, smartphone AR-based pose estimation (SLAM) can accumulate errors over wide-area walking, causing point cloud distortion or scale drift. This lack of reliability made smartphone-acquired point clouds impractical for professional use, wasting the potential of easy 3D scanning.

What draws attention is high-precision positioning correction using RTK (Real Time Kinematic) and devices that enable smartphones to use it. RTK is a satellite positioning correction technology that dramatically reduces GPS errors by using correction signals from a reference station. In Japan, services like the Quasi-Zenith Satellite “Michibiki” provide centimeter-class augmentation service (CLAS), providing cm level accuracy (half-inch accuracy), making it possible to achieve astonishing positioning accuracy within a few centimeters without specialized knowledge. Recently, small GNSS receivers compatible with RTK can be attached to smartphones, enabling smartphones to perform centimeter-level positioning. The LRTK series from Reflexia is a representative example: by attaching the ultra-compact RTK receiver “LRTK Phone” for smartphones to an iPhone or iPad and using a dedicated app, your smartphone instantly becomes a pocket-sized surveying instrument. By simply snapping on a receiver weighing about 125 g and about 13 mm (0.51 in) thick, you can receive real-time correction information from satellites and have your smartphone continuously measure its position at centimeter-level accuracy. Typical errors are about 2-3 cm (0.8-1.2 in), but by averaging data even sub-1 cm (<0.4 in) accuracy can be achieved.

The smartphone + RTK device combination allows high-precision absolute coordinates to be assigned to every acquired point cloud. For example, when scanning pavement with an iPhone to create a point cloud, because LRTK is continuously correcting the device position to within a few centimeters, the position shifts or shape distortions that previously occurred in the whole point cloud do not happen. With these high-precision, coordinate-tagged point clouds, distance and thickness measurements yield reliable results. A smartphone thus transforms into a high-performance 3D measuring instrument comparable in accuracy to point clouds measured by specialized laser scanners.

Field measurement procedures are also very simple. Once connection settings to RTK correction information are completed, you only need to walk around holding the smartphone toward the object or area you want to measure. With one tap in the app, LiDAR scanning starts, and high-precision coordinates are recorded in real time for the captured point cloud. After a few minutes of walking, you can collect a sufficiently large point cloud. No special skills are required, and the fact that on-site staff themselves can perform measurements intuitively is a major advantage. Moreover, unlike before, complex post-scan point cloud processing on a PC is unnecessary; acquired data are automatically converted on site to known coordinate systems (plan coordinates and elevations). If needed, you can upload directly from the smartphone to the cloud for sharing, minimizing data handover effort. In short, “smartphone + LRTK” alone lets anyone immediately perform high-precision 3D measurement. It is revolutionary that a single person can obtain sufficiently accurate point clouds without carrying heavy tripods or expensive equipment. Site supervisors and foremen can casually “measure it themselves,” reducing waiting time for survey teams and relieving human-resource bottlenecks.

Instantly Checking Point Clouds in AR: Overlaying with the Real Thing on a Smartphone

The true value of smartphone-acquired point clouds is not just analyzing them in the office but being able to use them immediately on site. High-precision point clouds and 3D models with attached positioning information can be overlaid onto the real-world scene in AR. Through a smartphone or tablet camera, you can superimpose the captured digital point cloud onto real space, displaying virtual objects as if viewing through the real thing.

For example, with smartphone + LRTK point cloud measurement, since the acquired data are already registered in a global coordinate system (world coordinates), switching to AR mode on site will reproduce the point cloud precisely in the actual space. Even as you walk around the site, the virtual point cloud or 3D model follows the real object without lag. This is thanks to precise alignment achieved by RTK in addition to the smartphone’s pose tracking. The time lag from acquisition to visualization is minimal, so you can check the 3D data on the smartphone right after measuring and, if necessary, immediately re-scan any missed areas.

The greatest power of immediate AR checking is the ability to detect digital-to-real “misalignments” on the spot. By comparing point clouds to design drawings or BIM models, you can determine on-site whether after-construction structures conform to the plans, and the positions of temporary or buried items left on-site become obvious. Instead of comparing on a PC as before, AR allows you to overlay with the actual object on site, enabling you to point out problem areas, share them, and immediately instruct corrective work. For example, acquiring a point cloud after concrete placement and comparing it in AR with the design 3D model on a tablet instantly shows “which parts stick out how many centimeters compared to the design.” If you display deviations with a colorized heat map, you can intuitively judge whether they are within tolerances. This reduces previously time-consuming marking and re-measurement, speeding up quality checks and corrections. Point cloud use in AR is evolving from mere inspection records into a real-time decision-making tool for the field.

Main On-Site Use Cases (As-Built Verification, Navigation, Maintenance, etc.)

Displaying smartphone-acquired point clouds in AR enables various on-site applications. Here are the main use scenes in construction and infrastructure.

• As-built verification (post-construction quality checks): This is used to overlay a point cloud of the completed structure with the design 3D model to verify on site whether the finish matches the drawings. Comparing point clouds and design data in AR lets you immediately grasp “which parts deviate from the design and by how much.” Using a heat map makes overbuilt or depressed areas that exceed tolerances clearly visible by color, ensuring you don’t miss areas that need correction. Identifying defects on the spot and beginning corrective work shortens the inspection-to-fix cycle dramatically. As-built verification via point cloud × AR transforms quality inspection into a real-time quality improvement process.

• Construction navigation (survey guidance and layout support): High-precision AR technology can be applied to on-site layout tasks and machine guidance. For example, by importing design control points or final positions of structures into a smartphone as digital data and displaying “place a virtual stake here” in AR, workers can perform accurate layout by following the stakes or markings visible on the screen. Tasks that used to require experienced surveyors to set batter boards or mark lines can be performed accurately and intuitively even by less experienced workers with AR navigation. You can also display arrows or lines in smartphone AR to guide machine operators, or virtually visualize no-entry zones. Construction navigation combining high-precision positioning and AR will greatly contribute to labor savings and reduced human error.

• Maintenance management (buried asset management and equipment maintenance): Point cloud + AR are also effective for infrastructure and equipment maintenance. For example, recording the positions of buried water/sewer pipes and cables traditionally required photographing before backfilling or making hand-drawn diagrams. With a smartphone and photogrammetry, you can scan pipes during installation and save the point cloud, and even after backfilling “see through” in AR to visualize pipe locations and depths. By simply pointing a smartphone at the road, you can intuitively grasp the route of underground pipes on the screen. When that location needs to be excavated for later work, you can precisely identify buried assets without relying on experience or guesswork, preventing accidental damage to existing utilities. Additionally, if you link deterioration information to point clouds obtained in periodic inspections of completed structures, you can overlay past inspection records in AR on site. For example, in bridge inspections you can overlay previous and current point clouds in AR to compare whether cracks have grown since the last inspection. Compared with traditional inspections that carry paper drawings or photo logs, AR lets you directly compare digital records with the real object on site, speeding and improving situation assessment. In the future, advanced maintenance DX could include AR glasses worn by workers that display past data and repair instructions on the point cloud model.

• Infrastructure inspection (regular inspection and monitoring of infrastructure facilities): Point cloud data from photogrammetry are powerful for inspecting large-scale infrastructure such as roads, railways, and dams. If you overlay a point cloud model obtained by drone or ground photography onto the site via tablet AR, you can three-dimensionally reveal abnormalities such as cracks, subsidence, and displacement on the spot. Comparing point clouds over time to monitor deterioration progression or detecting deformation by comparing current point clouds with BIM models enables a new inspection style that fuses digital and field data. Inspection results can be stored as digital records for future repair planning and structural health assessment. AR-linked infrastructure inspection offers greater objectivity and coverage than traditional visual inspections, significantly improving maintenance efficiency and safety.

Benefits of Adoption: Dramatic Improvements in Ease, Accuracy, Speed, and Safety

Smartphone-based photogrammetric point cloud measurement and AR use bring various benefits to field work. The main advantages are as follows.

• Ease and efficiency: Because measurements can be made with a smartphone that everyone carries, there is no need to wait for specialized equipment or outsourcing. With one-touch operation from 3D data acquisition to visualization, site supervisors and engineers can measure whenever needed. Preparation and post-processing effort are greatly reduced, improving overall work efficiency.

• Prevention of construction errors and quality improvement: Using point cloud data prevents overlooking construction mistakes or finish defects. Comparing design models and the real object in AR allows detection of even subtle discrepancies during construction so that corrections can be made early. Accurately recording and sharing the positions of buried assets also prevents accidental damage to infrastructure. This directly leads to reduced quality defects and fewer rework operations.

• Faster decision-making: Previously, analyzing survey results and comparing with drawings took time, and decisions on site were sometimes delayed until the next day. Smartphone × photogrammetry allows immediate confirmation of 3D data on site and sharing with stakeholders for instant decision-making. Real-time visualization of conditions dramatically improves the speed and accuracy of decisions.

• Improved safety: AR navigation and see-through visualizations contribute to worker safety. For example, visualizing hazardous areas in AR prevents unauthorized entry, and knowing the locations of culverts and buried pipes ahead of time prevents excavation accidents. Visual guidance for heavy equipment reduces near-miss incidents caused by misinterpreted signals. Also, because one person can easily measure, long-duration work at heights or on roadways can be reduced, improving labor safety conditions.

As shown, smartphone-based point cloud measurement and AR use offer significant benefits to field operations in terms of efficiency, quality, and safety.

Conclusion: Accelerating Field DX with Simple Surveying Using LRTK

The latest workflow combining photogrammetry and AR is turning 3D measurement and advanced construction management—once the domain of specialists—into technology that anyone can use daily. The key is balancing “the convenience of completing everything with a single smartphone” and “trustworthy data at centimeter accuracy.” This balance has been enabled by new tools such as the smartphone RTK receiver LRTK. By attaching LRTK to a smartphone, you can perform high-precision position-tagged point cloud measurement on site with a push of a button and immediately check that data in AR. No complicated setup or specialized skills are required; it can truly function as a versatile surveying instrument for each person.

Digitalization and DX of field work start with “trying it out.” The method of smartphone × photogrammetry + AR has low initial investment and learning hurdles, so it’s a solution you can test immediately. Municipalities and construction companies that have already introduced it report that “waiting time for surveying has decreased,” “as-built inspections have become smoother,” and “real-time information sharing on site has increased safety awareness.” Why not start with simple 3D surveying using a smartphone and LRTK at your site? This easy-to-introduce technology will promote everyday use of point cloud data and directly contribute to quality improvement and productivity gains. Adopt the new on-site workflow brought by smartphone × photogrammetry and realize a safer, more efficient future site.