Site inspections made smart! An intuitive AR heatmap visualization tool

Table of contents

• What is an AR heatmap?

• Benefits of AR heatmaps

• How to create an AR heatmap

• Real-time verification of construction status with AR display

• Summary

• FAQ

On construction and civil engineering sites, verifying that completed structures and terrain match the design drawings—so-called quality/“as-built” control—is indispensable. However, conventional as-built verification work has involved measuring heights point by point with total stations or levels, bringing the data back to the office and comparing it with drawings to judge pass/fail, which consumes a great deal of time and effort. Because measurements have been taken by sampling points, fine defects are often overlooked and problems may be discovered late, requiring rework. One promising way to solve these issues and make site inspections smarter is an intuitive visualization tool called an AR heatmap. This article explains in detail what an AR heatmap is, its practical benefits, the specific steps to create one, and how to perform real-time on-site checks using AR. Learn the latest as-built management techniques using digital technology to improve and streamline quality control.

What is an AR heatmap?

An AR heatmap is a system that visualizes the differences between the as-built shape (terrain or structure geometry) after construction and the design data in color-coded 3D, and overlays that data onto the site scenery using AR (augmented reality) technology. Initially, as-built management introduced a method using color 3D diagrams called heatmaps to understand deviations from the finished shape. A heatmap expresses height differences at each point using colors such as red, blue, and green. For example, areas that are higher than the design are shown in warm colors like red or orange, whereas excavated, lower areas are shown in cool colors like blue or purple, and areas within design tolerance are shown in green. The feature is that you can intuitively tell at a glance which locations are higher or lower than specified, making the heatmap a powerful visualization tool for as-built management.

Combining this heatmap with AR technology allows digital pass/fail results to be overlaid onto the real scenery. By superimposing a virtual heatmap over the actual structure or terrain through a tablet or smartphone camera, you can check quality on site while viewing the actual object. Inspections that used to require comparing drawings and numerical data can now be understood intuitively as color displays on a phone screen, enabling “inspections you can see and understand on the spot.” In flows like *i-Construction* promoted by the Ministry of Land, Infrastructure, Transport and Tourism, as-built management that leverages 3D measurement data and heatmaps is gradually being incorporated into official procedures, and AR heatmaps are becoming a new standard in the era of on-site DX.

Benefits of AR heatmaps

Introducing AR heatmaps brings many benefits that conventional methods could not provide. Major advantages include:

• Intuitive quality assessment: Since the magnitude of deviations is shown by color, anyone from site workers to clients can understand construction accuracy at a glance. Visual information is easier to grasp than numerical or textual reports, making it easier for the whole team to share the points that require correction.

• Prevention of measurement omissions: By evaluating entire surfaces using dense 3D data such as point clouds, subtle irregularities and localized defects that were missed by conventional spot measurements can be detected. Heatmaps that cover the whole site enable you to uncover quality inconsistencies without omission.

• Rapid feedback: Even during construction, if you scan and convert to a heatmap at any time, you can immediately check as-built status at that moment. Early detection and immediate correction of problem areas reduce the need for large-scale rework later, shortening schedules and ensuring quality.

• Digitalization and utilization of records: Heatmaps and point cloud data can be stored as digital records in the cloud, preserving detailed construction histories that paper drawings cannot. It becomes easy to compare with past data for root-cause analysis during future maintenance. Also, by integrating as-built data into BIM/CIM models for facility management, they become useful information assets after completion.

• Labor savings and improved safety: Point cloud measurement that can survey wide areas at once and automated analysis greatly reduce the manpower and time required for measurement tasks. High or hazardous locations can be scanned remotely, reducing the frequency with which workers must enter dangerous areas. As-built verification of locations that were previously difficult becomes easier with heatmaps, reducing human errors.

In this way, AR heatmaps significantly contribute to improvements in accuracy and efficiency of quality management. Next, let’s look at the concrete steps to actually create a heatmap.

How to create an AR heatmap

Below is a step-by-step explanation of the basic procedure for creating an AR heatmap (as-built heatmap). Proceed through the following steps from preparing the necessary data to generating the heatmap.

• Design data preparation: First prepare a 3D design model that will serve as the comparison standard. For earthworks, this corresponds to the planned surface design data (TIN data, etc.); for structures, it corresponds to 3D design models such as BIM/CIM. In other words, this step clarifies the “ideal finished shape (target geometry)” as data. This design model becomes the basis for as-built evaluation and the foundation for pass/fail decisions in inspections.

• Current 3D measurement: Next, measure the actual as-built shape in three dimensions. Point cloud measurement has become mainstream in recent years, and methods that scan the entire site using terrestrial 3D laser scanners or drone photogrammetry are widely used. Recently, cases of easily acquiring point cloud data using smartphones equipped with LiDAR sensors have also increased. For example, by combining the LiDAR built into the latest iPhone or iPad with a high-precision GPS unit, even a smartphone can perform point cloud surveying with accuracy on the order of several centimeters (several inches). The important point is to measure the current condition without omission and obtain data with as high positioning accuracy as possible. Use point cloud scans that can cover wide areas in a short time to acquire a digital as-built model that includes fine details of the terrain and structures.

• Data alignment: Overlay the design data and the acquired as-built data in the same coordinate system. If measurements are taken from the start in a public coordinate system or other absolute coordinates, the two datasets will align automatically and require little effort to align. For example, if point clouds are acquired with RTK-GNSS-enabled equipment, the acquired data itself has global positioning coordinates, so you can simply overlay the design model on the same coordinates. If measurements were taken in a local coordinate system or there is some offset, carefully fit the two datasets using known control points (joint adjustment). If the alignment is not accurate, the subsequent heatmap results cannot be trusted, so it is crucial to align precisely in this step.

• Heatmap generation: Compare the prepared design model and the as-built point cloud data and generate a heatmap that color-codes the as-built differences. Running a “create heatmap” function in dedicated analysis software or a cloud service will automatically compute height differences at each point and output a 3D model visualized with a color map representing errors. Typically, small errors are shown in green to light blue, areas that are higher than the design are shown in warm colors from yellow to red, and areas lower than the design are shown in cool colors from blue to purple. If tolerance ranges are preset, the tool can highlight areas within tolerance in green, overfilled high areas in red, and excavated low areas in blue. Mesh size and color thresholds for the heatmap may be adjustable depending on the tool. Automatic comparison processing on a computer is fast and can produce results in a short time even for datasets on the order of hundreds of thousands of points.

• Review and analysis of results: Check the completed heatmap on screen and evaluate construction quality. By looking at the color distribution you can immediately read “which points are how much higher or lower,” for example, “the center of Area ○○ is overfilled by +5 cm (2.0 in) relative to the design” or “section △△ has a leftover cut of -3 cm (-1.2 in).” If necessary, check numerical errors at individual points on the heatmap and analyze overall trends (e.g., whether the entire area is slightly high or only certain parts are low). Because the heatmap is visual, it is easy to show to site workers and heavy equipment operators for comprehension, making it an effective communication tool to share corrective points among the whole team. Uploading data to the cloud allows those at a distant office to view the same 3D heatmap via the web on a PC. You can share real-time information with supervisors or clients who cannot come to the site and request appropriate instructions or approvals.

• Correct defects and record: Once defective areas are clarified with the heatmap, perform necessary rework on site (such as regrading or additional filling). Afterward, perform 3D measurement again and create a heatmap in the same way to confirm the post-correction finish. Once you confirm that the problem is resolved, output and save the final heatmap and measurement results as as-built management charts (reports). Recently, systems with automatic report generation that include heatmaps have appeared, allowing inspection reports to be generated with one click by combining photos and drawings. Because data collection through reporting can be completed digitally, the effort of creating reports is greatly reduced. Accumulate the resulting heatmaps and point cloud data within your company and use them for future construction planning and engineer training.

The above is the basic flow for creating an AR heatmap. The key points are high-accuracy acquisition of as-built data, precise alignment, and the use of automation tools. Next, let’s look at AR display for real-time on-site checking of construction status using this heatmap.

Real-time verification of construction status with AR display

Once the heatmap is created, displaying it in AR on site lets you overlay the digital inspection results onto the real scenery and verify them. This involves loading heatmap data into an AR-enabled app or system on a smartphone or tablet and compositing the virtual heatmap model onto the camera image. This allows you to see color-coded pass/fail indications overlaid on the real view, enabling you to intuitively understand on the spot “which locations need how much correction.”

Accurate AR display requires precisely knowing the mobile device’s position and orientation. While a device’s built-in GPS and gyroscope allow some degree of overlay, achieving centimeter-level high-precision AR (inch-level) requires additional measures. For example, you can correct the device position to centimeter accuracy (inch-level) by attaching an RTK-GNSS receiver to the smartphone, or use site reference markers (targets) placed on the site to align the virtual heatmap. Systems that support these methods can provide a stable AR experience where the heatmap display does not drift even as you walk around with the device.

There are many advantages to on-site verification using AR. The main effects include:

• Immediate identification of problem areas: Because colored spots on the screen clearly correspond to actual positions, you can mark the spot on the ground on site without the hassle of searching with survey equipment. For example, you can stand at a location shown in red on the heatmap, immediately mark the area nearby, or directly instruct the heavy equipment operator “let’s cut another ◯ cm here,” enabling quick corrective work.

• Efficient joint inspections: During on-site meetings with clients or supervisors, viewing the heatmap AR on a tablet together enables real-time sharing of pass/fail status. What used to be explained with charts prepared in the office can now be visually demonstrated on site—“we corrected this area by this amount”—which smooths explanations and consensus building.

• Reduced re-measurement: If AR accurately points out problem areas, you can reduce the need to re-measure many points for confirmation. Because high-precision point cloud data was already captured when creating the heatmap, you can minimize additional surveying and shorten the inspection process. Additionally, AR allows verification from a safe, distant position for hazardous locations, providing safety benefits.

By bringing heatmaps into the field via AR, you enable seamless integration of digital and real-world construction management. Rather than remaining mere inspection records, AR heatmaps function as on-site, immediately actionable quality improvement tools.

Summary

This article explained the overview, benefits, creation method, and AR utilization of AR heatmaps. Compared with traditional survey-centered as-built management, the method using heatmaps plus AR enables high-precision checks over wide areas in a short time, and the color-coded results are easy to interpret, dramatically improving efficiency and quality of construction management. By introducing digital technology, inspections that are hard to miss can be performed with fewer personnel, and information sharing between the site and the office becomes smoother. As part of on-site DX, this approach is expected to spread further.

That said, some may feel that introducing 3D scanning and analysis is a high hurdle. However, simple surveying systems that anyone can use have appeared recently, making it possible to perform point cloud measurement and heatmap creation easily even without specialized surveying skills. For example, LRTK, which uses a small RTK-GNSS receiver attached to a smartphone, transforms a phone into a high-precision 3D scanner and automatically generates as-built heatmaps in the cloud from site-acquired data. Moreover, that heatmap can be displayed in AR on the phone to provide a one-stop solution from measurement to on-site inspection. With all-in-one systems that minimize dedicated equipment and complex manual steps, even first-time users can readily implement the latest as-built management. Take this opportunity to introduce digital technology to your site and achieve better quality control and time savings.

FAQ

Q: What is an AR heatmap? A: An AR heatmap is a method that overlays a heatmap—created by color-coding the deviations between the post-construction as-built shape data and the design shape—onto the site using AR technology. By comparing acquired point cloud data or as-built models with the design model, areas with small errors are shown in green, overfilled areas above design are shown in red, and excavated low areas are shown in blue, enabling intuitive visual assessment of quality. It is a site inspection tool that allows instant judgment of construction accuracy.

Q: What equipment and software are needed to create a heatmap? A: Basically you need equipment to perform 3D surveying on site and software (or a cloud service) to process the data. For example, acquire point cloud data with a 3D laser scanner, a drone (photogrammetry), or a LiDAR-equipped smartphone, then compare it with the design model in dedicated PC software or a cloud service to generate a heatmap. Recently platforms have emerged that automatically compare uploaded point clouds and design data on the cloud and create a heatmap with one click.

Q: Can I create a heatmap with a smartphone? A: Yes. Modern smartphones (e.g., iPhone Pro series) have LiDAR sensors, and by combining them with a small RTK-GNSS receiver you can use a phone as a high-precision 3D scanner. Using a dedicated app to capture point clouds with a smartphone and upload them to the cloud, services will automatically generate heatmaps. For example, using smartphone surveying systems like the aforementioned LRTK, you can complete everything from point cloud acquisition to heatmap creation on a smartphone without specialized surveying knowledge.

Q: What is required to overlay a heatmap on site with AR? A: AR display requires an AR-capable smartphone or tablet and a dedicated app that loads the heatmap data. The app overlays the virtual heatmap model on the device’s camera image, but accurate overlay requires precise measurement of the device’s position and orientation. For higher accuracy, position correction using RTK-GNSS or setting reference markers (targets) on site for alignment may be used. With a compatible system, you can achieve centimeter-level alignment (inch-level) without relying solely on the device’s internal GPS, enabling stable, non-drifting AR display on site.

Q: Are AR heatmaps accepted as official as-built management documents? A: AR heatmaps (as-built heatmaps) are increasingly being recognized as one of the as-built management methods in public practice. The Ministry of Land, Infrastructure, Transport and Tourism’s guidelines have begun to incorporate surface-based as-built management using 3D measurement technologies, and heatmap-based evaluations are being piloted and progressively adopted. In some earthwork fields, comprehensive as-built measurement and heatmap evaluation have become mandatory. Therefore, it is possible to submit 3D as-built data including heatmaps as inspection documents, and modern ICT-enabled construction sites actively utilize them. However, follow the submitting organization’s instructions regarding formats, and prepare printed heatmap diagrams or electronic data as required.