Instant Point Cloud Analysis! Real-time As-built Management with AR Heat Maps

Table of Contents

• What is an AR heat map?

• Benefits of AR heat maps

• How to create an as-built heat map

• Real-time verification of construction status with AR display

• Use cases: paving, embankments, slopes, structures

• Conclusion

• FAQ

As-built management—verifying and recording whether completed structures and formed land match the design—is indispensable on civil engineering and construction sites. Traditionally, manual measurements by staff using tape measures, levels, and similar tools were the norm, but recently a new method has emerged that measures the entire site in 3D and visualizes deviations as a heat map. By combining this with AR (augmented reality) technology, construction accuracy can be intuitively checked on site in real time. This article explains what AR heat maps are, their benefits and creation process, and how to use AR display to check construction status on the spot. Learn this latest digital as-built management method and use it to improve quality control efficiency.

What is an AR heat map?

An as-built heat map (AR heat map) is a 3D visualization that color-codes the differences between the actual post-construction shape and the design data. Concretely, point cloud data or 3D survey data acquired after construction are overlaid with the 3D design model (design surface), and elevation differences at each point are shown with colors. For example, areas that are higher than the design due to overfill are shown in warm colors like red, parts that are lower due to insufficient cutting are shown in blue hues, and regions with small deviation that match the design are shown in green. At a glance, you can intuitively understand which locations are higher or lower than the standard and whether they are acceptable or not.

An as-built heat map is essentially a visualization tool for as-built management. Subtle undulations and trends that are hard to notice on planar drawings or lists of numbers can be easily discovered with a colored 3D visual. The Ministry of Land, Infrastructure, Transport and Tourism is promoting 3D measurement and planar as-built evaluation through DX initiatives such as *i-Construction*, and heat-map-based as-built management is beginning to be adopted in official guidelines. In fact, in the earthwork field there are projects that require comprehensive as-built measurement and heat map evaluation. In other words, heat-map-based as-built management is becoming a new standard in the era of site DX.

Benefits of AR heat maps

Using AR heat maps brings many advantages that conventional inspection methods could not provide. Here are the main benefits.

• Intuitive quality assessment: Because the magnitude of deviations is shown in color, anyone—from site workers to clients—can understand construction accuracy at a glance. It is visually clearer than reporting with numbers or text, making it easier to share corrective points with the whole team.

• Prevention of measurement omissions: High-density data such as point clouds allow evaluation of the entire surface, so unevenness or localized defects that tend to be missed by spot checks can be detected. A heat map that covers a wide area can reveal variations in quality without omissions.

• Rapid feedback: If you scan during construction and convert the data into a heat map, you can immediately check the as-built status on site. Early detection and rework of problem areas minimize rework, shorten schedules, and help secure quality.

• Record and traceability: Heat maps and point cloud data can be stored in the cloud as digital records. Detailed "construction history" that could not be preserved on paper drawings can be saved, and comparing with past data during future maintenance makes root-cause analysis easier. They can also be integrated into BIM/CIM models after completion and used as valuable information assets.

• Labor savings and improved safety: Point-cloud measurement that captures wide areas at once and automated analysis significantly reduce the manpower and time required for measurement tasks. High or dangerous locations can be scanned remotely, contributing to worker safety. Heat maps make it easier to check as-built conditions in places that were previously difficult to inspect, reducing human error.

Thus, as-built heat maps greatly contribute to improving the accuracy and efficiency of quality control. Next, how are these heat maps actually created and operated? The following section explains the creation steps and practical usage.

How to create an as-built heat map

Below is a step-by-step explanation of the general process for creating an as-built heat map, from preparing the necessary data to generating and using the heat map.

• Design data preparation: First, prepare the 3D design data that will serve as the comparison standard. For earthwork, this might be the design ground model (TIN data or design surface data); for structures, it could be a BIM/CIM 3D design model. The goal is to clearly define the "ideal completed shape (target)" as data. In as-built management, this design model becomes the criterion for pass/fail assessment.

• 3D measurement of the current condition: Next, measure the actual post-construction shape in 3D. Point-cloud measurement is now mainstream; terrestrial 3D laser scanners and drone photogrammetry are commonly used to scan entire sites. Increasingly, LiDAR-equipped smartphones are also being used to easily acquire point clouds. For example, combining the LiDAR sensor built into recent iPhone Pro-series models with an RTK-GNSS receiver allows point-cloud surveying with several-centimeter accuracy (half-inch accuracy) even using a smartphone. Regardless of the method, the important point is to measure the current condition without omission and obtain data with high positioning accuracy. Point-cloud scanning, which can cover wide areas quickly, yields a detailed digital as-built model that includes terrain and structures.

• Data alignment: Overlay the design data and the acquired as-built data within the same coordinate system. If measurements were taken in survey coordinates (public coordinates or global geodetic systems), both datasets will automatically align and little effort is needed to register them. For example, if you obtain point clouds with RTK-capable equipment, the acquired data already have high-accuracy coordinate values, so you can simply overlay the design model. If measurements were taken in a local coordinate system or there are slight offsets, perform an adjustment (fitting) using known control points to align the datasets. If alignment is incorrect here, subsequent heat-map results will be unreliable, so check carefully.

• Generating the heat map: Compare the prepared design data with the as-built point cloud data to create the as-built heat map. Running the "create heat map" function in dedicated analysis software or a cloud service automatically computes height differences at each point and generates a color-coded heat map. Typically, small deviations are shown in green; areas that are higher than the design are displayed from yellow to red; areas lower than the design are shown in light blue to bluish purple gradients. If you set allowable deviation thresholds beforehand, you can emphasize areas within tolerance in green, overfilled areas in red, and excavation-shortfall areas in blue. Tools are also available to adjust mesh (grid) size and color ranges. Since computers perform the calculations rapidly, results can be obtained in a short time even for datasets of several hundred thousand points—true instant point-cloud analysis is possible.

• Review and analysis of results: Review the generated heat map on screen and analyze construction quality. The color distribution allows you to intuitively read "which locations are how much higher or lower." For example, you might find "the center of the ○○ area is overfilled by the design + 5 cm (2.0 in)" or "the △△ portion is 3 cm (1.2 in) lower than the design due to insufficient cutting." Where necessary, check numerical deviations at points on the heat map and analyze overall trends (e.g., whether the site is generally slightly high or only specific locations are low). The visual nature of heat maps makes them easy for on-site workers and heavy-equipment operators to understand directly, facilitating sharing of corrective actions. Uploading data to the cloud enables remote stakeholders to view the same 3D heat map in a web browser, allowing supervisors or clients offsite to share information in real time and quickly provide instructions or approvals.

• Corrective work and record keeping: When defects are identified on the heat map, perform necessary on-site corrections (e.g., regrading or additional fill). After correction, remeasure the corrected state in 3D and verify the finish with a heat map. Once issues are resolved, output the final as-built heat map and measurement results as an as-built control chart/report. Systems now exist that can automatically generate heat-map-inclusive reports with one click, allowing quick preparation of submission materials combined with photos and drawings. Because everything is digital, record-keeping workload is greatly reduced. Store the resulting heat maps and point cloud data within the company to serve as reference for future projects and for knowledge sharing among engineers.

That covers the basic workflow for creating an as-built heat map. The key points are acquiring high-accuracy as-built data, performing precise alignment, and leveraging automation tools. Next, we explain AR display as a method to use this heat map on site for real-time verification of construction status.

Real-time verification of construction status with AR display

Once you have created an as-built heat map, you can display it on site in AR to overlay the digital information onto the real world and verify construction status. An AR-enabled app or system loads the heat map data onto a mobile device and overlays the virtual heat map onto the camera view. Because the heat map’s color-coded pass/fail information is composited with the actual scene, you can intuitively grasp "which location needs how much correction" on the spot.

The basic procedure is to transfer the heat map data (colored point cloud or model) to a smartphone or tablet, then hold up the device on site and overlay the heat map onto the real view on the screen. For accurate registration, using the device’s GPS and gyroscope along with higher-precision positioning or on-site reference markers is effective. For example, correcting the device position to centimeter-level using RTK-GNSS or anchoring the virtual heat map to known site points reduces display misalignment. Supported systems implement such corrections to achieve high-precision AR, keeping the heat map accurately positioned as you walk around with the device.

AR-based on-site verification offers many advantages. Representative points include:

• Rapid identification of problem areas: Since red and blue regions on the screen immediately correspond to actual locations, you can mark the ground on the spot or directly instruct the equipment operator, e.g., "cut here by another X cm." Previously, crews had to find corresponding positions in the field with a survey instrument while referring to heat-map reports; that effort is no longer necessary.

• Improved efficiency of on-site inspections: During site inspections with clients or supervising staff, showing AR heat maps on a tablet allows sharing pass/fail status immediately. The extent and degree of corrective work can be shown at a glance by color, smoothing explanations and consensus building.

• Reduced re-measurement: Once a high-accuracy point-cloud survey has been performed and a heat map created, you can confirm positional relationships in AR without remeasuring numerous points for inspection.

• Improved safety: For steep slopes or high locations that are hazardous, AR verification from a distance eliminates the need to approach dangerous spots. This enhances safety for measurement and verification tasks and reduces worker risk.

By projecting as-built heat maps onto the site with AR, you bring digital pass/fail judgments into the physical construction environment and enable real-time construction management. The combination of heat maps and AR is not just a record-keeping tool but a practical quality-improvement tool that can be used immediately on site.

Use cases: paving, embankments, slopes, structures

AR heat maps are highly effective for as-built management across many construction types and scenarios. Below are representative examples.

• Paving: Measure the entire road base and pavement thickness, and visualize surface irregularities and insufficient thickness as a heat map. For example, areas thinner than the specified thickness can be shown in blue, making it clear where additional paving is needed. With AR display, repair locations on the pavement can be immediately identified by superimposing the heat map on the real surface, enabling uniform, flat paving.

• Embankments and land formation: Check as-built conditions of embankments and formed land across wide areas and detect parts that are overfilled above the design or depressions below it. By viewing the red and blue areas on the heat map, you can instantly see which embankment sections need cutting or additional fill and by how much. AR overlay on site allows intuitive identification of correction areas, enabling precise instructions to equipment operators.

• Slope (cut/fill) work: Evaluate slope gradients and finishes across surfaces. A heat map generated from point clouds measured by remote laser or photogrammetry reveals bulges and depressions that are hard to discern by eye. Without entering dangerous steep slopes, AR heat maps enable confirmation and direction of repair areas from a safe position, improving both efficiency and safety.

• Structure as-built: For concrete structures and the like, as-built inspection items are diverse, but 3D scanning plus heat maps allow comprehensive shape checks. For tunnels or retaining walls, spraying thickness of shotcrete can be analyzed with heat maps to identify shortage areas for correction. Comparing as-built data with the design BIM model also makes it easy to evaluate finishing accuracy for each component. With AR display, you can directly show which surface locations deviate from standards, enabling quick instruction and verification of corrective work.

Conclusion

This article introduced how to create as-built heat maps and how to verify construction on site using AR. Compared with traditional inspections using surveying instruments, combining heat maps and AR allows wide-area, high-accuracy checks in a short time with visually intuitive results, dramatically improving construction management efficiency and quality. Digital technology enables thorough inspection even with a small team and smooth information sharing between site and office. This approach is likely to become increasingly widespread as part of site DX.

That said, some may feel that advanced 3D scanning and analysis are difficult to handle in-house. However, simple surveying systems that anyone can use have recently appeared, allowing point-cloud measurement and heat-map creation without specialized surveying skills. For example, LRTK—a system that attaches a small RTK-GNSS receiver to a smartphone—transforms a phone into a high-precision 3D scanner; scanned data are automatically processed in the cloud to generate as-built heat maps. Those heat maps can also be displayed on the smartphone in AR, enabling one-stop on-site verification. By leveraging all-in-one solutions that minimize specialized equipment and complex manual work, even first-time users can easily implement the latest as-built management practices. Take this opportunity to introduce digital technology on site to raise your quality control level and streamline operations.

FAQ

Q: What is an as-built heat map? A: It is a color-coded visualization of the difference between the actual post-construction shape and the design shape. Acquired point cloud data are compared with the design model; areas with small deviations are green, overfilled areas are red, and excavated areas are blue, allowing intuitive evaluation of quality at a glance. It is an as-built management tool that enables instant judgment of construction accuracy.

Q: What equipment or software is needed to create a heat map? A: Basically, you need on-site 3D measurement equipment and software (or a cloud service) for data processing. Point cloud data can be acquired with 3D laser scanners, drones, or LiDAR-equipped smartphones, and heat maps are generated by comparing the design data with the point cloud in dedicated PC software or a cloud system. Recently, platforms that automatically create heat maps when you upload point clouds and design models to the cloud have emerged.

Q: Can I create an as-built heat map with a smartphone? A: Yes. Modern smartphones (e.g., recent iPhone Pro-series models) have LiDAR sensors, and combining them with a dedicated RTK-GNSS receiver lets you use a phone as a high-precision 3D scanner. If you capture point clouds with a dedicated app and upload them to the cloud, services can automatically generate heat maps. Using smartphone surveying systems like LRTK, even without surveying expertise, you can complete on-site point-cloud measurement, heat-map creation, and AR verification using only a smartphone.

Q: What is required to overlay a heat map on site with AR? A: AR display requires an AR-capable smartphone or tablet and a dedicated app that reads the heat map data. Essentially, the virtual model (heat map) is overlaid on the device’s camera view, but accurate overlay requires precise knowledge of the device’s position and orientation. For high-precision work, device positioning is often corrected with RTK-GNSS or by placing on-site markers (targets) for reference. Compatible systems can achieve centimeter-level registration beyond typical smartphone GPS, so heat maps remain correctly aligned on site.

Q: Are as-built heat maps accepted as official as-built management documentation? A: As-built heat maps are increasingly being recognized as an official as-built management method. The Ministry of Land, Infrastructure, Transport and Tourism’s guidelines include planar as-built management using 3D measurement techniques, and heat-map evaluation is being trialed and introduced more broadly. Some contracting authorities already accept heat-map-inclusive as-built data as inspection documents, and they are actively used in advanced ICT construction sites. However, follow the client’s instructions and submit printed heat-map charts or electronic data as required.