Point Cloud Data × AR for Smart Surveying! Site Visualization via Plan Overlay

Table of Contents

• Introduction

• What is point cloud data?

• What is AR (Augmented Reality)?

• New developments in smart surveying using point clouds × AR

• Site visualization realized by plan overlay

• Benefits of smart surveying

• Main use cases

• Simple surveying with LRTK

• FAQ

Introduction

In construction and civil engineering, surveying and construction management are being dramatically transformed by the adoption of digital technologies. With industry-wide ICT adoption advancing under initiatives such as the Ministry of Land, Infrastructure, Transport and Tourism’s i-Construction policy, a particularly notable trend in recent years is the combination of “point cloud data” and “AR (augmented reality)” for so-called smart surveying. Point cloud data is three-dimensional data that digitally records the real world as countless points, enabling detailed understanding of any shape on site. AR, on the other hand, overlays digital information onto real-world imagery, allowing construction drawings or 3D models to be viewed aligned with the actual object. Combining the two can greatly increase the efficiency of surveying and design verification work that previously relied on skilled craftsmen and manual tasks, making it possible for anyone to accurately and quickly “visualize” site conditions.

This article first explains the basics of point cloud data and AR in plain terms, then describes how the latest surveying methods that combine them are changing the field. We focus especially on the plan overlay (a technique that overlays two-dimensional drawings onto site imagery) and introduce the advantages of site visualization that were not achievable with traditional plans or photographs. We also describe the benefits and concrete application scenarios of this smart surveying, and finally introduce a simple smartphone-based surveying method using a system called LRTK.

What is point cloud data?

Point cloud data is three-dimensional digital data that records the surfaces of real-world objects such as buildings and terrain as a collection of countless points (a point cloud). Each point includes X, Y, and Z coordinates (spatial position), and depending on the acquisition method, color information or return intensity may also be attached. At first glance it looks like a coarse photo made of a cloud of points, but a key characteristic is that each point has an exact position in real space. Using a dedicated 3D laser scanner, you can scan buildings and terrain with point clouds numbering from millions to hundreds of millions of points. Recently, point cloud data can also be obtained via photogrammetry using smartphones or drones. For example, with the latest smartphones (LiDAR sensor–equipped models), you can record surrounding shapes as point clouds simply by walking around and pointing the camera. It’s like taking the entire shape of the site home as data, dramatically streamlining surveying work that used to measure things one by one.

The advantages of point cloud data are its speed, comprehensiveness, and accuracy. A single scan can measure a wide area in a short time, and the acquired data contains information down to the far corners of the site, so there is almost no “missed measurement.” For example, terrain that used to be inferred from a few ground elevation measurements can be understood in detail across the entire surface with point clouds. On point clouds you can measure arbitrary distances, areas, and volumes within software, which is more accurate than manual tape-measurements and reduces human error. Furthermore, it is possible to automatically generate 2D drawings (plans, elevations, sections) from point clouds. Because point clouds contain the complete three-dimensional shape of the object, importing them into dedicated software allows you to cut out arbitrary sections or draw accurate plans from overhead views. Drawing creation that used to be done by hand measurements and CAD drafting can be greatly reduced by utilizing point clouds.

AR (Augmented Reality) — what is it?

AR (Augmented Reality) is a technology that overlays digital information onto real-world scenes. By compositing CG models, text, shapes, etc., in real time onto a smartphone or tablet camera view, it can make them appear as if they exist on site. In construction, AR is attracting attention for visualizing the completed image by projecting drawings or 3D models onto the site and for directing construction locations. For example, through a tablet screen, virtual lines and dimensions can be displayed on the ground to confirm building placement plans, or piping and rebar layouts can be displayed transparently on a wall to guide construction. AR closes the gap between drawings and reality and enables intuitive information sharing.

Recent smart devices are equipped with high-performance cameras, sensors, and AR platforms, making AR experiences accessible without special equipment. However, to make full use of AR on construction sites, accurate alignment is crucial. If the physical object and digital information are displayed even a few centimeters off, it can lead to critical errors in surveying and construction. This requires a mechanism to determine device position and orientation with high accuracy and align digital data with the site coordinate system. Such challenges are increasingly being overcome by advances in RTK-GNSS (high-precision satellite positioning) and image analysis technologies.

New developments in smart surveying using point clouds × AR

Combining the two advanced technologies of point cloud data and AR is bringing unprecedented developments to site surveying and management. Known as smart surveying, this approach first acquires the current conditions in detail using point cloud data and then visualizes them on site with AR. Specifically, you can scan a site with a smartphone or tablet to create point cloud data, switch to AR display mode on the spot, and see the newly acquired point cloud or model superimposed over the real object. If the point cloud has high-accuracy position information attached, the virtual data remains fixed to the ground or structures even as you walk around during on-site AR display, with no drift. It feels like a holographic copy of the site appears before your eyes, allowing direct comparison between as-built data and design data.

A major strength is the ability to immediately detect discrepancies between digital data and reality through on-the-spot comparisons. For example, by scanning the as-built structure as a point cloud and comparing it with design drawings or a BIM model in AR, you can instantly determine whether the finished work matches the plans. Traditionally, surveying data had to be taken back to a PC for checking, which delayed defect detection, but AR lets you point out problems on site and start corrections immediately. Moreover, the visualization provided by point clouds + AR functions as a real-time decision-making tool rather than mere documentation. Viewing the AR screen together with stakeholders on site makes it possible to notice clashes or errors that wouldn’t be apparent on a plan, enabling swift decisions and preventing incorrect construction.

Site visualization realized by plan overlay

Among the combinations of point cloud data and AR, what is a plan overlay? A plan overlay is a technique that overlays a plan view (top-down view) from paper drawings or CAD data onto the site imagery using AR. In short, instead of carrying a drawing and looking at the site, the lines and symbols from the plan appear to float over the site when viewed through a smartphone or tablet.

This technology makes the correspondence between the design and the site immediately clear. For example, by confirming building placement or foundation positions with a plan overlay, you can visually grasp setbacks from site boundaries and clearances from adjacent structures. The process that used to require measuring with tape and marking positions, then checking after completion, can now be done by drawing the completed shape in AR and confirming in advance. Before construction, you can share with the client what the appearance and layout would be if built according to the plans, preventing “it’s not what I expected.” During construction, you can instantly check whether foundations and structures are positioned and dimensioned according to the plan and correct any deviations on the spot.

Plan overlays also serve as an intuitive navigation tool for site workers. Because plan lines are projected to scale onto the ground, even less-experienced workers can achieve accurate layout simply by following the lines. For example, if virtual markers or lines are displayed in AR for column or equipment positions, the time-consuming chalking work traditionally done by experts becomes much easier. Even complex curves or angled layouts can be followed because AR displays the curve’s trajectory directly on the ground, allowing everyone to work with a clear image of the finished form. When height checks are needed at key points, showing target heights in AR makes it possible to grasp slopes and height deviations without repeatedly using a level. In this way, plan overlay simultaneously realizes site visualization and work guidance, contributing to improved construction quality and efficiency.

Benefits of smart surveying

Smart surveying using point cloud data × AR brings many advantages to the field over traditional analog methods. The main benefits are summarized below.

• Significant efficiency gains in surveying work: Using laser scanners or smartphone measurement, a single person can acquire current-condition data in a short time, completing surveying that used to take days in hours to minutes. Because drawings can be automatically generated from point clouds, the burden of drafting is also reduced.

• High accuracy and reduced human error: Digital measurement ensures millimeter- to centimeter-level precision (≈0.04 in to ≈0.4 in), reducing reading mistakes and recording errors by humans. On-site AR verification prevents oversights and misunderstandings that could lead to construction errors.

• Immediacy and faster decision-making: Because you can scan on site and instantly check with AR, the time from problem detection to corrective instruction is shortened. Real-time understanding and sharing of site conditions minimize waiting time and rework.

• Labor savings and skill transfer: AR navigation enables high-precision work even without experienced personnel. Quality can be maintained without relying on veterans’ intuition and experience, serving as a countermeasure against labor shortages and aging technicians.

• Improved communication and consensus building: When explaining the completed image to clients or contractors, projecting it on site with AR provides immediate understanding. Sharing spatial images that are hard to convey on paper prevents mismatches like “this isn’t what I imagined” and smooths consensus building among stakeholders.

• Enhanced safety: Point cloud surveying, which can measure in short time with fewer personnel, reduces risks in situations that used to require long measurements at heights or on roadways. AR can visualize underground utilities to prevent excavation accidents or virtually mark danger areas to enforce restricted access, with further safety-management applications expected.

Main use cases

Here are several concrete use cases of smart surveying.

• As-built verification (quality inspection): After construction, scan the structure as a point cloud and compare it with design data to confirm whether the finish matches the drawings. If AR overlay is performed on site, you can immediately see “which parts are off from the plan by how many centimeters (inches)” using color-coded heat maps. If deviations exceed allowable tolerances, repairs or rework can be instructed immediately, and storing photos and point cloud data as inspection records aids future maintenance.

• Construction navigation and marking support: Use AR guidance to assist surveying and marking tasks. Load reference points and structure positions from the design into the device as digital data and display AR instructions such as “place a stake here” or “construct along this line.” Workers simply follow virtual stakes or lines on the screen to perform accurate layout even with little experience. For heavy-equipment operators, AR directional arrows can guide movement, reducing rework due to human error.

• Maintenance and infrastructure inspection: Point clouds + AR are effective for infrastructure maintenance. For example, if you record buried water/sewer pipes and cables with point cloud measurement before backfilling, you can later confirm their positions through the ground with AR, reducing the risk of damaging pipes during excavation. Regularly scanning bridges and tunnels as point clouds and comparing them over time in AR allows visual monitoring of crack propagation and deformation, helping to determine repair timing.

• Client proposals and image sharing: AR is powerful in client presentations. Displaying a 3D model or plan as AR over the actual site enables clients to experience the finished appearance in advance. For example, for a renovation you can overlay an extension in AR on the existing house, or preview fences and carports on site for exterior design. This conveys aspects that paper drawings can’t, speeding agreement and preventing later disputes about mismatched expectations.

• Safety management and hazard prediction: AR can be applied to site safety measures. Predefine restricted zones and heavy-equipment work areas, and when viewed through AR goggles or a tablet, hazardous zones are highlighted in red. Workers intuitively recognize danger areas and avoid approaching them. Using point cloud data to simulate temporary scaffolding or equipment operating ranges and verifying them in AR also aids safety-plan validation.

Simple surveying with LRTK

You might wonder whether the point cloud + AR smart surveying described so far requires specialized knowledge or expensive equipment to implement on site. Lowering that barrier is an easy smartphone-based surveying system called LRTK. LRTK connects a compact high-precision GNSS receiver (RTK-capable) to a smartphone or tablet and, with a dedicated app, provides an all-in-one solution that enables anyone to easily perform high-precision point cloud measurement and AR surveying.

Specifically, using a smartphone + LRTK, you can start a LiDAR scan with a single button and obtain surrounding point cloud data simply by walking around. There is no need to set up tripods or perform complex configurations; site staff can intuitively operate it. Moreover, because RTK-GNSS attaches centimeter-level position coordinates (cm-level accuracy (half-inch accuracy)) to the measurement data, the acquired point cloud is immediately corrected to a known coordinate system (plan coordinates and elevation). In other words, you can display the point cloud in AR on site right away and align it with the real object without positional error. There is no need to return to the office for data processing after the scan, and additional scans or remeasurements can be flexibly performed on site as needed.

The LRTK system also includes functions to automatically generate plans and sections from point cloud data and to create as-built reports with one click. This allows the entire workflow from surveying to drawing, construction guidance, inspection records, and reporting to be completed with almost a single smartphone. Even without specialized CAD skills, site-acquired data can be used immediately, greatly saving labor and time. The system is designed to be simple to operate while delivering accuracy comparable to dedicated surveying instruments, making it accessible even to those with limited site experience. For sites considering introducing smart surveying, LRTK can be a powerful helper.

FAQ

Q1. What equipment is required to acquire point cloud data? A1. Traditionally, specialized surveying instruments such as 3D laser scanners were the mainstream, but recently point cloud data can be obtained with smartphones or tablets. LiDAR-equipped phones can scan with the device alone, and non-LiDAR models can use photogrammetry apps to generate point clouds. For higher-precision surveying, combining a smartphone with an RTK-GNSS receiver (for example, systems like LRTK) enables point cloud acquisition with centimeter-level accuracy (half-inch accuracy).

Q2. Do I need special tools to perform plan overlay in AR? A2. Basically, an AR-capable smartphone or tablet is sufficient. Load plan data (images or CAD files) into a dedicated AR app and perform on-site positioning to overlay the drawing on the camera image. What’s important is the reference for accurate alignment; methods include placing markers for measurement or using GPS. For high accuracy on site, a system that performs AR display while referencing RTK-GNSS control points is desirable.

Q3. Is smartphone measurement accuracy sufficient? A3. The standalone GPS and sensor accuracy of typical smartphones is limited and can produce errors of several meters (several ft). However, applying RTK corrections can improve accuracy to the level of several centimeters (several in). For example, by combining a smartphone with RTK-GNSS like LRTK, smartphone surveying can achieve accuracy comparable to traditional surveying instruments. With appropriate correction technology, smartphones can therefore provide accuracy sufficient for practical work.

Q4. Can you really create drawings from point cloud data? A4. Yes. Point cloud data contains detailed real-world shapes, and with dedicated software or systems you can generate 2D drawings from it. For example, you can draw contour lines from terrain point clouds or generate plans and elevations from building point clouds automatically. Systems like LRTK analyze acquired point cloud data in the cloud to extract building outlines and cross-sectional shapes and convert them into drawings. Using point clouds greatly streamlines drawing work that was previously done manually.

Q5. Is it difficult to introduce digital surveying on site? A5. You may be uneasy about new technology at first, but recent smart surveying tools pay attention to usability. Smartphone-app-based systems guide users through the process on screen, enabling surveying and AR display to be performed intuitively without expert knowledge. Training and demos before introduction help site staff become familiar quickly in many cases. Once users experience the convenience, they often find it indispensable. Digitalization contributes to solving labor shortages and improving operational efficiency, so the benefits generally outweigh the initial difficulty.