AR Civil Engineering × AI・IoT: A New Dawn for Smart Construction

Table of Contents

• Introduction

• Use of AR Technology on Civil Engineering Sites

• Digitization of Construction Sites Enabled by AI and IoT

• Smart Construction through the Fusion of AR×AI×IoT

• Benefits of Smart Construction

• Conclusion

• FAQ

Introduction

In recent years, the construction industry has been undergoing significant changes in work and construction management methods due to the adoption of ICT (information and communication technology) and the promotion of DX (digital transformation). Nevertheless, civil engineering and construction sites still require considerable time and effort for tasks such as surveying and as-built (post-construction shape) verification, and issues such as labor shortages and the aging of skilled technicians remain serious. Furthermore, from 2024 the upper limits on overtime work are being applied to the construction industry (the so-called “2024 problem”), increasing the need to carry out construction efficiently with limited personnel.

As a trump card to solve these challenges, “smart construction” using advanced technologies such as AR (augmented reality), AI (artificial intelligence), and IoT (Internet of Things) is attracting attention. In particular, efforts to introduce AR technology at sites—often called “AR civil engineering”—are becoming a new industry trend. For example, by using familiar devices such as tablets and smartphones to overlay design data and survey information onto the real landscape, workers can receive intuitive work instructions and confirmations. The use of these technologies in conjunction with AI and IoT is bringing a wave of digital innovation to civil engineering sites that traditionally relied on experience and manual labor.

This article explains smart construction centered on AR combined with AI and IoT, and introduces the concrete changes and benefits it brings to sites. Let’s look at the emerging trend that will usher in a new era for how cutting-edge technology transforms civil engineering fieldwork.

Use of AR Technology on Civil Engineering Sites

AR (augmented reality) technology overlays virtual objects and information onto real images through cameras and sensors. By using dedicated AR glasses (smart glasses) or smartphones/tablets, workers can perform tasks while viewing virtual guides or models on the actual site. AR technology has begun to be used in various situations in the construction and civil engineering fields.

Here are some examples of on-site AR applications.

• Marking construction positions and pile-driving work: By displaying pile-driving positions and reference points on the ground with AR based on design drawings, you can streamline the positioning work that survey teams used to redo repeatedly. Even under harsh terrain conditions, a single person can accurately identify points using virtual markers on the screen, leading to reduced personnel and improved safety. There have been cases where no assistants were needed on steep, unstable slopes, reducing risk. One person can complete wide-area surveying and pile-positioning in a short time, and supervisory instructions can be reflected in AR on the spot and shared, facilitating smoother communication.

• As-built surveying and on-site measurements: As-built surveys that used to take half a day can be dramatically streamlined by combining AR with sensor technology. For example, if you walk around the site scanning with a tablet equipped with LiDAR (laser scanner), you can acquire detailed point cloud data in a short time. The acquired data is immediately sent to the cloud and is automatically turned into drawings and quantity calculations, so tasks that once took days have been reported to finish on-site in about 30 minutes. Simple AR-based surveying eliminates the need to manually observe each survey point, dramatically speeding up construction management. Getting and visualizing data on-site reduces rework and enables rapid decision-making.

• On-site visualization of BIM models: The use of BIM/CIM (three-dimensional design information models) is advancing in construction, and AR demonstrates its power on-site. If the planned completed model of a building or structure displayed on a tablet is overlaid on the actual terrain or the construction site in progress, the client, site staff, heavy equipment operators, and even nearby residents can all intuitively share the completed image. The post-construction appearance, which is hard to convey on paper drawings, becomes obvious when displayed on-site with AR. This makes explanations and meetings smoother, speeds up consensus building, and improves construction quality. It is also effective for thoroughly communicating design intent and preventing construction errors.

• Making buried utilities and boundary lines visible: By displaying the positions of pipes and cables buried underground on the surface with AR, you can reduce the risk of accidental excavation during digging. If subsurface utility data is loaded in advance, workers can check virtual piping lines through the ground, making safety checks easier. Similarly, AR can display land boundary lines so site boundaries can be confirmed on the spot. Tasks that previously required finding boundary stakes or conducting surveys can now be instantly verified by pointing a device, contributing to time savings in land surveying and on-site inspections.

As shown above, AR technology provides intuitive visualization and guidance on civil engineering sites, greatly contributing to improved efficiency, enhanced safety, and smoother communication. Complex drawing information can be seen and understood on-site, enabling high-precision work without relying solely on the experience of veteran workers. The introduction of AR is thus opening new horizons in civil engineering construction, long described as a world of intuition and experience.

Digitization of Construction Sites Enabled by AI and IoT

Alongside AR, AI (artificial intelligence) and IoT (Internet of Things) are also important technologies supporting the digitization of construction sites. IoT connects “everything” on the site to the internet and collects and shares data from various sensors and machines. AI analyzes that vast amount of data to enable optimization and prediction that were previously difficult for humans. By utilizing these technologies, previously unseen site conditions can be visualized, improving the quality and speed of decision-making.

Examples of AI and IoT applications in construction include the following.

• Equipment and vehicle operation management: By equipping construction machinery and vehicles with GPS and various sensors, their operation status can be monitored in real time and data sent to the cloud via IoT. With AI, this data can be used to automatically analyze fuel consumption and utilization rates and to plan optimal machine allocation. This reduces idling time and improves heavy-equipment utilization efficiency, leading to cost savings and shorter construction periods. Remote operation and autonomous construction machinery are also emerging, enabling hazardous tasks to be performed unmanned.

• Environmental and safety monitoring: IoT sensors installed inside and around the site can continuously measure environmental information such as noise, vibration, dust, temperature, and humidity. AI analyzes the collected data and issues alerts when thresholds are exceeded, automating environmental and safety management. Systems that attach IoT tags to workers’ helmets or safety belts to monitor location and vital signs are also becoming common. These systems enable rapid responses to safety issues, such as detecting entry into restricted areas or early identification of heatstroke risk.

• Progress and quality control: AI can analyze site photos and drone footage to automatically assess construction progress or detect discrepancies between as-built conditions and design models. For example, AI can check photos of structures after concrete placement to detect defects or dimensional errors compared to the design drawings—a quality-inspection application. Inspections that were previously manual can now be performed quickly and objectively by AI image recognition, helping to prevent mistakes and reduce labor.

• Optimization of construction planning: By training AI on past construction data and weather information, it can propose optimal task sequences and personnel allocation, or predict schedule delay risks. AI analyzes various site data collected by IoT to formulate more efficient construction and material procurement plans. This data-driven planning can improve productivity without relying solely on veteran intuition.

In this way, AI and IoT form the foundation for realizing a “smart site” by fully utilizing site data. Real-time situation awareness, prediction, and optimization make waste-free operations possible even amid labor shortages. In particular, AI analysis of the vast data collected by IoT allows decisions that once relied on experience to be made on scientific grounds. As a result, safety improvements, advanced quality control, and labor savings progress, leading to a productivity revolution on construction sites.

Smart Construction through the Fusion of AR×AI×IoT

While AR, AI, and IoT are each useful on their own, combining the three makes construction sites even smarter. The synergy created by the combination of real-time data from the field (IoT), the analytical power that turns those data into useful information (AI), and the visual interface that intuitively conveys that information to workers (AR) is the true essence of “smart construction.”

For example, future construction sites might look like this: data related to progress and safety are constantly sent to the cloud from IoT sensors and machines installed throughout the site. AI analyzes that information and presents real-time judgments such as “Task A is behind schedule,” “There may be deformation in the ground at Area B,” or “The optimal combination of machines for today’s work is XX.” Workers and managers can immediately check those AI suggestions and warnings via AR displays in helmet-mounted screens or handheld tablets. In other words, a digital twin of the site—a virtual model constructed in digital space—is kept constantly up to date, and by viewing it through AR, the real site and digital information seamlessly merge.

This AR×AI×IoT fusion dramatically enhances site responsiveness. For example, even slight design-to-construction deviations detected by AI can be highlighted in the AR view seen by on-site workers and corrected immediately. If IoT-monitored equipment anomalies are detected at a predictive level, warnings appear on workers’ AR screens to prevent accidents and downtime. Remote experts can share on-site AR images in real time and review AI analysis results, enabling accurate support and instructions from afar.

In such smart construction, a cycle is created in which everything happening on-site is datafied and feedback is provided instantly. People can always obtain necessary information through AR while many judgments are AI-supported and based on real data backed by IoT. Even without highly experienced veterans, high quality and safety can be ensured using these technologies, and veterans can pass on their tacit knowledge by training AI, raising overall performance. This “collaboration between people and digital” unlocks productivity and creativity that overturn conventional wisdom—the hallmark of smart construction.

Benefits of Smart Construction

The benefits of smart construction (construction DX) are wide-ranging. Here are the main points summarized.

• Dramatic improvement in work productivity: Visual support by AR and automated analysis by AI significantly streamline processes such as surveying, inspections, and meetings. For example, in surveying, one person may be able to perform the work of multiple people, producing the effect of “the workforce effectively doubled” in some cases. Reduced idle time and duplicated tasks allow limited personnel to achieve greater results than before.

• Improved safety: Visually warning of hazardous areas with AR, and increasing tasks that can be performed without humans entering dangerous zones via remote operation or autonomous driving, reduces on-site accident risk. IoT-based monitoring features such as entry detection around heavy equipment and health monitoring of workers are also enhanced, and an AI-driven alert system for abnormalities minimizes human error and oversight. The result is a workplace that is safer and more reassuring for workers.

• Improved quality and reduced rework: Being able to confirm the completed image during construction with AR and having AI check as-built conditions help prevent rework and mistakes. Detecting and correcting discrepancies between design data and site conditions on the spot reduces downstream rework and complaint handling. Construction based on accurate data leads to stable final product quality and improved trust from clients and local residents.

• Labor reduction and skills transfer: Smart construction is an effective solution to chronic labor shortages. Automation and efficiency can reduce required personnel, and if surveying and inspections that were outsourced can be handled quickly in-house, it contributes to better use of human resources and cost savings. AR and AI support enable young or inexperienced workers to perform to a certain standard, making it easier to operate even with fewer skilled workers. Entrusting veterans’ tacit knowledge to digital tools also facilitates cross-generational skills transfer.

In addition to these benefits, adopting cutting-edge technologies can improve the site’s image and help secure younger talent. Construction sites, often avoided as 3K (tough, dirty, dangerous), are beginning to transform into smart and attractive workplaces through digitalization. The trio of efficiency, safety, and quality in smart construction directly strengthens corporate competitiveness.

Conclusion

The trend toward smart construction using “AR civil engineering × AI・IoT” represents a new dawn for the construction industry. It aligns with initiatives such as the Ministry of Land, Infrastructure, Transport and Tourism’s *i-Construction* and on-site DX efforts, and further adoption of digital technologies at many more sites is expected. Facing work-style reforms and labor shortages, the use of AR, AI, and IoT is becoming not an option but an indispensable key technology.

Recently, a new concept called “simple surveying” has emerged, enabling anyone to easily perform surveying and positioning by combining a smartphone with a compact high-precision GNSS receiver to achieve RTK positioning (real-time kinematic). A representative solution is LRTK. LRTK allows palm-sized devices rather than specialized equipment to achieve centimeter-level positioning (cm level accuracy (half-inch accuracy)) and AR display, greatly lowering the barrier to site surveying. This indicates that smart construction technologies are spreading not only to large projects but also to small-scale work and routine tasks.

Smart construction, which transforms sites through technology, has only just begun. In the near future, site scenes where information flows via AR and AI supports operations behind the scenes may become commonplace. Now is the time to consider the effects of introducing these advanced technologies at your own sites. Taking a step toward smart construction could become a major force in leading the future of construction sites.

FAQ

Q1. Do I need expensive equipment or specialized knowledge to introduce AR on-site? A. No, you do not necessarily need costly dedicated equipment or advanced expertise to get started. Recently, solutions have emerged that allow intuitive use of AR simply by attaching a small GNSS receiver to a smartphone or tablet and launching a dedicated app. For example, a smartphone-based AR surveying system like LRTK requires no complicated operations and can be mastered by site staff with a few hours of training. Using familiar devices lowers the barrier to introduction, so you can start easily with smartphone AR.

Q2. Can AR on smartphones or tablets really align positions with an error of only a few centimeters? A. It is possible with dedicated systems. Standard built-in smartphone GPS typically has an error of about 5-10 m (16.4-32.8 ft), but by combining high-precision positioning technology such as RTK-GNSS, positional accuracy can be dramatically improved. If a smartphone’s positioning is corrected by RTK as in LRTK, the gap between a virtual model and the real object can be reduced to a few centimeters or less (a few inches or less). On actual construction sites, accuracy at a level where the AR-displayed design model and the real object almost perfectly match has been confirmed. Therefore, smartphone AR can achieve sufficiently high-precision alignment for practical use.

Q3. Can AR-based positioning and marking be used indoors or in mountainous areas where satellite positioning is hard to receive? A. In environments where GPS or satellite signals are completely blocked (indoors, underground, or in tunnels), it is currently difficult to achieve high-precision AR positioning with existing technologies. In places where satellite signals temporarily degrade, such as among tall buildings or under trees, accuracy may drop or positioning may be interrupted. Even in such cases, it is possible to perform a calibration in an open area and then use the smartphone’s built-in gyroscope and camera visual markers to supplement position for a short time. However, for fully indoor or underground environments, conventional surveying with total stations is still required. On the other hand, LRTK supports signals from Japan’s Quasi-Zenith Satellite System (Michibiki), and high-precision positioning is possible in mountainous areas with open sky even without mobile communication. By selecting the appropriate method for the environment, the coverage area is expected to gradually expand as technology advances.

Q4. Are there benefits to introducing these smart construction technologies on small or short-term projects? A. Yes, definitely. In fact, small projects with limited personnel stand to gain the most from AR solutions that allow one person to perform surveying and as-built management. Tasks that were previously outsourced to surveyors can be handled in-house in a short time, resulting in reduced outsourcing costs and waiting times. For short-term projects, using AR for daily progress checks and as-built inspections allows quick on-the-spot recording and smooth coordination with subsequent processes. Regardless of project size, adopting AR and AI contributes to efficiency and quality improvement, enabling better outcomes with limited resources.

Q5. There are dedicated AR devices like smart glasses—how do they compare with using smartphones? A. Indeed, transparent AR glasses and helmet-mounted displays that enable hands-free use are available and are being trialed in some places. However, at present dedicated glasses are expensive, may have narrow fields of view, and require users to become accustomed to their operation, making widespread on-site use challenging. Using smartphones or tablets leverages devices that most people already use daily and keeps introduction costs relatively low. LRTK was designed as a smartphone-based solution, combining high-precision GNSS positioning with convenient smartphone AR display. A practical phased approach is to start with familiar smartphone AR to experience the benefits on-site and then consider dedicated glasses or other devices as needed.