Five Criteria to Assess the Reliability of Solar Power Generation Simulations

When considering the introduction of solar power generation, generation simulations become an important decision-making tool. However, simulation results are calculated figures and do not guarantee identical outcomes on site. For that reason, practitioners need a perspective to judge how trustworthy the presented generation figures are instead of accepting them at face value. This article explains five criteria for judging the reliability of solar power generation simulations in a form that is easy to use when considering installation or comparing vendors.

Table of contents

• Why the reliability of solar power generation simulations matters

• Criterion 1: Are the input conditions consistent with on-site realities?

• Criterion 2: Are the assumptions about solar irradiance and weather conditions reasonable?

• Criterion 3: Are the effects of shading, azimuth, and tilt reflected?

• Criterion 4: Are generation losses and aging realistically accounted for?

• Criterion 5: Is the relationship between generation and power consumption explained?

• Common traits of low-reliability simulations

• Points to confirm with vendors

• On-site measurement accuracy improves simulation reliability

• Summary

Why the reliability of solar power generation simulations matters

Solar power generation simulations are documents that predict generation before installation. They are indispensable for practitioners to understand how much can be generated annually, how generation changes month by month, and how much can be consumed on-site. Especially when considering solar for factories, warehouses, stores, offices, public facilities, or multi-family housing, there are many situations where simulation results are checked to judge system scale and operational effects.

However, generation simulations are, after all, predicted values calculated from input conditions. If the conditions used in the calculations change, results vary even for the same building or site. Small differences in roof area, azimuth, tilt, surrounding shading, local solar irradiance, system capacity, generation losses, or assumptions about power consumption can change the appearance of annual generation and self-consumption. Therefore, proceeding with installation decisions without checking the simulation’s reliability may lead to problems such as lower-than-expected generation, excessive surplus power, or lack of expected benefits after installation.

A reliable simulation is not simply one that shows a large generation figure. It accurately reflects on-site conditions, realistically accounts for solar irradiance, shading, losses, and operational conditions, and can explain the basis of its figures. Conversely, simulations that emphasize only large annual generation while leaving assumptions and loss breakdowns unclear should be treated cautiously despite their appealing appearance.

What practitioners should look at is not just the generation numbers themselves but the conditions from which those numbers are derived. Simulations provide a common language for comparing proposals. When receiving proposals from multiple vendors, annual generation, system capacity, installation layout, monthly generation, and self-consumption rates may differ. To interpret those differences, you need criteria to judge reliability.

Being able to spot reliable simulations makes it harder to be swayed by overly optimistic proposals and easier to understand the value of conservative-looking proposals. A proposal showing somewhat modest generation that carefully accounts for shading and losses may be closer to actual post-installation performance. Conversely, a proposal showing large generation that does not fully reflect local shading or system constraints may set expectations too high.

Solar power systems are not “install and forget”; they are equipment intended for long-term operation. A wrong decision at installation can affect long-term operation plans and power usage strategies. Thus, discerning the reliability of generation simulations is not mere paperwork—it is a crucial task that affects business decisions.

Criterion 1: Are the input conditions consistent with on-site realities?

The first criterion for judging the reliability of solar power generation simulations is whether the input conditions match on-site realities. No matter how advanced the calculation, if the on-site conditions inputted are incorrect, the results are hard to trust. Simulations are calculated based on site information, so it is essential that roof or site dimensions, azimuth, tilt, surrounding environment, and feasible installation areas are correctly reflected.

First, confirm the information about the surfaces considered for installation. For roof installations, relevant items include roof area, shape, azimuth, tilt, locations of rooftop equipment, inspection walkways, drainage routes, lightning protection, and railings. For ground-mounted systems, relevant items include site shape, elevation differences, neighboring boundaries, surrounding buildings and trees, access routes for maintenance, and future usage plans. The reliability of the simulation depends on whether these are treated only roughly or based on on-site confirmation.

Simulations based solely on drawings can deviate from the current situation. Equipment not reflected in as-built drawings may have been added to the roof, piping or outdoor units may have increased, or new buildings or structures may have been erected nearby. A location that looks installable on a drawing might in reality require inspection space or safety clearances. Reliable simulations reflect such on-site realities as much as possible.

Also important as input conditions is how the installable area is determined. You cannot simply use the entire roof or site. Considerations such as edge clearances, maintenance paths, space around existing equipment, load-bearing limits, and constructability during installation are necessary. Overestimating the installable area inflates system capacity and generation. If the number of panels is reduced during detailed design, simulation results will be revised downward.

Whether an on-site survey was conducted is also important when checking input conditions. Rough simulations are acceptable at the initial study stage, but as decisions approach the installation stage, it is desirable to reconfirm conditions based on on-site surveys. Simulations created without visiting the site should be treated as preliminary estimates. Differentiating proposals that have been confirmed on-site from those based only on drawings or interviews makes it easier to judge the reliability of the figures.

Furthermore, check whether input conditions are clearly stated in the proposal. Even if azimuth, tilt, system capacity, installation surface, assumed panel count, and expected generation are shown, it is difficult to verify validity without the underlying dimensions and shading conditions. A reliable proposal at least explains the main input conditions.

Checking whether input conditions match on-site realities is the starting point for evaluating a simulation’s reliability. Before looking at generation numbers, confirm where, at what scale, in what orientation, and under what conditions the installation is assumed. Even this single criterion helps distinguish simulations with weak justification from those usable in practice.

Criterion 2: Are the assumptions about solar irradiance and weather conditions reasonable?

The second criterion that affects the reliability of solar power generation simulations is whether the assumptions about solar irradiance and weather conditions are reasonable. Since solar power generates electricity from sunlight, regional irradiance, seasonal weather patterns, temperature, snowfall, and cloudiness greatly affect generation. Even with the same system capacity, annual generation varies with irradiance conditions.

When checking irradiance assumptions, confirm which regional meteorological data are used. Results differ in accuracy depending on whether data from a location close to the site or broad-area averages are used. Even neighboring points can show different irradiance conditions in mountainous areas, coastal zones, urban areas, snowy regions, or fog-prone areas. If a simulation shows high generation, check whether the irradiance assumptions are overly optimistic.

Monthly irradiance conditions—not just annual averages—are also important. Solar generation changes seasonally; generation typically increases from spring to summer and declines in winter as the sun’s altitude and daylight hours decrease. However, summer heat can also reduce output. In some regions, the rainy season or snowfall affects generation. Reliable simulations should show realistic monthly generation trends as well as annual totals.

Temperature assumptions must not be overlooked. Solar panels generate more with stronger irradiance but their output drops as temperature rises. Thus, if summer irradiance is high but temperature-related losses are not considered, generation can be overestimated. Check how temperature-related losses are handled in the proposal to assess realism.

In snowy regions, snow impacts are significant. Snow on roofs or panels can cause periods of no generation. Whether panels are at an angle that allows snow to slide off easily, whether there is space for snow accumulation nearby, and how much winter generation is assumed will affect annual generation reliability. If winter generation is shown as high in a snowy area, confirm how snow effects were treated.

Note that meteorological conditions are often treated as long-term averages and may not match a single year’s actual performance. One year may be unusually sunny while another is cloudy and rainy. Reliable simulations use long-term reasonable assumptions rather than assuming a single year of exceptional conditions. Practitioners should understand simulation results not as absolute values but as forecasts that include expected variability.

When irradiance and weather assumptions are reasonable, simulation results are closer to reality. Conversely, if only annual generation is shown while these assumptions remain unclear, there is insufficient basis to judge the numbers. When receiving proposals, confirm the solar irradiance data used, monthly generation tendencies, and how temperature and snowfall are treated to check consistency with regional characteristics.

Criterion 3: Are the effects of shading, azimuth, and tilt reflected?

The third criterion for judging the reliability of solar power generation simulations is whether the effects of shading, azimuth, and tilt are appropriately reflected. These factors strongly influence generation at each installation site and can cause large differences in results even with the same system capacity. The treatment of shading is especially important when judging realism.

Sources of shading include surrounding buildings, neighboring structures, trees, utility poles, signs, rooftop equipment, penthouses, railings, piping, and chimneys. The length and direction of shadows change by time of day and season. Shading that is negligible in summer can become significant in winter when the sun’s altitude is low. Some locations get shaded only in the morning or evening, while others are strongly affected in particular seasons.

Reliable simulations do not ignore shading and reflect its impact on generation as much as possible. Especially for buildings with many rooftop units or sites surrounded by tall buildings, shading analysis is indispensable. Installing panels in shaded areas can affect generation more than the shaded area alone would suggest. Partial shading on panels can reduce the efficiency of the entire system.

Azimuth is also important. Generally, surfaces closer to south-facing tend to have higher annual generation, but east- or west-facing surfaces are not necessarily disadvantaged. East-facing arrays favor morning generation and west-facing arrays favor afternoon generation. Depending on facility power usage patterns, the timing of generation can be as important as total generation. Confirm that the simulation realistically handles generation by azimuth and time-of-day tendencies.

Tilt angle affects generation too. Changing tilt alters how the seasons affect irradiance. For roof-mounted systems, tilt usually follows the existing roof slope and may not be adjustable to the optimum angle. For flat roofs or ground-mounted systems, racking can set the angle, but increasing tilt affects inter-row shading, wind loading, spacing, and constructability. If tilt is set only to maximize generation without matching actual installation conditions, reliability decreases.

When reviewing vendor proposals, check whether shading, azimuth, and tilt are considered together. For example, a south-facing roof with a large adjacent building shadow may not generate as much as expected. Conversely, a slightly less favorable azimuth combined with little shading and alignment with facility usage hours may be a practical advantage. It is important to understand conditions by installation surface rather than judging by annual generation alone.

Low-reliability simulations often show high generation without adequate shading explanation. If the surrounding environment includes shading factors but shading-related generation reductions are scarcely reflected, be cautious. Also watch for calculations using azimuth or tilt that differ from the actual conditions.

Shading, azimuth, and tilt are difficult to understand without visiting the site. Checking how much these aspects are explained in the proposal and whether the vendor can answer questions concretely will help you spot reliable simulations.

Criterion 4: Are generation losses and aging realistically accounted for?

The fourth criterion for judging the reliability of solar power generation simulations is whether generation losses and aging are realistically accounted for. Solar systems do not continuously deliver maximum output under ideal conditions. In practice, various loss factors reduce theoretical generation. How these losses are treated greatly affects simulation reliability.

Many types of generation loss exist. Typical examples include temperature-induced output reduction, power conversion losses, wiring losses, soiling of panel surfaces, shading effects, equipment downtime, snowfall, output curtailment, and equipment variability. Sometimes each of these is calculated in detail; other times they are aggregated into a single loss rate. In either case, the important point is whether the loss approach can be explained.

If losses are estimated small, simulated generation increases. Conversely, conservative loss estimates lower generation. Practitioners should not immediately favor proposals with high generation but should check the assumed loss rates. When comparing multiple proposals and one shows significantly higher generation, determine whether it is due to larger system capacity, better irradiance assumptions, or smaller assumed losses.

Temperature-related loss is particularly easy to overlook. While panels generate more under strong irradiance, increased panel temperature reduces output. In summer, when irradiance is high but temperatures are also elevated, estimating generation solely by irradiance can lead to overestimation. Systems mounted close to the roof or with poor ventilation are more susceptible to temperature rise.

Assumptions about soiling and maintenance are also important. Panel surfaces accumulate dust, pollen, leaves, bird droppings, and exhaust-related grime. Rain removes some contaminants, but depending on the environment, soiling can accumulate. Check how much loss due to soiling is assumed in the simulation and whether cleaning and inspection practices are part of the assumptions to gain insight into long-term operational realism.

Don’t forget aging. Solar systems are long-lived assets and their output gradually declines over time. It is important to know not only first-year generation but also how generation is projected after several years or decades. For long-term investment decisions, it is insufficient to rely only on first-year estimates. Confirm whether the simulation is a first-year forecast or a long-term projection that includes degradation.

Operational downtime and maintenance impacts also occur in reality. Inspections, equipment replacements, fault responses, blackouts, and grid-side constraints can create temporary generation downtime. Precisely predicting all events is difficult, but assuming continuous ideal operation does not reflect reality for long-term planning.

Reliable simulations adopt realistic, not overly optimistic, assumptions for losses and aging. A proposal that appears modest in generation but carefully accounts for losses may be closer to real operation. Practitioners should prioritize whether loss assumptions are convincing rather than the absolute size of generation figures.

Criterion 5: Is the relationship between generation and power consumption explained?

The fifth criterion for judging the reliability of solar power generation simulations is whether the relationship between generation and power consumption is explained. Solar generation is not an end in itself; the important question is how generated power will be utilized. For commercial or organizational facilities, assessing self-consumption effects requires looking at the temporal relationship between generation and consumption.

Even with high annual generation, if the facility cannot consume that power on-site, the perceived benefits change. Facilities with high daytime demand may pair well with solar. Conversely, facilities mainly operating at night or with many holidays may experience surplus generation. If a simulation shows self-consumption rate or surplus power, confirm how well actual power usage is reflected in those calculations.

Reliable simulations explain the relationship between generation and the facility’s power consumption. Considering monthly consumption, daytime vs nighttime usage trends, weekday vs weekend differences, and seasonal load fluctuations makes it easier to estimate realistic self-consumption. In contrast, calculating self-consumption roughly from annual usage alone may deviate from actual operation.

For example, a facility with large annual consumption may still have low self-consumption if its demand during solar generation hours is small. Conversely, a facility with modest annual consumption but stable daytime load can use generated power efficiently. Thus, time-of-day matching is crucial for judging self-consumption, not just annual totals.

Oversized system capacity can increase generation but also surplus. Even if a proposal shows high annual generation, it may not be optimal if the self-consumption share is low. Practitioners should check the balance with power consumption rather than focusing solely on maximizing generation. If an overly large system is proposed, ask why that scale is justified.

When combining storage or power control, separate the analysis of generation and consumption. Storage can shift surplus to other times, but charging/discharging losses and operational constraints apply. Confusing the effects of solar-only generation with those of storage and control can lead to misunderstanding simulation results.

Reliable simulations clearly explain the relationship between generation, self-consumption, and surplus power. It is important not only to present annual generation but also to explain when that power is produced, how much can be used in the facility, and how much will remain surplus. If you intend to use simulations for installation decisions, assessing usable power as well as generated power is essential.

Common traits of low-reliability simulations

Low-reliability solar power generation simulations share several common traits. Knowing these helps quickly spot issues when reviewing proposals. The numbers may not necessarily be wrong, but when generation is shown without sufficient justification, caution is warranted for decision-making.

First, be wary of proposals that emphasize only large annual generation. While annual generation is important, it alone cannot determine reliability. Without monthly generation breakdowns, per-surface conditions, system capacity, shading impacts, loss rates, and self-consumption assumptions, you cannot verify the figure’s validity. Low-reliability simulations tend to lead with results rather than explaining their basis.

Second, be cautious of proposals that provide little explanation of on-site conditions. If they present generation based only on rough estimates without addressing site dimensions, azimuth, tilt, surrounding obstacles, rooftop equipment, or inspection space, the design can change significantly in the detailed stage. Rough estimates are acceptable in initial studies, but near a decision point, revalidation based on on-site conditions is necessary.

Simulations with unclear loss assumptions are also hard to judge. Because generation losses always occur, how they are treated matters. If you cannot tell whether temperature, conversion, wiring, soiling, shading, or aging are included, generation may be overestimated. A low assumed loss rate is not inherently bad, but if it cannot be justified, concerns remain.

Be careful with proposals that handle shading vaguely. If there are surrounding buildings or equipment but shading impact is scarcely explained, generation could be higher than reality. Winter shadows extend more, so monthly generation can reveal inconsistencies. If winter generation seems unnaturally high or many panels are placed in likely shaded areas, request clarification.

Also watch for proposals that claim high self-consumption rates without explaining power usage assumptions. If only annual consumption is used to calculate a high self-consumption rate, timing mismatches may be ignored. Because solar generates during daytime, the extent of daytime demand matters. If self-consumption rates are presented without time-of-day usage trends, treat them as rough estimates.

Low-reliability simulations often become vague when asked to explain their basis. When you ask about the basis for generation figures, irradiance assumptions, shading evaluation, loss rates, system capacity rationale, and self-consumption calculation methods, check whether concrete explanations are given. The ability to explain the numbers matters as much as whether they are large or small.

Points to confirm with vendors

To spot reliable solar power generation simulations, it helps to have a checklist of points to confirm with vendors. When you receive a proposal, comparing proposals without a framework can lead to judging by annual generation or superficial materials. Deciding in advance what to check allows you to read differences calmly.

First, confirm how on-site conditions were obtained. Whether the vendor conducted an on-site survey, calculated from drawings only, or used interview-based information changes the simulation’s standing. Clarify whether the proposal is a preliminary estimate for early study or a high-accuracy calculation suitable for decision-making. If on-site surveys were conducted, confirm the scope—did they check shading factors, reflect rooftop equipment and obstacles, and so on?

Next, confirm the assumptions about solar irradiance and weather. Ask which regional data were used, whether monthly irradiance is reflected, and whether snowfall and high-temperature effects are considered. This helps judge consistency with regional characteristics. For proposals that appear to show high generation, be sure irradiance assumptions are realistic.

Ask about the rationale for the installation layout. Why were panels placed in those locations? Why was that capacity chosen? If some surfaces were excluded, why? These questions reveal the thinking behind the proposal. Whether the layout prioritizes maximizing generation or emphasizes maintainability and safety affects evaluation. In practice, not only generation but also post-installation inspection and maintenance matter.

Also ask for the loss rate breakdown. Beyond an aggregate loss rate, ask how temperature, conversion, wiring, soiling, shading, and aging are treated. Even if each item cannot be quantified precisely, it is important that the vendor can explain the approach used to adjust generation. Proposals that ignore losses or assume extremely small losses may differ substantially from actual generation.

Confirm assumptions about self-consumption as well. If self-consumption rate or surplus power is shown, ask whether the power data used were annual, monthly, or time-of-day values. Check whether facility operating hours, holidays, seasonal changes, and planned future equipment additions are reflected for a more realistic assessment.

When asking vendors questions, do not just ask whether the generation figure is correct—ask which assumptions were used to calculate it. Simulations are forecasts and do not produce perfect answers. But if assumptions are clear, you can understand the meaning of figures and compare proposals. More reliable vendors can explain not only calculation results but also assumptions and risks.

On-site measurement accuracy improves simulation reliability

On-site measurement accuracy is extremely important for improving the reliability of solar power generation simulations. Simulations predict generation based on entered conditions. Therefore, if the installation location’s position, dimensions, azimuth, tilt, obstacles, and surrounding environment are not accurately known, the calculations will deviate. When on-site measurements are vague, no matter how carefully you calculate, reliability has limits.

Especially where roofs or sites have complex shapes, measurement accuracy greatly affects results. For buildings with multiple roof planes, facilities with many rooftop units, sites near tall surrounding buildings, or ground installations with elevation differences, accurate positional information is necessary for panel layout and shading evaluation. Areas that look simple on drawings may have obstacles or clearance constraints that narrow feasible installation zones.

Accurate on-site measurements reduce rework during the design stage. If the proposed layout from the initial simulation changes during detailed design or construction, generation and self-consumption estimates also change. The greater the change, the larger the gap between decision-stage assumptions and actual plans. Obtaining accurate on-site information early increases simulation reliability and reduces misunderstandings among stakeholders.

Accurate on-site measurements also help when comparing vendor proposals. When multiple vendors create simulations with different assumptions, it becomes hard to tell whether generation differences stem from design skill or input condition differences. If your organization organizes basic on-site information, you can present the same conditions to each vendor for a fair comparison.

On-site information should include not only candidate surface dimensions and azimuth but also obstacle locations, inspection paths, surrounding structures, site boundaries, and planned equipment updates. If rooftop equipment additions are likely or site usage changes are expected, that information affects simulation assumptions. Because solar power systems are operated long-term, organizing on-site information with future usage in mind is advisable.

On-site measurement does not directly increase generation. However, with accurate on-site information you can consider realistic layouts, feasible generation estimates, appropriate system capacities, and maintainable access paths. In other words, it forms the foundation for improving simulation reliability.

If you plan to obtain accurate positional information on site and use it to support installation studies or simulation assumptions, using LRTK, an iPhone-mounted high-precision GNSS positioning device, is effective. Recording candidate locations, obstacles, equipment positions, site boundaries, and inspection routes on site makes it easier to verify simulation assumptions and compare vendor proposals. To make solar power generation simulations reliable decision-making materials, it is important to build a system that captures the site accurately as well as evaluating calculation results.

Summary

To assess the reliability of solar power generation simulations, do not look only at annual generation numbers; confirm the assumptions from which those numbers are derived. Reliable simulations treat on-site conditions, solar irradiance, shading, azimuth, tilt, generation losses, aging, and the relationship with power consumption realistically. Conversely, simulations that show large generation without clear assumptions should be read carefully.

The first criterion is whether input conditions match on-site realities. If roof or site dimensions, azimuth, tilt, surrounding equipment, obstacles, or inspection spaces are not correctly reflected, generation forecasts will deviate. The second is whether assumptions about solar irradiance and weather are reasonable—check regional irradiance, monthly weather, temperature, and snowfall.

The third is whether shading, azimuth, and tilt effects are reflected. Shading varies by time of day and season and significantly affects generation. The fourth is whether generation losses and aging are realistically accounted for; check for underestimation of temperature, conversion, wiring, soiling, shading, downtime, and degradation. The fifth is whether the relationship between generation and power consumption is explained—evaluate how much generated power can actually be used on-site and whether self-consumption and surplus assumptions match reality.

When practitioners review simulations, they should prioritize transparency and explainability of assumptions rather than assuming that higher generation means a better proposal. Confirming how on-site conditions were obtained, irradiance assumptions, shading evaluation, loss rate breakdown, and self-consumption calculation methods helps reveal a proposal’s reliability.

Furthermore, improving simulation reliability requires accurately obtaining on-site information. If the location, roof or site shape, obstacles, surrounding structures, and inspection targets are accurately captured, the basis for generation estimates becomes clear and comparing vendor proposals becomes easier. If on-site information is vague, comparing proposals is difficult.

If you want to capture accurate positional information in the field and use it for installation studies or to structure simulation assumptions, using LRTK, an iPhone-mounted high-precision GNSS positioning device, is effective. Recording candidate sites, obstacles, equipment positions, site boundaries, and inspection routes on site helps verification of simulation assumptions and vendor proposal comparison. To make solar power generation simulations a reliable basis for decision making, it is important to set up a process that accurately understands the site as well as evaluating calculation methods.