Traditionally, metrology focuses on maintaining traceability in measurements. Through chains of calibrations, measurements are ensured to be reliable and comparable.

"For AI models to be trustworthy, traceable and quality-assured measurements are needed as inputs. This makes model predictions more reliable," says Olle Penttinen, a researcher in volume and flow, specializing in IoT and AI solutions within metrology and predictive maintenance.

For measurements to be traceable and quality-assured, taking measurement uncertainty into account is essential.

"Measurement uncertainty is important in measurement technology because all measurements contain errors. We have valuable knowledge in uncertainty analysis, which can also be applied to AI and machine learning," says Olle Penttinen.

Predictive Maintenance

He has experience from AI projects in predictive maintenance, where the goal is to use machine learning to predict where maintenance needs exist, thereby preventing damage before it occurs.

"To achieve this, we need to understand the uncertainties both in the factors used to train the models and in the model's predictions. Just as with physical measurements, we should analyze how different factors affect the total uncertainty," says Olle Penttinen.

Trusting AI

For companies to take the leap and use AI to, for example, optimize their production or maintenance, trust is needed in the quality of the predictions. Ensuring this requires model validation. What uncertainty exists in the predictions produced by the model?

"We need to be able to trust the results, and just as measuring instruments need calibration, AI models need validation," says Olle Penttinen.

As an independent research institute, RISE has is in a unique position to work on validating AI models. Validation involves examining the outcomes or predictions generated by the model and determining how accurate they are through measurements and experiments.

"Sometimes it's difficult to fully understand how models function internally, but ultimately, it’s the prediction output that matters. To confidently use the technology, we need to know how accurate the predictions are, that the models are robust, and that the results are reproducible," says Olle Penttinen.

Correlation and Causality

Considering the advancements in large language models over recent years, it’s not surprising that there’s sometimes wishful thinking about what AI can achieve.

"It’s easy to believe that AI can magically solve the impossible. However, in industrial and business applications, language models are often not used; instead, simpler models are applied. Here, the amount of training data is smaller, while the demand for prediction quality may be higher," says Olle Penttinen.

Higher quality in predictions with less training data? To achieve this, an understanding of which factors influence the outcome is essential. Otherwise, a variable with only indirect influence might be overinterpreted. There’s a difference between correlation and causality; just because something is related doesn’t mean it causes the other.

"For instance, say we use an AI model to predict the probability of damage to individual pipeline segments in a water or district heating network. The training is based on a maintenance log where various pipes have been dug up over the years, with several factors recorded for the replaced pipes, such as pipeline length. Including pipeline length in the training could potentially improve the model’s precision—there is a correlation between pipeline length and the likelihood of damage. However, this provides a potentially weaker decision support for the network owner, as the causality is absent. The damage isn’t due to the pipeline length itself," says Olle Penttinen.

Connecting Input Data to Outcome

When using so-called "supervised learning," as in the example above, it’s necessary to link the factors the model is trained on to the outcome. In the case of the pipelines, the same parameter must be present in information about both the damaged and undamaged pipes.

"Acoustic methods, for example, can estimate wall thickness in a pipeline network. But if wall thickness data is missing for damaged pipes, it becomes challenging to link it to damage risk. For the model to predict outcomes accurately, there must be a clear connection between the input data and the result," says Olle Penttinen.

Challenging to Handle Data – But Measure Anyway

The challenge of managing data is a time-consuming aspect in AI model development and is highlighted as one of the central areas to further develop within the Advanced Digitization program, led by Vinnova in partnership with industry. Despite the challenges of handling data, Olle Penttinen is clear that more data is beneficial:

"Do not be afraid to measure and record parameters that can indirectly influence the quality of a product or process, such as ambient temperature or humidity. The day will come when these measurements are sought after as input for new models and research ideas. You are also welcome to reach out to us at RISE for support, for example, regarding quality-assured measurements as input for models or validation of the models," says Olle Penttinen.

Good measurements are essential for ensuring that products and services meet high-quality standards, thereby enhancing customer satisfaction and brand strength. Accurate and reliable measurements in production enable companies to optimize processes, reduce material waste, lower production costs, improve profitability, and, most importantly, make operations more sustainable. In most industries, there are legal requirements and standards to comply with, helping avoid fines, recalls, or production halts. Moreover, better measurements pave the way for developing new products and services, shortening time-to-market.

“A company’s products need to maintain sufficient quality, be produced efficiently, and meet all necessary requirements to fulfill customer needs. In this way, good measurements are the foundation of a company’s competitiveness,” says Jan Johansson, head of RISE National Laboratories.

Sufficiently Accurate and Cost-Effective

RISE's National Laboratories generally operate at the highest international level. However, good measurements are not about achieving the highest possible accuracy in every situation. Instead, they are about being sufficiently accurate in the most cost-effective way.

"The foundation of a good measurement is achieving an uncertainty level that meets the application’s needs. If the uncertainty is too high, the company risks the product not meeting requirements. On the other hand, if the uncertainty is smaller than necessary, measurement costs increase,” says Jan Johansson.

Reducing Risk in Decision-Making

Fredrik Hägglund, head of the metrology department at RISE, emphasizes that good measurements provide better decision-making data and reduce risks related to product development, investments, or operational optimization – whether decisions are made by a person or a computer.

“Measurement systems in industrial processes and infrastructure, such as electricity and heating, have become increasingly complex, with connected sensors measuring continuously throughout production. In products requiring high reliability, such as modern vehicles, numerous measurement systems must work together. The advantage is the potential for better and faster decisions, such as automatically controlling flows or temperatures to maximize process output. But challenges remain. Sensors can be hard to access or disconnect for calibration, and managing the massive amount of generated data to make it meaningful is no small feat,” says Fredrik Hägglund.

He continues: “If some sensors drift and show incorrect values, the risk is that you or your control system draw incorrect conclusions and make decisions based on faulty data. That’s why there’s a significant need to work on measurement quality in these complex systems.”

Jan Johansson agrees: 

“All too often, machines and sensors are installed with blind faith that everything works as intended. If instruments provide incorrect readings, there are no processes in place to detect and address the issue. That said, many companies are skilled and aware, as evidenced by the increasing number of calibrations we perform at RISE every year,” says Jan Johansson.

A Mindset

Calibration of measuring instruments is important, but both agree that good measurements involve more than that.

“We measure everywhere, all the time, in both business and society. Yet most measurements are not quality-assured in the sense that people actively evaluate and ensure they meet requirements and needs optimally. To me, it’s about a mindset – being aware of why we measure, how we handle instruments and methods, and reasoning about how to evaluate measurement results and make decisions based on them,” says Fredrik Hägglund.

Building strategies on reliable data is not just a technical necessity but a strategic investment that helps businesses stay innovative, efficient, and compliant. In the end, it leads to increased competitiveness and long-term growth. By following the checklist below, your company can make significant progress.

“You’re also welcome to contact us at RISE for support with all metrology-related issues and challenges, whether it’s calibration, measurement methods and interpretation, organizing metrology efforts, integrating new sensors, commissioned research, development projects, or something else entirely,” says Fredrik Hägglund.