Machine learning models for physics and engineering
The main objective of physics is to understand nature, and one way to achieve this is to build models of the natural phenomenon of interest. For centuries, physicists have been pushing the limits of our knowledge, and in recent years we have commonly begun to encounter challenges where our physics-driven models are either not accurate enough, or too complex, to be useful. In these situations, machine learning models can give a helping hand.
|Figure 1 Three different models for the shape of the Earth.|
We frequently experience situations where our physics models are either not accurate enough (Model X, Fig. 3) or computationally too complex (Model Y, Fig. 3) to satisfy our application (Blue shaded area, Fig. 3). Machine learning can help in two fundamental ways (Figure 3): (1) It can improve accuracy, without increasing the complexity. (2) It can decrease complexity without a loss of accuracy. Let's see some examples for both.
|Figure 3 Two physics-based models X and Y out of specification. Two ways machine learning can help (1) by increasing accuracy or (2) by decreasing computational complexity.|
In one of our recent projects on building a novel particle size analyzer, the particle scattering model based on Mie theory was not accurate enough for the application. Using a machine learning model (random forests) we were able to build a model for particle size prediction that satisfied the specifications. You can read more here in our paper. In this case, we were able to increase model accuracy without increasing computational complexity (Figure 3, (1)). In another project related to microscopy, the image reconstruction algorithm based on physical diffraction laws took around 10 minutes to run, hindering the ability of the microscope to provide "live" images. We helped our collaborators by developing a deep learning model that can achieve the same construction in less than 1 second. Here, we were able to simplify the computational complexity of the calculation, while not sacrificing any accuracy (Figure 3, (2)).
But how can machine learning achieve these impressive results? As we discussed, every model requires assumptions. Often, the more/strong assumptions you make, the more you lose accuracy. Physical models require some strong assumptions (no multiple scattering, the particles are perfect spheres, etc.) whereas for building machine learning models you make weaker assumptions (this random forest has enough capacity to learn the scattering relationship from this dataset). As for the computational complexity, of course, it does not vanish. Rather you push it to the training phase of machine learning model development. In other words, creating the model might take time, but once the model is trained and ready to use, it generates new predictions very quickly.
Machine learning has the potential to transform many areas: from sensing to materials discovery, to imaging, to optimal control of dynamic systems. If you are interested in improving your models through machine learning get in touch with us!