Sun Research Group at Columbia University
  • Home
  • News
  • PI
  • Team Members
  • Publications
  • Research
  • Teaching
  • Software & Data
  • Presentations
  • Recruitment & Advice
  • ML for Mechanics
  • Home
  • News
  • PI
  • Team Members
  • Publications
  • Research
  • Teaching
  • Software & Data
  • Presentations
  • Recruitment & Advice
  • ML for Mechanics

Collaborative work with Sandia National Lab on design/planning of experiments with Kalman  filter + deep reinforcement learning has published in Computational Mechanics

5/12/2023

0 Comments

 
Our collaborative work with Sandia funded by the LDRD project led by Dr. Sharlotte Kramer has just published in the special issue "Machine Learning Theories, Modeling, and Applications to Computational Materials Science, Additive Manufacturing, Mechanics of Materials, Design and Optimization". The article is available in the Computational Mechanics website [URL].

Experimental data are often costly to obtain, which makes it difficult to calibrate complex models. For many models an experimental design that produces the best calibration given a limited experimental budget is not obvious. This paper introduces a deep reinforcement learning (RL) algorithm for design of experiments that maximizes the information gain measured by Kullback–Leibler divergence obtained via the Kalman filter (KF), see figure below.  
Picture
This combination enables experimental design for rapid online experiments where manual trial-and-error is not feasible in the high-dimensional parametric design space. We formulate possible configurations of experiments as a decision tree and a Markov decision process, where a finite choice of actions is available at each incremental step. 
Picture
Once an action is taken, a variety of measurements are used to update the state of the experiment. This new data leads to a Bayesian update of the parameters by the KF, which is used to enhance the state representation. In contrast to the Nash–Sutcliffe efficiency index, which requires additional sampling to test hypotheses for forward predictions, the KF can lower the cost of experiments by directly estimating the values of new data acquired through additional actions. In this work our applications focus on mechanical testing of materials. Numerical experiments with complex, history-dependent models are used to verify the implementation and benchmark the performance of the RL-designed experiments.
Picture
0 Comments



Leave a Reply.

    Group News

    News about Computational Poromechanics lab at Columbia University.

    Categories

    All
    Invited Talk
    Job Placements
    Journal Article
    Presentation
    Special Events

    Archives

    May 2023
    March 2023
    December 2022
    November 2022
    August 2022
    July 2022
    May 2022
    April 2022
    March 2022
    December 2021
    November 2021
    October 2021
    September 2021
    August 2021
    July 2021
    June 2021
    May 2021
    April 2021
    March 2021
    February 2021
    January 2021
    October 2020
    August 2020
    July 2020
    June 2020
    May 2020
    February 2020
    January 2020
    December 2019
    September 2019
    July 2019
    June 2019
    May 2019
    April 2019
    March 2019
    February 2019
    December 2018
    October 2018
    September 2018
    August 2018
    July 2018
    June 2018
    May 2018
    April 2018
    March 2018
    January 2018
    December 2017
    November 2017
    October 2017
    September 2017
    August 2017
    July 2017
    June 2017
    May 2017
    April 2017
    March 2017
    February 2017
    January 2017
    December 2016
    November 2016
    October 2016
    May 2016
    April 2016
    March 2016
    February 2016
    January 2016
    November 2015
    October 2015
    September 2015
    August 2015
    July 2015
    June 2015
    May 2015
    March 2015
    February 2015
    January 2015
    December 2014
    November 2014
    October 2014
    September 2014
    August 2014
    July 2014
    June 2014
    May 2014
    April 2014
    March 2014
    February 2014
    January 2014
    November 2013
    September 2013

    RSS Feed

Contact Information
Prof. Steve Sun
Phone: 212-851-4371 
Fax: +1 212-854-6267
Email: wsun@columbia.edu
Copyright @ 2014-2022.  All rights reserved.