Evaluation of reinforcement learning in transformer-based molecular design
Artikel i vetenskaplig tidskrift, 2024

Designing compounds with a range of desirable properties is a fundamental challenge in drug discovery. In pre-clinical early drug discovery, novel compounds are often designed based on an already existing promising starting compound through structural modifications for further property optimization. Recently, transformer-based deep learning models have been explored for the task of molecular optimization by training on pairs of similar molecules. This provides a starting point for generating similar molecules to a given input molecule, but has limited flexibility regarding user-defined property profiles. Here, we evaluate the effect of reinforcement learning on transformer-based molecular generative models. The generative model can be considered as a pre-trained model with knowledge of the chemical space close to an input compound, while reinforcement learning can be viewed as a tuning phase, steering the model towards chemical space with user-specific desirable properties. The evaluation of two distinct tasks—molecular optimization and scaffold discovery—suggest that reinforcement learning could guide the transformer-based generative model towards the generation of more compounds of interest. Additionally, the impact of pre-trained models, learning steps and learning rates are investigated. Scientific contribution Our study investigates the effect of reinforcement learning on a transformer-based generative model initially trained for generating molecules similar to starting molecules. The reinforcement learning framework is applied to facilitate multiparameter optimisation of starting molecules. This approach allows for more flexibility for optimizing user-specific property profiles and helps finding more ideas of interest.

Generative model

Molecular optimization

Scaffold discovery

Tanimoto similarity

Transformer

QSAR

Reinforcement learning

Författare

Jiazhen He

AstraZeneca AB

Alessandro Tibo

AstraZeneca AB

Jon Paul Janet

AstraZeneca AB

Eva Nittinger

AstraZeneca AB

Christian Tyrchan

AstraZeneca AB

Werngard Czechtizky

AstraZeneca AB

Ola Engkvist

Chalmers, Data- och informationsteknik

AstraZeneca AB

Journal of Cheminformatics

1758-2946 (ISSN) 17582946 (eISSN)

Vol. 16 1 95

Ämneskategorier

Data- och informationsvetenskap

DOI

10.1186/s13321-024-00887-0

Mer information

Senast uppdaterat

2024-08-23