This is a broader topic complex consisting of multiple concrete research questions to be addressed. The key idea evolves around the use of Pearl's structural causal models as text generation processes and exploring the potentials of contemporary LMs for this purpose. The topic comprises artificial data generation and causal estimation using LLMs.