User Manual


User Manual for Materials Consumption Simulator

中文版 物料消耗模拟器用户指南
Materials Consumption Simulator Materials Consumption Simulator

1. Why Simulate

1.1. The Base Scenario C0

Imagine you are the Project Manager (PM) overseeing a single-center randomized controlled trial (RCT). The trial design is presented in Figure 1.

Figure 1. Base Scenario C0

The trial protocol specifies that 40 patients who meet the inclusion and exclusion criteria will be randomized into two treatment arms: Arm T and Arm R, with an allocation ratio of 1:1. Each patient will receive two kits of materials, one on Day 1 and one on Day 14.

The theoretical consumptions of materials is relatively straightforward to calculate:

Since this is a single-center trial, it is relatively straightforward for you, as the PM, to ensure that the correct amount of materials are shipped to the center. In this case, you can justify that at least 40 kits of T and 40 kits of R should be shipped to the center to cover the expected consumption. However, to account for potential unforeseen circumstances, you decide to add a small buffer. Based on your experience and historical data, you anticipate a 5% chance of re-dispense due to various factors such as:

To mitigate the risk of running out of materials, you decide to ship an additional 5% of the original required amount for each arm. This results in 42 kits for T and 42 kits for R.

C0 is a clear example of how, in trials with simple logistics and predictable needs, a manual approach can be sufficient, making simulations unnecessary for material supply planning.

1.2. The Alternative Scenarios Ccenter=2

You’re facing significant pressure to advance the timeline of your trial. To accelerate patient accrual, you decide to expand from a single-center to a multi-center RCT. Now, you have two centers to manage. The key question becomes:

Let’s break down the questions and challenges you're likely facing:

Central Randomization and Patient Enrollment Distribution

Under the framework of central randomization, patients are randomly assigned to either Arm T or Arm R. Since the total number of patients across all centers is fixed at 40, there are 41 possible enrollment outcomes for the two centers—ranging from 0 to 40 patients being enrolled at Center 1, with the remaining patients assigned to Center 2. Each outcome results in a different combination of patients in each arm at both centers.

Uncertainty in Material Requirements

Given the uncertainty in how patients will be distributed across the centers, it’s challenging to accurately predict how many materials should be shipped to each center.

The simplest, most conservative approach might be to send 40 kits of T and 40 kits of R to both centers. However, this will lead to overstocking at all centers. The actual material consumption could end up being 200% of the theoretical amount, which would significantly increase costs and resource wastage — an unacceptable outcome.

To avoid overstocking and reduce unnecessary waste, you consider an alternative strategy: Ship 30 kits of T and 30 kits of R to each center. This ensures that materials are distributed more reasonably, and the consumption would increase to only 150% of the theoretical consumption (rather than 200%). While this approach is still more than the minimum needed, it offers a more balanced solution, covering potential variations in patient enrollment without excessive overstock.

In Real World

Instead of shipping all the materials at once, you consider a more adaptive shipping strategy. This allows you to adjust material shipments based on the actual enrollment status of each center over time, reducing the risk of either overstocking or running out of materials. Here’s how it could work:

Of course, you have to specify follow parameters:

1.3. Quick View of Simulation

This is where simulation becomes invaluable. By using simulation, you no longer need to rely on simple, deterministic calculations. The simulation accounts for the uncertainty in how patients will be distributed across the centers and how materials will be consumed. With this approach, you can identify the optimal supply strategy that balances the need to ensure adequate supply without excessive overstocking or stockouts. And you can make data-driven decisions that improve the accuracy and efficiency of your clinical trial logistics.

At this stage, we understand that diving into the details of how to carry out a simulation might seem overwhelming, so we will focus on presenting the key evaluation results directly:

Table 1. Various Supply Strategy

# Supply Strategy Coverage Theoretic
Consumption
Actual
Consumption
Inflation Ratio
1 Single Shipment of 40 Ts and 40 Rs 100% 40 Ts and 40 Rs 80 Ts and 80 Rs 200.0%
2 Single Shipment of 30 Ts and 30 Rs 99% 40 Ts and 40 Rs 60 Ts and 60 Rs 150.0%
3 Multiple Shipment with Initial 20 Ts and 20 Rs
Supply 5 Ts and 5 Rs if any stock is under 5
99% 40 Ts and 40 Rs 57 Ts and 57 Rs 142.5%
4 Multiple Shipment with Initial 10 Ts and 10 Rs
Supply 5 Ts and 5 Rs if any stock is under 5
98% 40 Ts and 40 Rs 56 Ts and 55 Rs 137.5%
5 Multiple Shipment with Initial 10 Ts and 10 Rs
Supply adaptively if any stock is under 5
96% 40 Ts and 40 Rs 50 Ts and 50 Rs 122.5%

The short answer is that Scenario #4 or Scenario #5 are the most recommended options, with actual material consumption predicted to be between 123% and 138% of the theoretical consumption. This range provides a more realistic estimate of the materials required, and is much more efficient than preparing 150% or even 200% of the materials, which would lead to overstocking and unnecessary costs.

In the following sections, MACROLIB will walk you through the underlying mechanisms of the Monte Carlo simulation used to model materials consumption. We’ll cover:

Finally, we will introduce the Warehouse: a collection of advanced examples that demonstrate real-world use cases and simulation outcomes. These examples will serve as a reference, helping you better understand how to apply the simulation in different trial contexts.

2. How to Simulate

Here’s a quick and easy version to help you explain the idea to your colleagues without getting bogged down in technical details:

By repeating these simulations many times (often thousands of iterations), instead of relying on a single, potentially inaccurate estimate, you get a range of possible outcomes, which helps you make more informed decisions — you’re not just guessing; evidence is based on a wide range of potential scenarios.

If you’re the type who likes to get into the technical details and really understand how it all works under the hood, don’t worry — we’ve got you covered. The following sections will break down the Monte Carlo simulation process in plain English, so even if you don’t have a background in statistics, you can still follow along and get a solid grasp of how the simulations work and how to interpret the results.

2.1. Objective Function

A robust material supply strategy should primarily address:

One side is ensuring that each center has enough stock available to meet the needs of patients when they visit to claim their study materials. This is essential to maintaining trial integrity, as failure to dispense materials according to the protocol can have serious consequences.

However, the other side is avoiding overstocking at centers. While ensuring that sufficient stock is available is crucial, overstocking can be equally problematic. Excessive stock levels at centers lead to wastage and inefficiency.

Additionally, depending on the context, other factors should be carefully eluvated:

In each case, optimality is about balancing the trade-offs between availability, cost, storage complexity, and product life cycle. Depending on the specific product and trial requirements, the optimal strategy may prioritize one or more of these factors.

2.2. Complex System

In the real world, clinical supply chains don’t operate in isolation. They are shaped by multiple dimensions that constantly interact with each other.

Figure 3. Complex System for Clinical Trial Material Supply

These dimensions include:

Once both the trial design and logistics are finalized, the supply strategy can be formulated to ensure the right amount of materials are available at the right time. we can apply different strategies to manage material distribution and resupply. For example, Table 1 (provided later in this section) illustrates various supply strategies for a multi-center trial (Ccenter=2).

Take Supply Strategy #4 as an exmple:

2.3. Monte Carlo Simulation

Now, we can perform the Monte Carlo procedure to evaluate the complex system

  1. Create a group of patients, allocate treatment arm according to the randomization plan, simulate the date of enrollment and subsequent date of dispensing;

    Figure 4. Monte Carlo Simulation Step A


  2. Create a group of centers, add the initial supply according to the supply strategy;

    Figure 5. Monte Carlo Simulation Step B


  3. Advance trial day by day, dispense the materials according to the schedule of visit;

    Figure 6. Monte Carlo Simulation Step C


  4. Check the stock after every material dispensing. If the stock under pre-specified threshold, re-supply is triggered. The materials will be restock after shipment period;


    Figure 7. Monte Carlo Simulation Step D


  5. Run trial till the end. Anytime any center fails to dispense materials, the simulation will be recorded as failure. Otherwise, the number of supply (initial supply and re-supply) will be collected;
  6. Repeat A to E certain times to stablize the simulation outcomes.

3. Parameters Specification

Figure 8 presents the input panel for Simulator.

Figure 8. Input Panel

3.1. Trial Design

The trial protocol provides crucial information that forms the foundation for your simulation. From the protocol, the following key parameters are extracted:

Table 2. Example of Treatment Label and Allocation Ratio

Trial Protocol Input Panel
Treatment Arm Allocation Ratio Treatment Label Allocation Ratio
Example 1: Placebo Controlled
Test 2 T 2
Placebo 1 P 1
Example 2: Dose Ranging
Placebo 1 P 1
Low Dose 1 L 1
Mid Dose 1 M 1
High Dose 1 H 1

3.2. Logistic

Logistical factors, although rarely presented directly from the trial protocol, have a significant impact on the outcomes of the simulation. These factors play a crucial role in determining how materials are handled and distributed throughout the trial.

By taking into account these logistical components, MACROLIB ensures that the simulation reflects more realistic, real-world scenarios. This allows for a more accurate estimation of material requirements and helps in the planning of resources and timelines for trial execution.

3.3. Supply Strategy

The Supply Strategy refers to the procedures used to manage the flow of materials throughout the clinical trial. It ensures that the right quantity of materials is available at the right time and place, optimizing resource usage and reducing the risk of shortages or overstocking. This strategy is broken down into three main components: Initial Supply, Trigger for Re-supply, and Re-Supply.

3.3.1. Initial Supply

The Initial Supply refers to the amount of material that needs to be available at the start of the clinical trial to ensure that patient enrollment and treatment begin smoothly.

3.3.2. Trigger for Re-supply

The Trigger for Re-supply defines the point at which additional materials need to be shipped to the clinical trial sites. When the stock at a clinical site reaches a pre-defined minimum level, a shipment is triggered to restock the site. Shipments can take time, ensuring that materials are sent ahead of time before the stock runs low.

3.3.3. Re-Supply

Re-Supply refers to the process of restocking materials at clinical trial sites during the conduct, ensuring continuous availability of the required items. There are two major modalities:

3.4. Number of Simulation

To ensure the reliability and stability of the simulation outcomes, MACROLIB recommends conducting at least 100 iterations for each simulation. This helps stabilize the results and reduces the potential variability caused by random fluctuations in the data. While 100 iterations is the minimum recommended for general accuracy, the more iterations you run, the higher the reliability of the outcomes.

However, due to current resource limitations, MACROLIB only provides the option for a simulation of 10 iterations by default. This limited number is suitable for basic exploratory analysis but may not provide the full level of accuracy required for more complex simulations.

For users needing more intensive simulations or higher iteration counts, we encourage you to contact the Help Desk. Our team can assist in providing a customized solution that fits your specific simulation needs and resource requirements.

4. Intepretation

The simulation provides valuable insights to help you assess and refine your material supply strategy. Figure 9 presents the output panel for Simulator.

Figure 8. Output Panel

Let’s take a closer look at the two main pieces of information the simulation provides:

5. Others

Warehouse for Advance Examples Warehouse for Advance Examples

物料消耗模拟器用户指南

English Version User Manual for Materials Consumption Simulator
物料消耗模拟器 物料消耗模拟器

1. 为什么模拟

1.1. 基础场景C0

想象一下,你是一名项目经理(PM),负责监督一项单中心随机对照试验(RCT)。

Figure 1. Base Scenario C0

试验方案规定,符合纳入和排除标准的40名患者将被随机分为两个治疗组:T组和R组,分配比例为1:1。每位患者将收到两套研究物料,一套在第1天,一套是在第14天。

研究物料的理论消耗量相对容易计算:

由于这是一项单中心试验,作为项目经理,确保将正确数量的物料运送到现场相对简单。在这种情况下,您可以证明至少应向中心运送40套T和40套R,以满足预期的消耗。但是,为了考虑潜在的不可预见的情况,您决定添加一个小缓冲区。根据您的经验和历史数据,由于以下各种因素,您预计重新分配的可能性为5%:

为了降低物料料用完的风险,您决定为每个组额外运送原始所需数量的5%。这导致T组有42套,R组有42套。

C0是一个清楚的例子,说明在具有简单物流和可预测需求的试验中,手动方法就足够了,使得基本物料供应计划不需要模拟。

1.2. 升级方案Ccenter=2

你面临着提前时间表的巨大压力。为了加速患者的招募,您决定将单中心随机对照试验扩展到多中心随机对照试验。现在,您需要管理两个中心。关键问题变成了:

让我们分解一下你可能面临的问题和挑战:

中心随机化和患者入组分布

在中心随机化的框架下,患者被随机分配到T组或R组。由于所有中心的患者总数固定为40人,这两个中心有41种可能的入组结果——从0到40名患者在中心1入组,其余患者分配到中心2。每种结果都会导致两个中心每组的患者组合不同。

物料要求的不确定性

鉴于患者在各个中心的分布存在不确定性,准确预测每个中心应该运送多少物料是一项挑战。

最简单、最保守的方法可能是向两个中心发送40套T和40套R。然而,这会导致中心的库存过剩。总物料消耗量最终可能达到理论量的200%,这将大大增加成本和资源浪费,这是一个不可接受的结果。

为了避免库存过剩并减少不必要的浪费,您可以考虑另一种策略:向每个中心运送30套T和30套R。这确保了物料的分配更加合理,消耗量将增加到理论消耗量的150%(而不是200%)。虽然这种方法仍然超过了所需的最低限度,但它提供了一种更平衡的解决方案,在不过度积压的情况下覆盖了患者登记的潜在变化。

在真实世界

您可以考虑采用更具适应性的运输策略,而不是一次性运输所有物料。这允许您根据每个中心随时间推移的实际注册状态调整物料发货,从而降低物料积压或用完的风险。以下是它的工作原理:

当然,你需要定义以下参数:

1.3. 模拟

这就是模拟变得无价的地方。通过使用模拟,您不再需要依赖简单的确定性计算。该模拟可以解释患者将如何在各个中心分布以及材料将如何消耗的不确定性。通过这种方法,您可以确定最佳的供应策略,以平衡确保充足供应的需求,同时避免过度积压或缺货。您可以做出数据驱动的决策,以提高临床试验物流的准确性和效率。

在这个阶段,我们了解到,深入了解如何进行模拟的细节可能会让人感到不知所措,因此我们将专注于直接呈现关键的评估结果:

Table 1. 多种供应策略

# 供应策略 成功率 理论消耗量 实际消耗量 膨胀率
1 单次转运40套T和40套R 100% 40套T和40套R 80套T和80套R 200.0%
2 单次转运30套T和30套R 99% 40套T和40套R 60套T和60套R 150.0%
3 多次转运,首次20套T和20套R
当任意库存低于5时补充5套T和5套R
99% 40套T和40套R 57套T和57套R 142.5%
4 多次转运,首次10套T和10套R
当任意库存低于5时补充5套T和5套R
98% 40套T和40套R 55套T和55套R 137.5%
5 多次转运,首次20套T和20套R
当任意库存低于5时按需补充
96% 40套T和40套R 50套T和50套R 122.5%

简短的回答是,方案4或方案5是最推荐的选择,实际物料消耗量预计在理论消耗量的123%至138%之间。这个范围提供了对所需物料的更现实的估计,并且比准备150%甚至200%的物料更有效,这会导致库存过剩和不必要的成本。

在以下部分中,MACROLIB将引导您了解用于模拟材料消耗的蒙特卡洛模拟的基本机制。我们将介绍:

最后,我们将介绍仓库:一组真实场景和模拟结果的示例。这些示例将作为参考,帮助您更好地理解如何在不同的试验环境中应用模拟。

2. 如何模拟

这里有一个快速简单的版本,可以帮助你向同事解释这个想法,而不会陷入技术细节:

通过多次重复这些模拟(通常是数千次迭代),而不是依赖于单一的、可能不准确的估计,你会得到一系列可能的结果,这有助于你做出更明智的决定——你不仅仅是猜测;证据基于广泛的潜在情景。

如果你是那种喜欢深入了解技术细节并真正了解其工作原理的人,别担心——我们已经为你做好了准备。以下部分将用简单的英语分解蒙特卡洛模拟过程,因此即使你没有统计学背景,你仍然可以跟随并牢牢掌握模拟的工作原理以及如何解释结果。

2.1. 目标函数

稳健的物料供应策略应主要解决以下问题:

一方面是确保每个中心都有足够的库存,以满足患者在领取研究材料时的需求。这对于保持试验的完整性至关重要,因为不按照方案分配材料可能会产生严重后果。

然而,另一方正在避免中心库存过剩。虽然确保有足够的库存是至关重要的,但库存过剩同样可能造成问题。中心库存水平过高会导致浪费和效率低下。

此外,根据具体情况,应仔细排除其他因素:

在每种情况下,优化都是关于平衡可用性、成本、存储复杂性和产品生命周期之间的权衡。根据具体的产品和试验要求,最佳策略可能会优先考虑这些因素中的一个或多个。

2.2. 复杂系统

在现实世界中,临床供应链并不是孤立运作的。它们是由不断相互作用的多个维度形成的。

Figure 3. Complex System for Clinical Trial Material Supply

这些维度包括:

一旦试验设计和物流都完成,就可以制定供应策略,以确保在正确的时间提供适量的物料。我们可以应用不同的策略来管理材料分配和补给。例如,表1(本节稍后提供)说明了多中心试验的各种供应策略(Ccenter=2

以供应策略#4为例:

2.3. 蒙特卡洛模拟

现在,我们可以执行蒙特卡洛程序来评估复杂系统:

  1. 创建一组患者,根据随机化计划分配治疗组,模拟入组日期和随后的配药日期;

    Figure 4. 蒙特卡罗模拟步骤A


  2. 创建一组中心,根据供应策略添加初始供应;

    Figure 5. 蒙特卡罗模拟步骤B


  3. 一天一天推进试验,根据参观时间表发放材料;

    Figure 6. 蒙特卡罗模拟步骤C


  4. 每次分发物料后检查库存。如果库存低于预先指定的阈值,则触发重新供应。物料将在转运期后被补充;


    Figure 7. 蒙特卡罗模拟步骤D


  5. 试运行到最后。任何中心未能分配物料时,这一次模拟都将被记录为失败。否则,将记录实际供应数量(初始供应和重新供应);
  6. 重复A到E的一定次数,稳定模拟结果。

3. 参数规格

Figure 8 显示了模拟器的输入面板。

Figure 8. 输入面板

3.1. 试验设计

试验方案提供了构成模拟基础的关键信息。从方案中提取以下关键参数:

Table 2. 治疗标签和分配比例示例

试验方案 输入版面
治疗组 分配比例 治疗组 分配比例
Example 1: 安慰剂对照
试验组 2 T 2
安慰剂组 1 P 1
Example 2: 剂量探索
安慰剂组 1 P 1
低剂量组 1 L 1
中剂量组 1 M 1
高剂量组 1 H 1

3.2. 后勤因素

后勤因素虽然很少直接出现在试验方案中,但对模拟结果有重大影响。这些因素在决定如何在整个试验过程中处理和分配物料方面起着至关重要的作用。

通过考虑这些后勤要素,MACROLIB确保模拟反映了更真实的现实世界场景。这可以更准确地估计物料需求,并有助于规划审判执行的资源和时间表。

3.3. 供应策略

供应策略是指在整个临床试验过程中用于管理物料流动的程序。它确保在正确的时间和地点提供正确数量的物料,优化资源使用,降低短缺或积压的风险。该策略分为三个主要部分:初始供应、再供应触发和再供应。

3.3.1. 初始供应

初始供应是指在临床试验开始时需要提供的物料量,以确保患者入组和治疗顺利开始。

3.3.2. 再供应触发

再供应触发器定义了需要将额外物料运送到临床试验地点的时间点。当临床站点的库存达到预定义的最低水平时,会触发装运以补充站点的库存。发货可能需要时间,以确保在库存不足之前提前发送材料。

3.3.3. 再供应

再供应是指在临床试验过程中在临床试验现场重新进货的过程,以确保所需物品的持续可用性。主要有两种模式:

3.4. 模拟次数

为确保模拟结果的可靠性和稳定性,MACROLIB建议每次模拟至少进行100次迭代。这有助于稳定结果,并减少数据随机波动引起的潜在可变性。虽然100次迭代是一般精度的最低建议,但你运行的迭代次数越多,结果的可靠性就越高。

然而,由于当前的资源限制,默认情况下,MACROLIB仅提供10次迭代的模拟选项。这个有限的数量适用于基本的探索性分析,但可能无法提供更复杂的模拟所需的全部精度。

对于需要更密集模拟或更高迭代次数的用户,我们建议您联系帮助台。我们的团队可以协助提供符合您特定模拟需求和资源要求的定制解决方案。

4. 推断

该模拟提供了宝贵的见解,帮助您评估和完善您的物料供应策略。图9显示了模拟器的输出面板。

Figure 8. 输出面板

让我们仔细看看模拟提供的两条主要信息:

5. 其他

高级示例仓库 高级示例仓库