Performing meta-analysis with incomplete statistical information in clinical trials

1471-2288-8-56 1471-2288 Research article Performing meta-analysis with incomplete statistical information in clinical trials Ma Jianbing jma03@qub.ac.uk Liu Weiru w.liu@qub.ac.uk Hunter Anthony a.hunter@cs.ucl.ac.uk Zhang Weiya weiya.zhang@nottingham.ac.uk

School of Electronics, Electrical Engineering and Computer Science, Queen's University Belfast, Belfast, BT7 1NN, UK

Department of Computer Science, University College London, Gower Street, London, WC1E 6BT, UK

Academic Rheumatology, Medical & Surgical Sciences, City Hospital, Nottingham, NG5 1PB, UK

BMC Medical Research Methodology 1471-2288 2008 8 1 56 http://www.biomedcentral.com/1471-2288/8/56 18706124 10.1186/1471-2288-8-56 12 5 2008 18 8 2008 18 8 2008 2008 Ma et al; licensee BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Background

Results from clinical trials are usually summarized in the form of sampling distributions. When full information (mean, SEM) about these distributions is given, performing meta-analysis is straightforward. However, when some of the sampling distributions only have mean values, a challenging issue is to decide how to use such distributions in meta-analysis. Currently, the most common approaches are either ignoring such trials or for each trial with a missing SEM, finding a similar trial and taking its SEM value as the missing SEM. Both approaches have drawbacks. As an alternative, this paper develops and tests two new methods, the first being the prognostic method and the second being the interval method, to estimate any missing SEMs from a set of sampling distributions with full information. A merging method is also proposed to handle clinical trials with partial information to simulate meta-analysis.

Methods

Both of our methods use the assumption that the samples for which the sampling distributions will be merged are randomly selected from the same population. In the prognostic method, we predict the missing SEMs from the given SEMs. In the interval method, we define intervals that we believe will contain the missing SEMs and then we use these intervals in the merging process.

Results

Two sets of clinical trials are used to verify our methods. One family of trials is on comparing different drugs for reduction of low density lipprotein cholesterol (LDL) for Type-2 diabetes, and the other is about the effectiveness of drugs for lowering intraocular pressure (IOP). Both methods are shown to be useful for approximating the conventional meta-analysis including trials with incomplete information. For example, the meta-analysis result of Latanoprost versus Timolol on IOP reduction for six months provided in 1 was 5.05 ± 1.15 (Mean ± SEM) with full information. If the last trial in this study is assumed to be with partial information, the traditional analysis method for dealing with incomplete information that ignores this trial would give 6.49 ± 1.36 while our prognostic method gives 5.02 ± 1.15, and our interval method provides two intervals as Mean ∈ [4.25, 5.63] and SEM ∈ [1.01, 1.24].

Conclusion

Both the prognostic and the interval methods are useful alternatives for dealing with missing data in meta-analysis. We recommend clinicians to use the prognostic method to predict the missing SEMs in order to perform meta-analysis and the interval method for obtaining a more cautious result.

Background

Clinical trials are widely used to test new drugs or to compare the effect of different drugs 2. For example, many clinical trials have been carried out to investigate the efficacy of drugs for lowering intraocular pressure, such as travoprost, bimatoprost, timolol, and latanoprost, 34567891011, and many to investigate the oral diabetes medication for adults with Type-2 diabetes 121314151617. Given that there is a huge number of trials available and reports on trials are very time consuming to read and understand, a systematic review of related trials is useful for medical practioners or other health care professionals to obtain an overall estimation about drugs/therapies of interest. Meta-analysis is the technique commonly used to summarize related trials results. Statistically, meta-analysis is in effect a process for merging sampling distributions (see its explanation in Preliminaries) into a single distribution.

When the full information of sampling distributions used in the trials is available, merging the results from these trials is usually a matter of systematic use of established techniques from statistics. However, in reality, some trial results reported in the literature are statistically incomplete. For instance, the standard error of mean (SEM) may be missing from a sampling distribution. A clinical trial with incomplete information is often abandoned, or, an SEM from a similar trial is used to substitute the missing data. Obviously, abandoning trials will decrease the power of a meta-analysis since trials that are eligible for analysis cannot be taken into account. On the other hand, if these trials are considered and a missing SEM is replaced by a substitute SEM, two major difficulties of this approach are inevitable. First finding a similar trial can be very difficult. Second there is no guarantee that there exists a similar trial with full information. Furthermore, measuring the similarity between trials is another issue that must be addressed. Therefore, an appropriate method is urgently needed to deal with sampling distributions with missing information when considering meta-analysis.

In this paper, we propose a prognostic method where missing SEMs are predicted from known information (SEMs) and an interval method where an interval is calculated in which the missing SEMs are assumed to be. These two methods are based on the assumption that the sampling distributions to be analyzed and merged are from the same population by random selection. In a sense, the two methods can be viewed as extremes. The prognostic method uses an estimate of the missing SEM, while the interval method aims at considering the best and worse cases. Of course, there are other reasonable intermediate procedures, for example, a Bayesian predictive approach is a very natural tool for dealing with missing information.

Significantly, our methods can also be used in the process of merging between group differences (almost all meta-analysis performs merging of between group differences). In fact, our methods can be applied to any results obtained from clinical trials, as long as these results (regarded as random variables) theoretically follow a sampling distribution.

Methods

Study examples

The study examples were drawn from two systematic reviews 117. 17 reported a meta-analysis on drugs for patients with Type-2 diabetes and 1 reported a meta-analysis on lowering intraocular pressure for patients with open angle glaucoma or ocular hypertension.

In order to compare the results obtained from our methods with that from 17, we first attempted to collect all the original information on sampling distributions from each of the clinical trials papers used in 17. After going through these papers, we found that we could not get the sampling distributions with full information from every single paper, as some of these papers did not provide the SEM values. We then applied our two methods to merge these (including partial) distributions and compared the merged result with that obtained in 17. In contrast to 17, in 1 every sampling distribution used has full statistical information. To test the adequacy of our methods for dealing with missing information, we randomly selected a trial from 1 and deleted its SEM value. We then applied our two methods to recover this missing SEM value before merging this trial with the rest. Finally, we compared our results with that from 1.

Preliminaries

In statistics, a normal distribution associated with a random variable is denoted as X ~ N (μ, σ²). For the convenience of further calculations in the rest of the paper, we use notation X ~ N (μ, σ) instead of X ~ N (μ, σ²) for a normal distribution of variable X.

In statistics, random samples of individuals are often used as the representatives of the entire group of individuals (often denoted as a population) to estimate the values of some parameters of the population. The mean of variable X of the samples, when the sample size is reasonably large, follows a normal distribution. This distribution is typically referred to as a sampling distribution.

We use X ~ N (μ, SEM) to denote a sampling distribution with mean value μ and standard error of mean SEM.

The basic merging rule for sampling distributions is as follows.

Let X₁~ N (μ₁, SEM₁) and X₂~ N (μ₁, SEM₂) be two sampling distributions, then the merged sampling distribution X ~ N (μ, SEM) is given by

μ = μ 1 S E M 2 2 + μ 2 S E M 1 2 S E M 1 2 + S E M 2 2 , S E M = S E M 1 2 S E M 2 2 S E M 1 2 + S E M 2 2 . MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xI8qiVKYPFjYdHaVhbbf9v8qqaqFr0xc9vqFj0dXdbba91qpepeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGaciGaaiaabeqaaeqabiWaaaGcbaqbaeqabeGaaaqaaiabeY7aTjabg2da9KqbaoaalaaabaGaeqiVd02aaSbaaeaacqaIXaqmaeqaaiabdofatjabdweafjabd2eannaaDaaabaGaeGOmaidabaGaeGOmaidaaiabgUcaRiabeY7aTnaaBaaabaGaeGOmaidabeaacqWGtbWucqWGfbqrcqWGnbqtdaqhaaqaaiabigdaXaqaaiabikdaYaaaaeaacqWGtbWucqWGfbqrcqWGnbqtdaqhaaqaaiabigdaXaqaaiabikdaYaaacqGHRaWkcqWGtbWucqWGfbqrcqWGnbqtdaqhaaqaaiabikdaYaqaaiabikdaYaaaaaGccqGGSaalaeaacqWGtbWucqWGfbqrcqWGnbqtcqGH9aqpdaGcaaqcfayaamaalaaabaGaem4uamLaemyrauKaemyta00aa0baaeaacqaIXaqmaeaacqaIYaGmaaGaem4uamLaemyrauKaemyta00aa0baaeaacqaIYaGmaeaacqaIYaGmaaaabaGaem4uamLaemyrauKaemyta00aa0baaeaacqaIXaqmaeaacqaIYaGmaaGaey4kaSIaem4uamLaemyrauKaemyta00aa0baaeaacqaIYaGmaeaacqaIYaGmaaaaaaWcbeaakiabc6caUaaaaaa@6A0C@

Equation 1 can be easily induced from σ₁= σ₂where σ_i= SEM_ini MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGaciGaaiaabeqaaeqabiWaaaGcbaWaaOaaaeaacqWGUbGBdaWgaaWcbaGaemyAaKgabeaaaeqaaaaa@2ED1@ and n_iis the number of samples of the ith trial (for i = 1, 2).

Conventionally, clinicians usually use notation ωi=1SEMi2 MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGaciGaaiaabeqaaeqabiWaaaGcbaGaeqyYdC3aaSbaaSqaaiabdMgaPbqabaGccqGH9aqpjuaGdaWcaaqaaiabigdaXaqaaiabdofatjabdweafjabd2eannaaDaaabaGaemyAaKgabaGaeGOmaidaaaaaaaa@379B@, thus Equation 1 can be rewritten as:

μ = μ 1 ω 1 + μ 2 ω 2 ω 1 + ω 2 , ω = ω 1 + ω 2 . MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xI8qiVKYPFjYdHaVhbbf9v8qqaqFr0xc9vqFj0dXdbba91qpepeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGaciGaaiaabeqaaeqabiWaaaGcbaGaeqiVd0Maeyypa0tcfa4aaSaaaeaacqaH8oqBdaWgaaqaaiabigdaXaqabaGaeqyYdC3aaSbaaeaacqaIXaqmaeqaaiabgUcaRiabeY7aTnaaBaaabaGaeGOmaidabeaacqaHjpWDdaWgaaqaaiabikdaYaqabaaabaGaeqyYdC3aaSbaaeaacqaIXaqmaeqaaiabgUcaRiabeM8a3naaBaaabaGaeGOmaidabeaaaaGccqGGSaalcqaHjpWDcqGH9aqpcqaHjpWDdaWgaaWcbaGaeGymaedabeaakiabgUcaRiabeM8a3naaBaaaleaacqaIYaGmaeqaaOGaeiOla4caaa@4DB8@

It is easy to see that the merging rule is associative, thus this rule can be straightforwardly used to merge multiple sampling distributions. Let X_i~ N (μ_i, SEM_i), 1 ≤ i ≤ k, then for the merged sampling distribution X ~ N (μ, SEM), we have

μ = ∑ i = 1 k μ i ω i ∑ i = 1 k ω i , ω = ∑ i = 1 k ω i . MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xI8qiVKYPFjYdHaVhbbf9v8qqaqFr0xc9vqFj0dXdbba91qpepeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGaciGaaiaabeqaaeqabiWaaaGcbaqbaeqabeGaaaqaaiabeY7aTjabg2da9KqbaoaalaaabaWaaabmaeaacqaH8oqBdaWgaaqaaiabdMgaPbqabaGaeqyYdC3aaSbaaeaacqWGPbqAaeqaaaqaaiabdMgaPjabg2da9iabigdaXaqaaiabdUgaRbGaeyyeIuoaaeaadaaeWaqaaiabeM8a3naaBaaabaGaemyAaKgabeaaaeaacqWGPbqAcqGH9aqpcqaIXaqmaeaacqWGRbWAaiabggHiLdaaaOGaeiilaWcabaGaeqyYdCNaeyypa0ZaaabCaeaacqaHjpWDdaWgaaWcbaGaemyAaKgabeaaaeaacqWGPbqAcqGH9aqpcqaIXaqmaeaacqWGRbWAa0GaeyyeIuoakiabc6caUaaaaaa@5568@

This is the classical merging method (i.e., meta-analysis) used by clinicians.

The Prognostic Method

We propose a method to predict missing SEMs for sampling distributions from other distributions that have SEM values. Hereafter, we assume that there are k + l trials altogether where k trials are with full information, i.e.,

(μ₁, SEM₁, n₁),..., (μ_k, SEM_k, n_k)

and l trials with partial information, i.e.,

(μ_k+1, n_k+1),..., (μ_k+l, n_k+l).

We want to get the merging result of those k + l trials.

If we have both the SEM value and the sample size n from a trial, then we can obtain σ by equation SEM = σn MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGaciGaaiaabeqaaeqabiWaaaGcbaqcfa4aaSaaaeaacqaHdpWCaeaadaGcaaqaaiabd6gaUbqabaaaaaaa@2FAB@. Thus for k trials with

(μ₁, SEM₁, n₁),..., (μ_k, SEM_k, n_k)

we get σ_i= SEM_ini MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGaciGaaiaabeqaaeqabiWaaaGcbaWaaOaaaeaacqWGUbGBdaWgaaWcbaGaemyAaKgabeaaaeqaaaaa@2ED1@, 1 ≤ i ≤ k. Because it is assumed that these trials randomly select samples from the same population, these σ_is suggest what the real value σ could be. In fact, from the well-known Error Theory, we can use

σ ∗ = ∑ i = 1 k σ i k MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xI8qiVKYPFjYdHaVhbbf9v8qqaqFr0xc9vqFj0dXdbba91qpepeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGaciGaaiaabeqaaeqabiWaaaGcbaGaeq4Wdm3aaWbaaSqabeaacqGHxiIkaaGccqGH9aqpjuaGdaWcaaqaamaaqadabaGaeq4Wdm3aaSbaaeaacqWGPbqAaeqaaaqaaiabdMgaPjabg2da9iabigdaXaqaaiabdUgaRbGaeyyeIuoaaeaacqWGRbWAaaaaaa@3BE8@

to replace the real σ. When k gets larger, σ* gets closer to the real σ. Therefore, for a sampling distribution without a standard error, we can use SEMj∗=σ∗nj∗ MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGaciGaaiaabeqaaeqabiWaaaGcbaGaem4uamLaemyrauKaemyta00aa0baaSqaaiabdQgaQbqaaiabgEHiQaaakiabg2da9KqbaoaalaaabaGaeq4Wdm3aaWbaaeqabaGaey4fIOcaaaqaamaakaaabaGaemOBa42aa0baaeaacqWGQbGAaeaacqGHxiIkaaaabeaaaaaaaa@3A18@ as its standard error where nj∗ MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGaciGaaiaabeqaaeqabiWaaaGcbaGaemOBa42aa0baaSqaaiabdQgaQbqaaiabgEHiQaaaaaa@2FB3@ is the sample size of this sampling distribution.

To summarize, the prognostic method uses the following equation to predict the missing SEMj∗ MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGaciGaaiaabeqaaeqabiWaaaGcbaGaem4uamLaemyrauKaemyta00aa0baaSqaaiabdQgaQbqaaiabgEHiQaaaaaa@31B3@ value for trial j with sample size nj∗ MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGaciGaaiaabeqaaeqabiWaaaGcbaGaemOBa42aa0baaSqaaiabdQgaQbqaaiabgEHiQaaaaaa@2FB3@, given that for k trials, each of which has the SEM_ivalue and the sample size n_i.

S E M j ∗ = ∑ i = 1 k S E M i n i k n j ∗ . MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xI8qiVKYPFjYdHaVhbbf9v8qqaqFr0xc9vqFj0dXdbba91qpepeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGaciGaaiaabeqaaeqabiWaaaGcbaGaem4uamLaemyrauKaemyta00aa0baaSqaaiabdQgaQbqaaiabgEHiQaaakiabg2da9KqbaoaalaaabaWaaabmaeaacqWGtbWucqWGfbqrcqWGnbqtdaWgaaqaaiabdMgaPbqabaWaaOaaaeaacqWGUbGBdaWgaaqaaiabdMgaPbqabaaabeaaaeaacqWGPbqAcqGH9aqpcqaIXaqmaeaacqWGRbWAaiabggHiLdaabaGaem4AaS2aaOaaaeaacqWGUbGBdaqhaaqaaiabdQgaQbqaaiabgEHiQaaaaeqaaaaacqGGUaGlaaa@4841@

Then we are able to use the standard meta-analysis method to merge trials with predicted SEM values and trials with full information.

The Interval Method

In contrast to estimating a single value for a missing SEM as discussed above, in this section, we establish a method to estimate a reliable interval for a missing SEM. Then we propose the corresponding merging rule for this case.

For the k trials with

(μ₁, SEM₁, n₁),..., (μ_k, SEM_k, n_k),

we have σ_i= SEM_ini MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGaciGaaiaabeqaaeqabiWaaaGcbaWaaOaaaeaacqWGUbGBdaWgaaWcbaGaemyAaKgabeaaaeqaaaaa@2ED1@, 1 ≤ i ≤ k. Let

σ m i n = m i n i = 1 k σ i σ m a x = m a x i = 1 k σ i MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xI8qiVKYPFjYdHaVhbbf9v8qqaqFr0xc9vqFj0dXdbba91qpepeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGaciGaaiaabeqaaeqabiWaaaGcbaqbaeqabeGaaaqaaiabeo8aZnaaBaaaleaacqWGTbqBcqWGPbqAcqWGUbGBaeqaaOGaeyypa0JaemyBa0MaemyAaKMaemOBa42aa0baaSqaaiabdMgaPjabg2da9iabigdaXaqaaiabdUgaRbaakiabeo8aZnaaBaaaleaacqWGPbqAaeqaaaGcbaGaeq4Wdm3aaSbaaSqaaiabd2gaTjabdggaHjabdIha4bqabaGccqGH9aqpcqWGTbqBcqWGHbqycqWG4baEdaqhaaWcbaGaemyAaKMaeyypa0JaeGymaedabaGaem4AaSgaaOGaeq4Wdm3aaSbaaSqaaiabdMgaPbqabaaaaaaa@532E@

It is intuitive to consider that the real σ value is in between σ_minand σ_max. Therefore for a sampling distribution without the standard error SEM*, we have SEM∗∈[σminn∗,σmaxn∗] MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGaciGaaiaabeqaaeqabiWaaaGcbaGaem4uamLaemyrauKaemyta00aaWbaaSqabeaacqGHxiIkaaGccqGHiiIZdaWadaqcfayaamaalaaabaGaeq4Wdm3aaSbaaeaacqWGTbqBcqWGPbqAcqWGUbGBaeqaaaqaamaakaaabaGaemOBa42aaWbaaeqabaGaey4fIOcaaaqabaaaaiabcYcaSmaalaaabaGaeq4Wdm3aaSbaaeaacqWGTbqBcqWGHbqycqWG4baEaeqaaaqaamaakaaabaGaemOBa42aaWbaaeqabaGaey4fIOcaaaqabaaaaaGccaGLBbGaayzxaaaaaa@468C@ where n* is the sample size of this trial.

It remains for us to investigate how to use this interval value for merging. For simplicity and illustration, first let us consider the case where there is only one trial with a missing SEM. Let μ^kdenote the weighted average of μ₁to μ_k(the k trials with known SEMs), i.e.,

μ k = ∑ i = 1 k μ i ω i ∑ i = 1 k ω i . MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xI8qiVKYPFjYdHaVhbbf9v8qqaqFr0xc9vqFj0dXdbba91qpepeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGaciGaaiaabeqaaeqabiWaaaGcbaGaeqiVd02aaWbaaSqabeaacqWGRbWAaaGccqGH9aqpjuaGdaWcaaqaamaaqadabaGaeqiVd02aaSbaaeaacqWGPbqAaeqaaiabeM8a3naaBaaabaGaemyAaKgabeaaaeaacqWGPbqAcqGH9aqpcqaIXaqmaeaacqWGRbWAaiabggHiLdaabaWaaabmaeaacqaHjpWDdaWgaaqaaiabdMgaPbqabaaabaGaemyAaKMaeyypa0JaeGymaedabaGaem4AaSgacqGHris5aaaakiabc6caUaaa@48F9@

μ^kis equivalent to the merged mean value for the k trials in meta-analysis. Let

μ k + 1 1 = ∑ i = 1 k μ i ω i + n k + 1 μ k + 1 / σ m i n 2 ∑ i = 1 k ω i + n k + 1 / σ m i n 2 MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xI8qiVKYPFjYdHaVhbbf9v8qqaqFr0xc9vqFj0dXdbba91qpepeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGaciGaaiaabeqaaeqabiWaaaGcbaGaeqiVd02aa0baaSqaaiabdUgaRjabgUcaRiabigdaXaqaaiabigdaXaaakiabg2da9KqbaoaalaaabaWaaabmaeaacqaH8oqBdaWgaaqaaiabdMgaPbqabaGaeqyYdC3aaSbaaeaacqWGPbqAaeqaaaqaaiabdMgaPjabg2da9iabigdaXaqaaiabdUgaRbGaeyyeIuoacqGHRaWkcqWGUbGBdaWgaaqaaiabdUgaRjabgUcaRiabigdaXaqabaGaeqiVd02aaSbaaeaacqWGRbWAcqGHRaWkcqaIXaqmaeqaaiabc+caViabeo8aZnaaDaaabaGaemyBa0MaemyAaKMaemOBa4gabaGaeGOmaidaaaqaamaaqadabaGaeqyYdC3aaSbaaeaacqWGPbqAaeqaaaqaaiabdMgaPjabg2da9iabigdaXaqaaiabdUgaRbGaeyyeIuoacqGHRaWkcqWGUbGBdaWgaaqaaiabdUgaRjabgUcaRiabigdaXaqabaGaei4la8Iaeq4Wdm3aa0baaeaacqWGTbqBcqWGPbqAcqWGUbGBaeaacqaIYaGmaaaaaaaa@6AC7@

and

μ k + 1 2 = ∑ i = 1 k μ i ω i + n k + 1 μ k + 1 / σ m a x 2 ∑ i = 1 k ω i + n k + 1 / σ m a x 2 , MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xI8qiVKYPFjYdHaVhbbf9v8qqaqFr0xc9vqFj0dXdbba91qpepeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGaciGaaiaabeqaaeqabiWaaaGcbaGaeqiVd02aa0baaSqaaiabdUgaRjabgUcaRiabigdaXaqaaiabikdaYaaakiabg2da9KqbaoaalaaabaWaaabmaeaacqaH8oqBdaWgaaqaaiabdMgaPbqabaGaeqyYdC3aaSbaaeaacqWGPbqAaeqaaaqaaiabdMgaPjabg2da9iabigdaXaqaaiabdUgaRbGaeyyeIuoacqGHRaWkcqWGUbGBdaWgaaqaaiabdUgaRjabgUcaRiabigdaXaqabaGaeqiVd02aaSbaaeaacqWGRbWAcqGHRaWkcqaIXaqmaeqaaiabc+caViabeo8aZnaaDaaabaGaemyBa0MaemyyaeMaemiEaGhabaGaeGOmaidaaaqaamaaqadabaGaeqyYdC3aaSbaaeaacqWGPbqAaeqaaaqaaiabdMgaPjabg2da9iabigdaXaqaaiabdUgaRbGaeyyeIuoacqGHRaWkcqWGUbGBdaWgaaqaaiabdUgaRjabgUcaRiabigdaXaqabaGaei4la8Iaeq4Wdm3aa0baaeaacqWGTbqBcqWGHbqycqWG4baEaeaacqaIYaGmaaaaaiabcYcaSaaa@6BB1@

then we have the following result.

Let X_i~ N (μ_i, SEM_i), 1 ≤ i ≤ k, denote the ith sampling distribution with sample size n_iand X_i+1~ N (μ_i+1, SEM_i+1) denote the (k + 1)th sampling distribution with sample size n_i+1where value SEM_i+1is unknown. Then the merged result N (μ, SEM) of the interval method is:

1. If μ_k+1≤ μ^k, then μ ∈ [μk+11 MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGaciGaaiaabeqaaeqabiWaaaGcbaGaeqiVd02aa0baaSqaaiabdUgaRjabgUcaRiabigdaXaqaaiabigdaXaaaaaa@31D9@, μk+12 MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGaciGaaiaabeqaaeqabiWaaaGcbaGaeqiVd02aa0baaSqaaiabdUgaRjabgUcaRiabigdaXaqaaiabikdaYaaaaaa@31DB@]

2. If μ_k+1> μ^k, then μ ∈ [μk+12 MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGaciGaaiaabeqaaeqabiWaaaGcbaGaeqiVd02aa0baaSqaaiabdUgaRjabgUcaRiabigdaXaqaaiabikdaYaaaaaa@31DB@, μk+11 MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGaciGaaiaabeqaaeqabiWaaaGcbaGaeqiVd02aa0baaSqaaiabdUgaRjabgUcaRiabigdaXaqaaiabigdaXaaaaaa@31D9@]

and

S E M 2 ∈ [ 1 ∑ i = 1 k ω i + n k + 1 / σ m i n 2 , 1 ∑ i = 1 k ω i + n k + 1 / σ m a x 2 ] MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGaciGaaiaabeqaaeqabiWaaaGcbaGaem4uamLaemyrauKaemyta00aaWbaaSqabeaacqaIYaGmaaGccqGHiiIZcqGGBbWwjuaGdaWcaaqaaiabigdaXaqaamaaqadabaGaeqyYdC3aaSbaaeaacqWGPbqAaeqaaiabgUcaRiabd6gaUnaaBaaabaGaem4AaSMaey4kaSIaeGymaedabeaacqGGVaWlcqaHdpWCdaqhaaqaaiabd2gaTjabdMgaPjabd6gaUbqaaiabikdaYaaaaeaacqWGPbqAcqGH9aqpcqaIXaqmaeaacqWGRbWAaiabggHiLdaaaiabcYcaSmaalaaabaGaeGymaedabaWaaabmaeaacqaHjpWDdaWgaaqaaiabdMgaPbqabaGaey4kaSIaemOBa42aaSbaaeaacqWGRbWAcqGHRaWkcqaIXaqmaeqaaiabc+caViabeo8aZnaaDaaabaGaemyBa0MaemyyaeMaemiEaGhabaGaeGOmaidaaaqaaiabdMgaPjabg2da9iabigdaXaqaaiabdUgaRbGaeyyeIuoaaaGaeiyxa0faaa@6691@

The corresponding bounds of interval for μ depend on whether μ_k+1is larger or smaller than μ^k. If μ_k+1is not bigger than μ^k, then the lower (resp. upper) bound of its interval μk+11 MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGaciGaaiaabeqaaeqabiWaaaGcbaGaeqiVd02aa0baaSqaaiabdUgaRjabgUcaRiabigdaXaqaaiabigdaXaaaaaa@31D9@ (resp. μk+12 MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGaciGaaiaabeqaaeqabiWaaaGcbaGaeqiVd02aa0baaSqaaiabdUgaRjabgUcaRiabigdaXaqaaiabikdaYaaaaaa@31DB@) is obtained from the result of merging k + 1 trials by the traditional meta-analysis method where the (k + 1)th SEM is assumed to be σminnk+1(resp.σmaxnk+1) MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGaciGaaiaabeqaaeqabiWaaaGcbaqcfa4aaSaaaeaacqaHdpWCdaWgaaqaaiabd2gaTjabdMgaPjabd6gaUbqabaaabaWaaOaaaeaacqWGUbGBdaWgaaqaaiabdUgaRjabgUcaRiabigdaXaqabaaabeaaaaGcdaqadaqaaiabbkhaYjabbwgaLjabbohaZjabbchaWjabc6caUKqbaoaalaaabaGaeq4Wdm3aaSbaaeaacqWGTbqBcqWGHbqycqWG4baEaeqaaaqaamaakaaabaGaemOBa42aaSbaaeaacqWGRbWAcqGHRaWkcqaIXaqmaeqaaaqabaaaaaGccaGLOaGaayzkaaaaaa@4AC2@. On the other hand, if μ_k+1is larger than μ^k, then the lower (resp. upper) bound is obtained from the result of merging k + 1 trials by the traditional meta-analysis method where the (k + 1)th SEM is assumed to be σmaxnk+1(resp.σminnk+1) MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGaciGaaiaabeqaaeqabiWaaaGcbaqcfa4aaSaaaeaacqaHdpWCdaWgaaqaaiabd2gaTjabdggaHjabdIha4bqabaaabaWaaOaaaeaacqWGUbGBdaWgaaqaaiabdUgaRjabgUcaRiabigdaXaqabaaabeaaaaGcdaqadaqaaiabbkhaYjabbwgaLjabbohaZjabbchaWjabc6caUKqbaoaalaaabaGaeq4Wdm3aaSbaaeaacqWGTbqBcqWGPbqAcqWGUbGBaeqaaaqaamaakaaabaGaemOBa42aaSbaaeaacqWGRbWAcqGHRaWkcqaIXaqmaeqaaaqabaaaaaGccaGLOaGaayzkaaaaaa@4AC2@

Similarly, for l trials with incomplete statistical information, we define

μ k + l 1 = ∑ i = 1 k μ i ω i + ∑ i = k + 1 k + l n i μ i / σ i 2 ∑ i = 1 k ω i + ∑ i = k + 1 k + l n i / σ i 2 MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xI8qiVKYPFjYdHaVhbbf9v8qqaqFr0xc9vqFj0dXdbba91qpepeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGaciGaaiaabeqaaeqabiWaaaGcbaGaeqiVd02aa0baaSqaaiabdUgaRjabgUcaRiabdYgaSbqaaiabigdaXaaakiabg2da9KqbaoaalaaabaWaaabmaeaacqaH8oqBdaWgaaqaaiabdMgaPbqabaGaeqyYdC3aaSbaaeaacqWGPbqAaeqaaiabgUcaRmaaqadabaGaemOBa42aaSbaaeaacqWGPbqAaeqaaiabeY7aTnaaBaaabaGaemyAaKgabeaacqGGVaWlcqaHdpWCdaqhaaqaaiabdMgaPbqaaiabikdaYaaaaeaacqWGPbqAcqGH9aqpcqWGRbWAcqGHRaWkcqaIXaqmaeaacqWGRbWAcqGHRaWkcqWGSbaBaiabggHiLdaabaGaemyAaKMaeyypa0JaeGymaedabaGaem4AaSgacqGHris5aaqaamaaqadabaGaeqyYdC3aaSbaaeaacqWGPbqAaeqaaiabgUcaRmaaqadabaGaemOBa42aaSbaaeaacqWGPbqAaeqaaiabc+caViabeo8aZnaaDaaabaGaemyAaKgabaGaeGOmaidaaaqaaiabdMgaPjabg2da9iabdUgaRjabgUcaRiabigdaXaqaaiabdUgaRjabgUcaRiabdYgaSbGaeyyeIuoaaeaacqWGPbqAcqGH9aqpcqaIXaqmaeaacqWGRbWAaiabggHiLdaaaaaa@7662@

and

μ k + l 2 = ∑ i = 1 k μ i ω i + ∑ i = k + 1 k + l n i μ i / σ ′ i 2 ∑ i = 1 k ω i + ∑ i = k + 1 k + l n i / σ ′ i 2 . MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xI8qiVKYPFjYdHaVhbbf9v8qqaqFr0xc9vqFj0dXdbba91qpepeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGaciGaaiaabeqaaeqabiWaaaGcbaGaeqiVd02aa0baaSqaaiabdUgaRjabgUcaRiabdYgaSbqaaiabikdaYaaakiabg2da9KqbaoaalaaabaWaaabmaeaacqaH8oqBdaWgaaqaaiabdMgaPbqabaGaeqyYdC3aaSbaaeaacqWGPbqAaeqaaiabgUcaRmaaqadabaGaemOBa42aaSbaaeaacqWGPbqAaeqaaiabeY7aTnaaBaaabaGaemyAaKgabeaacqGGVaWlcuaHdpWCgaqbamaaDaaabaGaemyAaKgabaGaeGOmaidaaaqaaiabdMgaPjabg2da9iabdUgaRjabgUcaRiabigdaXaqaaiabdUgaRjabgUcaRiabdYgaSbGaeyyeIuoaaeaacqWGPbqAcqGH9aqpcqaIXaqmaeaacqWGRbWAaiabggHiLdaabaWaaabmaeaacqaHjpWDdaWgaaqaaiabdMgaPbqabaGaey4kaSYaaabmaeaacqWGUbGBdaWgaaqaaiabdMgaPbqabaGaei4la8Iafq4WdmNbauaadaqhaaqaaiabdMgaPbqaaiabikdaYaaaaeaacqWGPbqAcqGH9aqpcqWGRbWAcqGHRaWkcqaIXaqmaeaacqWGRbWAcqGHRaWkcqWGSbaBaiabggHiLdaabaGaemyAaKMaeyypa0JaeGymaedabaGaem4AaSgacqGHris5aaaacqGGUaGlaaa@7760@

∀i, k + 1 ≤ i ≤ k + l, we let

σ i = σ m i n , σ ′ i = σ m a x , if μ i ≤ μ k , MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xI8qiVKYPFjYdHaVhbbf9v8qqaqFr0xc9vqFj0dXdbba91qpepeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGaciGaaiaabeqaaeqabiWaaaGcbaGaeq4Wdm3aaSbaaSqaaiabdMgaPbqabaGccqGH9aqpcqaHdpWCdaWgaaWcbaGaemyBa0MaemyAaKMaemOBa4gabeaakiabcYcaSiqbeo8aZzaafaWaaSbaaSqaaiabdMgaPbqabaGccqGH9aqpcqaHdpWCdaWgaaWcbaGaemyBa0MaemyyaeMaemiEaGhabeaakiabcYcaSiabbccaGiabbMgaPjabbAgaMjabbccaGiabeY7aTnaaBaaaleaacqWGPbqAaeqaaOGaeyizImQaeqiVd02aaWbaaSqabeaacqWGRbWAaaGccqGGSaalaaa@5041@

and

σ i = σ m a x , σ ′ i = σ m i n , if μ i > μ k , MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xI8qiVKYPFjYdHaVhbbf9v8qqaqFr0xc9vqFj0dXdbba91qpepeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGaciGaaiaabeqaaeqabiWaaaGcbaGaeq4Wdm3aaSbaaSqaaiabdMgaPbqabaGccqGH9aqpcqaHdpWCdaWgaaWcbaGaemyBa0MaemyyaeMaemiEaGhabeaakiabcYcaSiqbeo8aZzaafaWaaSbaaSqaaiabdMgaPbqabaGccqGH9aqpcqaHdpWCdaWgaaWcbaGaemyBa0MaemyAaKMaemOBa4gabeaakiabcYcaSiabbccaGiabbMgaPjabbAgaMjabbccaGiabeY7aTnaaBaaaleaacqWGPbqAaeqaaOGaeyOpa4JaeqiVd02aaWbaaSqabeaacqWGRbWAaaGccqGGSaalaaa@4F94@

then we have the following result.

Let X_i~ N (μ_i, SEM_i), 1 ≤ i ≤ k + l, denote the ith sampling distribution with sample size n_isuch that SEM_iis assumed missing when i > k, then the merged result N (μ, SEM) applying the interval method to these k + l trials is:

μ ∈ [ μ k + l 1 , μ k + l 2 ] , MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xI8qiVKYPFjYdHaVhbbf9v8qqaqFr0xc9vqFj0dXdbba91qpepeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGaciGaaiaabeqaaeqabiWaaaGcbaGaeqiVd0MaeyicI4Saei4waSLaeqiVd02aa0baaSqaaiabdUgaRjabgUcaRiabdYgaSbqaaiabigdaXaaakiabcYcaSiabeY7aTnaaDaaaleaacqWGRbWAcqGHRaWkcqWGSbaBaeaacqaIYaGmaaGccqGGDbqxcqGGSaalaaa@409D@

and

S E M 2 ∈ [ 1 ∑ i = 1 k ω i + ∑ i = k + 1 k + l n i / σ m i n 2 , 1 ∑ i = 1 k ω i + ∑ i = k + 1 k + l n i / σ m a x 2 ] . MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xI8qiVKYPFjYdHaVhbbf9v8qqaqFr0xc9vqFj0dXdbba91qpepeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGaciGaaiaabeqaaeqabiWaaaGcbaGaem4uamLaemyrauKaemyta00aaWbaaSqabeaacqaIYaGmaaGccqGHiiIZcqGGBbWwjuaGdaWcaaqaaiabigdaXaqaamaaqadabaGaeqyYdC3aaSbaaeaacqWGPbqAaeqaaiabgUcaRmaaqadabaGaemOBa42aaSbaaeaacqWGPbqAaeqaaiabc+caViabeo8aZnaaDaaabaGaemyBa0MaemyAaKMaemOBa4gabaGaeGOmaidaaaqaaiabdMgaPjabg2da9iabdUgaRjabgUcaRiabigdaXaqaaiabdUgaRjabgUcaRiabdYgaSbGaeyyeIuoaaeaacqWGPbqAcqGH9aqpcqaIXaqmaeaacqWGRbWAaiabggHiLdaaaiabcYcaSmaalaaabaGaeGymaedabaWaaabmaeaacqaHjpWDdaWgaaqaaiabdMgaPbqabaGaey4kaSYaaabmaeaacqWGUbGBdaWgaaqaaiabdMgaPbqabaGaei4la8Iaeq4Wdm3aa0baaeaacqWGTbqBcqWGHbqycqWG4baEaeaacqaIYaGmaaaabaGaemyAaKMaeyypa0Jaem4AaSMaey4kaSIaeGymaedabaGaem4AaSMaey4kaSIaemiBaWgacqGHris5aaqaaiabdMgaPjabg2da9iabigdaXaqaaiabdUgaRbGaeyyeIuoaaaGaeiyxa0LaeiOla4caaa@7A53@

Merging of the Differences between Groups

In clinical trials, the between group difference of two drugs/therapies about two groups is frequently used. Suppose that the numbers of patients in the two groups are the same (majority of clinical trials allocate (approximately) the same number of patients in two contrast groups) and we denote this number as n. Assume that the first group gives a sampling distribution of the effect of one drug as X₁~ N (μ₁, SEM₁) and the second group about another drug as X₂~ N (μ₂, SEM₂). Conventionally, the between group difference (of the two drugs involved) is calculated as

X ~ N ( μ 1 − μ 2 , S E M 1 2 + S E M 2 2 ) . MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xI8qiVKYPFjYdHaVhbbf9v8qqaqFr0xc9vqFj0dXdbba91qpepeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGaciGaaiaabeqaaeqabiWaaaGcbaGaemiwaGLaeiOFa4NaemOta4KaeiikaGIaeqiVd02aaSbaaSqaaiabigdaXaqabaGccqGHsislcqaH8oqBdaWgaaWcbaGaeGOmaidabeaakiabcYcaSmaakaaabaGaem4uamLaemyrauKaemyta00aa0baaSqaaiabigdaXaqaaiabikdaYaaakiabgUcaRiabdofatjabdweafjabd2eannaaDaaaleaacqaIYaGmaeaacqaIYaGmaaaabeaakiabcMcaPiabc6caUaaa@4612@

Thus we get

S E M = S E M 1 2 + S E M 2 2 = σ 1 2 + σ 2 2 n . MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xI8qiVKYPFjYdHaVhbbf9v8qqaqFr0xc9vqFj0dXdbba91qpepeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGaciGaaiaabeqaaeqabiWaaaGcbaGaem4uamLaemyrauKaemyta0Kaeyypa0ZaaOaaaeaacqWGtbWucqWGfbqrcqWGnbqtdaqhaaWcbaGaeGymaedabaGaeGOmaidaaOGaey4kaSIaem4uamLaemyrauKaemyta00aa0baaSqaaiabikdaYaqaaiabikdaYaaaaeqaaOGaeyypa0tcfa4aaSaaaeaadaGcaaqaaiabeo8aZnaaDaaabaGaeGymaedabaGaeGOmaidaaiabgUcaRiabeo8aZnaaDaaabaGaeGOmaidabaGaeGOmaidaaaqabaaabaWaaOaaaeaacqWGUbGBaeqaaaaakiabc6caUaaa@4907@

Let σ=σ12+σ22 MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGaciGaaiaabeqaaeqabiWaaaGcbaGaeq4WdmNaeyypa0ZaaOaaaeaacqaHdpWCdaqhaaWcbaGaeGymaedabaGaeGOmaidaaOGaey4kaSIaeq4Wdm3aa0baaSqaaiabikdaYaqaaiabikdaYaaaaeqaaaaa@3740@ be a fixed value since σ₁and σ₂are fixed by the selected populations, we get SEM = σn MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGaciGaaiaabeqaaeqabiWaaaGcbaqcfa4aaSaaaeaacqaHdpWCaeaadaGcaaqaaiabd6gaUbqabaaaaaaa@2FAB@. Therefore, the two methods proposed in the previous sections are also suitable in the process of merging the between group differences.

Results and discussion

Case Study of Drugs for Type-2 Diabetes

In this section, we use the data from clinical trials on medication for adults with Type-2 diabetes as our first case study.

Many research papers and reports have been published to show the effectiveness of various oral medication for Type-2 diabetes (1213141516, etc.). For oral medication of Type-2 diabetes, the meta-analysis in 17 compared each pair of drugs on systolic blood pressure (SBP for short), diastolic blood pressure (DBP), low density lipoprotein cholesterol (LDL-C) and high density lipoprotein cholesterol (HDL-C), etc.

In this section, we consider the between group difference on the effectiveness of pairs of drugs for lowering LDL-C. In 17, there were 14 sets of results comparing between group difference of 14 pairs of drugs on lowering LDL-C. We selected four sets among these 14 sets for our case study, because each of them contains more than four trials so that our merging method can be applied more adequately. Our data were obtained from the original papers, most of which are the same as the data used in 17, however some data used in 17 are different from what we have found in the original papers. When this happens, we will state it clearly in the examples.

The drugs being compared in the selected four groups are

1. Thiazolidinedione versus Metformin (Example 1),

2. Triazolidinedione versus second generation Sulfonylureas (Example 2),

3. Metformin versus Metformin plus second generation Sulfonylureas (Example 3),

4. Second generation Sulfonylureas versus Metformin plus second generation Sulfonylureas (Example 4).

Example 1 Drugs for reduction of low density lipoprotein (LDL for short) were studied by many papers. They compared the LDL-C reduction between different trial groups. For example, to compare drugs Thiazolidinedione and Metformin, we obtained the following (in mg/dL) sampling distributions from four trials.

18: X_Pa~ N (13.3, SEM_Pa) with n = 102.

12: X_LT~ N (7.8, 20.5) with n = 20.

19: X_Han~ N (10.1, 2.7) with n = 320.

20: X_Sch~ N (15.2, SEM_Sch) with n = 597.

Here n is the size of samples (number of patients) in each group of the trial, and SEM_Paand SEM_Schstand for the missing values (SEM values) from their respective trials data.

The meta-analysis results obtained by using prognostic method, interval method, and traditional method for incomplete trials information are provided in Table 1.

Table 1

Thiazolidinedione vs. Metformin

Missing

Int

Inc

(X_P)

(X_I)

(X_Inc)

X_Pa, X_Sch

12.56 ± 1.91

[11.94, 13.39] ± [1.54, 2.14]

10.1 ± 2.68

In Table 1, the first column shows the SEMs of X_Paand X_Schare missing. The second column shows that the result obtained by the prognostic (P for short) method is X_p~ N (12.56, 1.91) (denoted as 12.56 ± 1.91 in Table 1). The third column stands for the result obtained by the interval method (Int for short) and the last column stands for the result given by the traditional method on meta-analysis with incomplete trials information (Inc for short), i.e., removing trials with incomplete information. The rest of the tables in this case study follow the same notations and explanations.

Compared to X_BW~ N (12.5,1.89) 17which is the meta-analysis result when all information is complete, obviously, with two SEM values missing, X_Pis still very close to X_BW. Therefore, X_Pcan be used to replace X_BW for this set of trials. In addition, we also have 12.5 ∈ [11.94, 13.39] and 1.89 ∈ [1.54, 2.14] which indicate that X_Iis a good estimation.

Example 2 To compare Thiazolidinedione and second generation Sulfonylureas, we obtained the following sampling distributions (in mg/dL) from five trials.

12: X_LT~ N (10.5, 14.44) with n = 20.

13: X_CM~ N (11.31, 1.59) with n = 620.

14: X_TJ~ N (6.63, SEM_TJ) with n = 100.

15: X_PM~ N (5, 6.04) with n = 86.

16: X_MC~ N (14.6, SEM_MC) with n = 315.

There are two missing SEM values.

The meta-analysis results for this example are provided in Table 2.

Table 2

Triazolidinedione vs. second generation Sulfonylureas

Missing

Int

Inc

(X_P)

(X_I)

(X_Inc)

X_TJ, X_MC

11.35 ± 1.32

[10.91, 11.88] ± [1.20, 1.38]

10.9 ± 1.53

In this example, X_Pis reasonably close to X_BWwhere X_BW~ N (10.4,1.61) 17. However X_Incis closer.

Example 3 To compare Metformin and Metformin plus second generation Sulfonylureas, we looked at another set containing six trials with sampling distributions as follows (in mg/dL).

21: X_Ga~ N (-10.2, SEM_Ga) with n = 168.

22: X_Go~ N (-7.0, 5.18) with n = 60.

23: X_Ma~ N (-3.9, 4.11) with n = 103.

24: X_DeF~ N (2.0, 2.8) with n = 186.

25: X_H94~ N (-3.1, 3.6) with n = 30.

26: X_H91~ N (8.2, 5.8) with n = 15.

There is only one missing SEM value. The meta-analysis result in 17 is X_BW~ N (-1.6, 2.53) while we obtained the following results.

The meta-analysis results for this example are provided in Table 3.

Table 3

Metformin vs. Metformin plus second generation Sulfonylureas

Missing

Int

Inc

(X_P)

(X_I)

(X_Inc)

X _Ga

-3.82 ± 1.43

[-6.11, -2.88] ± [1.15, 1.53]

-0.73 ± 1.74

Some data (sampling distributions of 232526) used in 17 are somehow different from the data we found from the original papers. Naturally, there is a margin between the merged sampling distribution from our methods and that from the meta-analysis. Therefore, it is difficult to compare these results.

Example 4 A set of seven trials was analyzed in 17 to compare the second generation Sulfonylureas versus Metformin plus second generation Sulfonylureas. We obtained the following seven sampling distributions (in mg/dL) from them.

21: X_Ga~ N (-2.2, SEM_Ga) with n = 168.

22: X_Go~ N (-0.2, 4.6) with n = 60.

23: X_Ma~ N (3.9, 4.72) with n = 103.

27: X_Gr~ N (10.14, 10.17) with n = 87.

24: X_DeF~ N (11.0, 2.83) with n = 186.

25: X_H94~ N (7.41, 4.22) with n = 30.

26: X_H91~ N (19.89, 5.54) with n = 15.

There is one SEM value missing. The results from our methods are given in Table 4.

Table 4

Second generation Sulfonylureas vs. Metformin plus second generation Sulfonylureas

Missing

Int

Inc

(X_P)

(X_I)

(X_Inc)

X _Ga

6.20 ± 1.57

[2.79, 7.96] ± [1.21, 1.73]

8.56 ± 1.78

It appears that X_Pis not so close to X_BWwhere X_BW~ N (8.1,2.55) 17. Once again, some data (sampling distributions of 232526) used in 17 are not the same as given in the original papers. So effectively, we had to use different data to perform the merging of these several trials.

Case Study of IOP Reduction

In the above subsection, we applied our methods to approximate the traditional meta-analysis when some SEM values are missing. Because some of the data we found in the original papers are different from that used in the meta-analysis paper 17, it is hard to judge our approaches in some cases. In order to further validate our approaches experimentally, in this section, we consider and apply our methods to a set of trials with full statistical information. In other words, every trial we consider will have both the mean and the SEM value in its sampling distribution. To validate how accurate our two approaches are for predicting an SEM value, we deleted an SEM value from a trial selected randomly from a set of trials, and applied our methods to predict it. We then applied the meta-analysis method to merge the trial with the predicted SEM value together with the rest of trials in the group to see how close this new result is to the original meta-analysis result. Furthermore, as the traditional method for trials with incomplete information always abandons trials with incomplete information, we also compared our methods with this traditional method.

We considered four sets of trials used in 1 on IOP reduction. 1 reported the meta-analysis of some trials about between group difference of IOP reduction from baselines using drugs Latanoprost and Timolol.

Example 5 (one week results) Three papers on clinical trials about IOP reduction gave the following three sampling distributions comparing Latanoprost and Timolol for one-week trial duration.

28: X₁~ N (8.5, 8.24) with n = 46.

29: X₂~ N (5.62, 7.91) with n = 15.

30: X₃~ N (6.85, 4.01) with n = 20.

The traditional meta-analysis in 1 produced X_1w~ N (6.90, 3.28). We deleted the SEM value from one of these trials in turn and applied our methods to predict it. Then we calculated the merged sampling distribution involving this predicted SEM value. The results are summarized in Table 5.

Table 5

Latanoprost vs. Timolol: one week

Missing

Int

Inc

X P i MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGaciGaaiaabeqaaeqabiWaaaGcbaGaemiwaG1aa0baaSqaaiabdcfaqbqaaiabdMgaPbaaaaa@2FBF@

X I i MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGaciGaaiaabeqaaeqabiWaaaGcbaGaemiwaG1aa0baaSqaaiabdMeajbqaaiabdMgaPbaaaaa@2FB1@

X I n c i MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGaciGaaiaabeqaaeqabiWaaaGcbaGaemiwaG1aa0baaSqaaiabdMeajjabd6gaUjabdogaJbqaaiabdMgaPbaaaaa@3265@

X ₁

7.55 ± 2.53

[7.33, 7.83] ± [2.12, 2.80]

6.60 ± 3.57

X ₂

6.97 ± 3.37

[6.58, 7.07] ± [2.84, 3.49]

6.85 ± 4.01

X ₃

6.96 ± 4.91

[6.94, 6.97] ± [4.38, 5.19]

7.00 ± 5.71

In Table 5, the second row starting with "X₁" means that if the SEM value of X₁is missing, then from the prognostic method, we get XP1 MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGaciGaaiaabeqaaeqabiWaaaGcbaGaemiwaG1aa0baaSqaaiabdcfaqbqaaiabigdaXaaaaaa@2F54@ ~ N (7.55, 2.53), from the interval method, we get XI1 MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGaciGaaiaabeqaaeqabiWaaaGcbaGaemiwaG1aa0baaSqaaiabdMeajbqaaiabigdaXaaaaaa@2F46@ ~ N ([7.33, 7.83], [2.12, 2.80]), and from the traditional method for trials with incomplete information, we get XInc1 MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGaciGaaiaabeqaaeqabiWaaaGcbaGaemiwaG1aa0baaSqaaiabdMeajjabd6gaUjabdogaJbqaaiabigdaXaaaaaa@31FA@ ~ N (6.60, 3.57). Other rows are explained similarly. We can see that XPi MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGaciGaaiaabeqaaeqabiWaaaGcbaGaemiwaG1aa0baaSqaaiabdcfaqbqaaiabdMgaPbaaaaa@2FBF@s, 1 ≤ i ≤ 3, are close to the result obtained by the traditional method.

Example 6 (one month results) Three papers on clinical trials about IOP reduction gave the following three sampling distributions comparing Latanoprost and Timolol for one month duration.

28: X₁~ N (11.0, 6.05) with n = 46.

31: X₂~ N (5.2, 1.66) with n = 184.

32: X₃~ N (0.4, 2.17) with n = 294.

The traditional meta-analysis gives X_1m~ N (3.77, 1.29). The results are summarized in Table 6. XPi MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGaciGaaiaabeqaaeqabiWaaaGcbaGaemiwaG1aa0baaSqaaiabdcfaqbqaaiabdMgaPbaaaaa@2FBF@s, 1 ≤ i ≤ 3, are also very close to the result obtained by the traditional method.

Table 6

Latanoprost vs. Timolol: one month

Missing

Int

Inc

X ₁

4.05 ± 1.26

[3.84, 4.46] ± [1.22, 1.28]

3.43 ± 1.32

X ₂

2.81 ± 1.67

[2.73, 2.89] ± [1.64, 1.69]

1.61 ± 2.04

X ₃

3.38 ± 1.21

[2.49, 4.00] ± [1.01, 1.33]

5.61 ± 1.60

Example 7 (three months results) Five papers on clinical trials about IOP reduction gave the following five sampling distributions comparing Latanoprost and Timolol for three months duration.

33: X₁~ N (4.0, 3.11) with n = 267.

34: X₂~ N (5.41, 5.56) with n = 60.

35: X₃~ N (3.2, 4.03) with n = 36.

31: X₄~ N (7.8, 3.98) with n = 184.

32: X₅~ N (1.9, 2.12) with n = 294.

The traditional meta-analysis gives X_3m~ N (3.52, 1.44). The results are summarized in Table 7. Once again, XPi MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGaciGaaiaabeqaaeqabiWaaaGcbaGaemiwaG1aa0baaSqaaiabdcfaqbqaaiabdMgaPbaaaaa@2FBF@s, 1 ≤ i ≤ 5, are close to the result obtained by the traditional method.

Table 7

Latanoprost vs. Timolol: three months

Missing

Int

Inc

X ₁

3.58 ± 1.35

[3.51, 3.72] ± [1.09, 1.46]

3.39 ± 1.62

X ₂

3.53 ± 1.43

[3.47, 3.76] ± [1.34, 1.46]

3.38 ± 1.49

X ₃

3.55 ± 1.51

[3.54, 3.56] ± [1.49, 1.52]

3.57 ± 1.54

X ₄

3.99 ± 1.36

[3.59, 4.98] ± [1.17, 1.43]

2.88 ± 1.54

X ₅

3.77 ± 1.54

[2.93, 4.07] ± [1.14, 1.66]

4.91 ± 1.96

Example 8 (six months results) Four papers on clinical trials about IOP reduction gave the following four sampling distributions comparing Latanoprost and Timolol for six months duration.

33: X₁~ N (4.8, 3.14) with n = 267.

36: X₂~ N (7.1, 1.58) with n = 268.

35: X₃~ N (4.5, 5.23) with n = 36.

32: X₄~ N (1.5, 2.14) with n = 294.

The traditional meta analysis gives X_3m~ N (5.05, 1.15). The results are summarized in Table 8. Finally, XPi MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGaciGaaiaabeqaaeqabiWaaaGcbaGaemiwaG1aa0baaSqaaiabdcfaqbqaaiabdMgaPbaaaaa@2FBF@s, 1 ≤ i ≤ 4, are also close to the result obtained by the traditional method.

Table 8

Latanoprost vs. Timolol: six months

Missing

Int

Inc

X ₁

5.00 ± 1.04

[4.98, 5.02] ± [0.97, 1.08]

5.09 ± 1.24

X ₂

4.15 ± 1.38

[3.72, 4.64] ± [1.26, 1.48]

2.75 ± 1.68

X ₃

5.06 ± 1.16

[5.04, 5.07] ± [1.14, 1.17]

5.08 ± 1.18

X ₄

5.02 ± 1.15

[4.25, 5.63] ± [1.01, 1.24]

6.49 ± 1.36

By comparing these results, we can conclude that the more trials we have in an example, the closer our result is to the traditional meta-analysis method. This is because when the number of trials included in a meta-analysis gets larger, the error of meta-analysis gets smaller. Therefore, the predicted SEM value from the prognostic method gets closer to the real SEM value and the intervals used in the interval method have a better chance to contain the real values.

Discussion

Here we mainly analyze the results obtained from the IOP examples. Since we have stated that some data used in 17 are different from the data we found in the original papers, it would be difficult to compare those results objectively.

First, we found that the results obtained from the prognostic method are closer to the true results. It implies that the prognostic method is truly applicable. Although the interval method gives an interval instead of a single value, the interval provides a clear indication as to where the real value could be, and so it is an alternative to supplement the missing value.

Second, we found that the prognostic method is superior to the traditional method for trials with incomplete information which abandons trials with missing information. In fact, we can see that although in some cases, the results obtained by the traditional method for trials with incomplete information are also close to the true results, in some other cases, they deviate from the true results significantly, such as cases like in Table 6, when the SEM of X₂is missing, in Table 7, that of X₄or X₅is missing, and in Table 8, that of X₂or X₄is missing. That is, the prognostic method is more stable and precise than the traditional method for incomplete trial information. This result is not surprising because the prognostic method takes into account all the eligible trials. On the contrary, if the SEM value of a trial with a large/small mean value is missing, then the traditional method for trials with incomplete information will abandon this trial and naturally gets a result with smaller/higher mean value than the true one. However, the prognostic method does not abandon this trial, and instead it predicts a value for the missing one. Therefore, the final combined result is closer to the real result of meta-analysis. This is also illustrated by Examples 5,6,7,8, etc, except the case of the missing SEM of X₁in Example 5.

Dealing with missing data in statistics, especially in meta-analysis is a very important issue (e.g., 373839). However, there are hardly any papers focusing on missing standard errors. This paper thus provides some fresh results about how to deal with this situation. Our assumption that the populations should be the same or similar intuitively follows the well known Missing-at-random (MAR) assumption, except that MAR mainly focuses on repeatedly measured data while ours are focusing on different trials. With this assumption, the prognostic and the interval methods are easily induced. Generally speaking, the prognostic method is related to the regression imputation and the interval method is to some extent a concrete implementation of the best/worst case analysis 40 with our assumption and situations.

A small caveat of the prognostic and the interval methods is that when the input data are imprecise (as shown in Examples 3 and 4), we may obtain worse results than that from the traditional method for incomplete information. This is because when some input data are imprecise, the prognostic method will get wrong predictions for missing SEMs, hence obtain worse meta-analysis results whilst the traditional method for incomplete trial information simply abandons trials with incomplete information, avoiding any wrong predictions and therefore may obtain better results. In addition, in Example 5, when the SEM value of X₁is missing, we found that the result obtained by the prognostic method is not as accurate as that obtained by the traditional method for incomplete information. This is because the SEM value of X₁is exceptionally larger than the others, i.e., as the sample size of X₁is greater than those of X₂and X₃, it is expected (according to our assumption of same population) that the SEM of X₁should be smaller, however, it is not. So the prognostic method performs less effectively here.

Conclusion

Methods to deal with statistical information in clinical trials for which the SEMs values are missing is a neglected area in the literature. An obvious solution is to ignore a trial with missing SEM values. Our methods provide an application tool to solve this problem by effectively predicting missing SEMs or providing applicable intervals for the missing SEMs. The prognostic method can be used to obtain a result in a commonly accepted format, e.g., sampling distribution, whilst the interval method, although seemingly not so straightforward, provides a safer and also informative result.

Competing interests

The authors declare that they have no competing interests.

Authors' contributions

JM, WL and AH contributed to the analysis methods and the collection of materials on case studies. WZ contributed to the analysis methods and the evaluation of these new methods with respect to the traditional meta-analysis method and the traditional method for dealing with missing values. All authors read and approved the final manuscript.

Acknowledgements

We would like to thank the UK EPSRC for the project grant supports to Jianbing Ma, Weiru Liu and Anthony Hunter, and Joanna Rawmowski for her logistic support for this project.

Meta-analysis of randomised controlled trials comparing latanoprost with timolol in the treatment of patients with open angle glaucoma or ocular hypertension Zhang WY Po AL Dua HS Azuara-Blanco A Br J Ophthalmol 2001 85 983 990 1724079 11466259 10.1136/bjo.85.8.983 Greenhalgh T How to Read a Paper: The Basics of Evidence-Based Medicine BMJ Press 1997 Comparative analysis of the efficacy and safety of latanoprost, travoprost and the fixed combination timolol-dorzolamide; a prospective, randomized, masked, cross-over design study Chiselita D Antohi I Medvichi R Danielescu C Oftalmologia 2005 49 3 39 45 16408674 Bimatoprost-Travoprost Study Group, Intraocular pressure-lowering efficacy of bimatoprost 0.03% and travoprost 0.004$ in patients with glaucoma or ocular hypertension Cantor LB Hoop J Morgan L Wudunn D Catoira Y Br J Ophthalmol 2006 90 11 1370 1373 10.1136/bjo.2006.094326 16825272 Circadian IOP-lowering efficacy of travoprost 0.004$ ophthalmic solution compared to latanoprost 0.005% Gracia-Feijo J Martinez-de-la Casa JM Castillo A Mendez C Fernandez-Vidal A Garcia-Sanchez J Curr Med Res Opin 2006 22 9 1689 1697 10.1185/030079906X120959 16968572 The Safety and Efficacy of Travoprost 0.004%/Timolol 0.5% Fixed Combination Ophthalmic Solution Howard S Silvia ON Brian E John S Sushanta M Theresa A V M Ame J Ophthalmology 2005 140 1 1 8 Projected impact of travoprost versus timolol and latanoprost on visual field deficit progression and costs among black glaucoma subjects Michael T David W Alan L Trans Am Ophthalmol Soc 2002 100 109 118 1358952 12545683 Comparing bimatoprost and travoprost in black Americans Noecker RJ Earl ML Mundorf TK Silvestein SM P PM Curr Med Res Opin 2006 22 11 2175 2180 10.1185/030079906X148418 17076978 Effects of Travoprost Eye Drops on Intraocular Pressure and Pulsatile Ocular Blood Flow: A 180-Day, Randomized, Double-Masked Comparison with Latanoprost Eye Drops in Patients with Open-Angle Glaucoma Nicola C Michele V Tiziana T Francesco C Carlo S Curr Ther Res 2003 64 7 389 400 10.1016/S0011-393X(03)00112-7 A comparison of travoprost, la-tanoprost and the fixed combination of dorzolamide and timolol in patients with pseudoexfoliation glaucoma Parmarksiz S Yuksel N Karabas VL Ozkan B Demirci G Caglar Y Eur J Ophthalmol 2006 16 1 73 80 16496249 Axial length of the ocular globe and hypotensive effect in glaucoma therapy with prostaglandin analogs Stefan C Nenciu A Malcea C Tebeanu E Oftalmologia 2005 49 4 47 50 16524126 Favorable Effects of Pioglitazone and Metformin Compared With Gliclazide on Lipoprotein Subfractions in Overweight Patients With Early Type 2 Diabetes Lawrence J Reid J Taylor G Stirling C J R Diabetes Care 2004 27 1 41 46 10.2337/diacare.27.1.41 14693964 A long-term comparison of pioglitazone and gliclazide in patients with Type 2 diabetes mellitus: a randomized, double-blind, parallel-group comparison trial Charbonnel BH Matthews DR Schernthaner G Hanefeld M Brunetti P the QUARTET Study Group Diabetic Medicine 2004 22 399 405 10.1111/j.1464-5491.2004.01426.x Sustained effects of pioglitazone vs. glibenclamide on insulin sensitivity, glycaemic control, and lipid profiles in patients with Type 2 diabetes Tan MH Johns D Strand J Halse J Madsbad S Eriksson JW Clausen J Konkoy CS Herz M the GLAC Study Group Diabetic Medicine 2004 21 859 866 10.1111/j.1464-5491.2004.01258.x 15270789 Improvement of Cardiovascular Risk Markers by Pioglitazone Is Independent From Glycemic Control Results From the Pioneer Study Pfüzner A Marx N Lüben G Langenfeld M Walcher D Konrad T Forst T Journal of the American College of Cardiology 2005 45 12 1925 1931 10.1016/j.jacc.2005.03.041 15963388 Long-term therapy with addition of piogli-tazone to metformin compared with the addition of gliclazide to metformin in patients with type 2 diabetes: a randomized, comparative study Matthews DR Charbonnel BH Hanefeld M Brunetti P G S Diabetes Metab Res Rev 2005 21 167 174 10.1002/dmrr.478 15386821 Comparative effectiveness and safety of oral diabetes medications for adults with type 2 diabetes Bolen S Wilson L Vassy J Feldman L Yeh J Marinopoulos S Wilson R Cheng D Wiley C Selvin E Malaka D Akpala C Brancati F Bass E Ann Intern Med 2007 147 6 386 399 17638715 Effect of Pioglitazone Compared with Metformin on Glycemic Control and Indicators of Insulin Sensitivity in Recently Diagnosed Patients with Type 2 Diabetes Pavo I Jermendy G Varkonyi TT Kerenyi Z Gyimesi A Shoustov S Shestakova M Herz M Johns D Schluchter BJ Festa A Tan MH The Journal of Clinical Endocrinology & Metabolism 2003 88 4 1637 1645 10.1210/jc.2002-021786 HobotQSG: One-Year Glycemic Control With a Sulfonylurea Plus Pioglitazone Versus a Sulfonylurea Plus Metformin in Patients With Type 2 Diabetes Hanefeld M Brunetti P Schernthaner GH Matthews DR Charbonnel B Diabetes Care 2004 27 1 141 147 10.2337/diacare.27.1.141 14693980 Brunetti PoBotQSG: Efficacy and Safety of Pioglitazone Versus Metformin in Patients with Type 2 Diabetes Mellitus: A Double-Blind, Randomized Trial Schernthaner G Matthews DR Charbonnel B Hanefeld M The Journal of Clinical Endocrinology & Metabolism 2004 89 12 6068 6076 10.1210/jc.2003-030861 Efficacy of Glyburide/Metformin Tablets Compared with Initial Monotherapy in Type 2 Diabetes Garber AJ Donovan DS Dandona P Bruce S Park JS The Journal of Clinical Endocrinology & Metabolism 2003 88 8 3598 3604 10.1210/jc.2002-021225 Multicenter, Randomized, Double-Masked, Parallel-Group Assessment of Simultaneous Glipizide/Metformin as Second-Line Pharmacologic Treatment for Patients with Type 2 Diabetes MellitusThat Is Inadequately Controlled by a Sulfonylurea Goldstein BJ Pans M Rubin CJ Clinical Therapeutics 2003 25 3 890 903 10.1016/S0149-2918(03)80112-1 12852706 Improved glycaemic control with metformin glibenclamide combined tablet therapy (Glucovance) in Type 2 diabetic patients inadequately controlled on metformin Marre M Howlett H Lehertt P Allavoine T Diabetic Medicine 2002 19 673 680 10.1046/j.1464-5491.2002.00774.x 12147149 Goodman AMfTMMSG: Efficacy Of Metformin In Patients With Non-Insulin-Dependent Diabetes Mellitus Defronzo RA The New England Journal Of Medicine 1995 333 9 541 549 10.1056/NEJM199508313330902 7623902 Therapeutic Comparision of Metformin and Sulfonylurea, alone and in Various Combinations. A Double-blind Controlled Study Hermann LS Schersten B Bitzen PO Kjellstrom T Lindgarde F Melander A Diabetes Care 1994 17 10 1100 1109 10.2337/diacare.17.10.1100 7821128 Effects of Metformin and Glibenclamide alone and in Combination on Serum Lipids and Lipoproteins in Patients with Non-insulin-dependent Diabetes Mel-litus Hermann LS Kjellstrom T Nilsson-Ehle P Diabete Metab 1991 17 1 pt 2 174 179 1936472 Poorly Controlled Elderly Type 2 Diabetic Patients: the Effects of Increasing Sulphonylurea Dosages or Adding Metformin Gregorio F Ambrosi F Manfrini S Velussi M Carle F Testa R Merante D Filipponi P Diabet Med 1999 16 12 1016 1024 10.1046/j.1464-5491.1999.00201.x 10656230 Comparison of two fixed combinations of latanoprost and timolol in open-angle glaucoma Diestelhorst M Almegard B Graefes Arch Clin Exp Ophthalmol 1998 236 577 581 10.1007/s004170050124 9717652 A comparative study of the effects of timolol and latanoprost on blood flow velocity of the retrobulbar vessles Nicolela MT Buckley AR Walman BE Drance SM Am J Ophthalmol 1996 122 784 789 8956632 Additive effect of latanoprost, a prostaglandin F2<it>α </it>analogue, and timolol in patients with elevated intraocular pressure Rulo AH Greve EL Hoyng PF Br J Ophthalmol 1994 78 899 902 504988 7819171 10.1136/bjo.78.12.899 A comparison of latanoprost and timolol in primary open-angle glaucoma and ocular hypertension: a 12-week study Mishima HK Masuda K Kitazawa Y Azuma I Araie M Arch Ophthalmol 1996 114 929 932 8694726 A six-month, randomized, double-masked study comparing latanoprost with timolol in open-angle glaucoma and ocular hypertension Watson P Stjernschantz J Ophthalmology 1996 103 126 137 8628543 Effects on intraocular pressure and side effects of 0.005% latanoprost applied once daily, evening or morning-a comparison with tim-olol Alm A Stjernschantz J the Scandinavian Latanoprost Study Group Ophthalmology 1995 102 1743 1752 9098273 The effect of latanoprost vs timolol on intraocular pressure in patients with glaucoma and ocular hypertension Aquino MV Lat-Luna M Asian J Ophthalmology 1999 1 3 7 A 12-month, randomized, double-masked study comparing latanoprost with timolol in pigmentary glaucoma Mastropasqua L Carpineto P Ciancaglini M Gallenga PE Ophthalmology 1999 106 550 555 10.1016/S0161-6420(99)90115-X 10080213 Comparison of latanoprost and timolol in patients with ocular hypertension and glaucoma. A six-month, masked, multicenter trial in the United States Camras CB the US Latanoprost Study Group Ophthalmology 1996 103 138 147 8628544 Missing at Random, Likelihood Ignorability and Model Completeness Lu G Copas JB The Annals of Statistics 2004 32 2 754 765 10.1214/009053604000000166 Local model uncertainty and incomplete-data bias Copas JB Eguchi S J R Statist Soc B 2005 67 4 459 513 10.1111/j.1467-9868.2005.00512.x Missing data and departures from randomised treatment in pragmatic trials White I http://www.mrc-bsu.cam.ac.uk/BSUsite/Research/Section11.shtml Uncertainty method improved on best-worst case analysis in a binary meta-analysis Gamble C Hollis S Journal of Clinical Epidemiology 2005 58 6 579 588 10.1016/j.jclinepi.2004.09.013 15878471

Pre-publication history

The pre-publication history for this paper can be accessed here:

http://www.biomedcentral.com/1471-2288/8/56/prepub