Next Article in Journal
Farmers’ Attitudes to the Pricing of Natural Resources for Sustainability: GAP-Şanlıurfa Sampling of Turkey
Next Article in Special Issue
Climate Change Impact Assessment on Freshwater Inflow into the Small Aral Sea
Previous Article in Journal
Hydrogeological and Climatological Risks Perception in a Multi-Hazard Environment: The Case of Greece
Previous Article in Special Issue
Development of Threshold Levels and a Climate-Sensitivity Model of the Hydrological Regime of the High-Altitude Catchment of the Western Himalayas, Pakistan
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Assessing the Performance of CMIP5 Global Climate Models for Simulating Future Precipitation Change in the Tibetan Plateau

1
Institute of Geographic Sciences and Natural Resources Research, Chinese Academy of Sciences, Beijing 100101, China
2
University of Chinese Academy of Sciences, Beijing 100049, China
3
School of Public Policy & Management, Anhui Jianzhu University, Hefei 230000, China
*
Author to whom correspondence should be addressed.
Water 2019, 11(9), 1771; https://doi.org/10.3390/w11091771
Submission received: 16 July 2019 / Revised: 14 August 2019 / Accepted: 22 August 2019 / Published: 25 August 2019
(This article belongs to the Special Issue Evaluating Hydrological Responses to Climate Change)

Abstract

:
In this study, the performance of 33 Coupled Model Intercomparison Project 5 (CMIP5) global climate models (GCMs) in simulating precipitation over the Tibetan Plateau (TP) was assessed using data from 1961 to 2005 by an improved score-based method, which adopts multiple criteria to achieve a comprehensive evaluation. The future precipitation change was also estimated based on the Delta method by selecting the submultiple model ensemble (SMME) in the near-term (2006–2050) and far future (2051–2095) periods under Representative Concentration Pathways (RCP) scenarios RCP4.5 and RCP8.5. The results showed that most GCMs can reasonably simulate the precipitation pattern of an annual cycle; however, all GCMs overestimated the precipitation over TP, especially in spring and summer. The GCMs generally provide good simulations of the temporal characteristics of precipitation, while they did not perform as well in reproducing its spatial distributions. Different assessment criteria lead to inconsistent results; however, the improved rank score method, which adopts multiple criteria, provided a robust assessment of GCMs performance. The future annual precipitation was projected to increase by ~6% in the near-term with respect to the period 1961–2005, whereas increases of 12.3% and 16.7% are expected in the far future under RCP4.5 and RCP8.5 scenarios, respectively. Similar spatial distributions of future precipitation changes can be seen in the near-term and far future periods under the two scenarios, and indicate that the most predominant increases occurred in the north of TP. The results of this study are expected to provide valuable information on climate change, and for water resources and agricultural management in TP.

1. Introduction

The Tibetan Plateau (TP), also referred to as the “Third Pole” of the world [1], is the highest plateau in the world. It has an average elevation of more than 4000 m and features complex terrains [2]. TP is the source of major rivers in Asia, and as such is also referred to as the “Water Tower of Asia” [3]. Owing to its unique geographical characteristics, TP plays an important role in the East Asian and global atmospheric circulation through dynamic and thermal processes. On the other hand, TP is identified as a region that is sensitive and vulnerable to climate change. It is experiencing a warming trend [4,5,6], which has profound impacts on the hydrological cycle and the ecological system. Therefore, it is imperative to understand how climate will change in TP in the future.
Precipitation is a key climate variable in the global climate system and has an important impact on the hydrological cycle and the ecological system [7,8,9]. Scientific evidence has shown that precipitation patterns change in a warmer climate, and the likelihood of extreme precipitation is expected to increase due to global warming [10,11,12,13]. Thus, understanding the effect of climate change on precipitation has a great significance, as such information can be important for devising strategies to cope with such change.
Global climate models (GCMs) have been valuable tools for assessing climate change and produce climate projections [14]. The Coupled Model Intercomparison Project 5 (CMIP5) has provided numerous GCMs, which have more complicated mechanisms than before, and incorporate carbon cycle models and a dynamic vegetation module [15]. Many studies have found that the CMIP5 models perform better than the CMIP3 ones, have a smaller bias, and an overall improved capability of simulating climate change [16,17,18,19]. The same results were also demonstrated in characterizing the climatology of the East Asian monsoon [20,21]. However, CMIP5 models are still affected by major bias in simulating the magnitude and trend of precipitation, especially in regions with complex topography [22,23].
Many studies have been conducted to assess the performance of precipitation simulations of the CMIP5 GCMs using various methods in different regions [24,25,26,27,28,29]. Fu et al. [30] evaluated the performance of 25 GCMs using a score-based method in southeastern Australia. Das et al. [31] adopted a Multiple Imputation Chained Equation technique to cope with the limited data availability and poor data quality in the Western Himalayan Region, and assessed 34 GCMs based on three criteria: mean seasonal cycle, temporal trends, and spatial correlation. Li et al. [32] used the technique for order preference by similarity to ideal solution model to assess 31 GCMs in mainland Southeast Asia. Moreover, multimodel ensembles of GCMs have been proven to perform better than individual GCMs, especially after rejecting the most poorly performing models based on the assessment of all GCMs, and were shown to provide more reliable information on climate change [33,34]. Thus, an accurate assessment of GCMs with appropriate methods is necessary.
Because of the coarse resolution of the GCMs, the outputs provide inadequate climate change information at the regional or local scale [35,36]. Downscaling methods, including dynamic downscaling and statistical downscaling, have been used to bridge the gap between the coarse resolution of GCMs and the need for climate information at a local scale [37,38]. Statistical downscaling has advantages in its convenient implementation and lower computational requirements without considering the effects of boundary conditions [39]. The Delta method, which is one of the statistical downscaling methods, has been widely applied in future climate projections [40,41,42].
In view of the complexity of the East Asian monsoon system and the complex influence of topography, the uncertainty about future climate change is amplified in TP [43,44]. In addition, the limited number of observation stations and data availability aggravates the uncertainty in precipitation projections for TP. Previous studies assessed the simulation capabilities of the CMIP5 GCMs using several evaluation indicators for TP [2,8,22,45]. However, for TP, only a few studies have adopted a multiple-criteria evaluation method to assess the CMIP5 GCMs comprehensively, and simulated future precipitation in combination with downscaling methods. Therefore, in this study, an improved rank score method is applied for assessing the performance of the CMIP5 GCMs in simulating precipitation over TP. The Delta method is then used to project the future precipitation change during two periods under Representative Concentration Pathway 4.5 (RCP4.5) and Representative Concentration Pathway 8.5 (RCP8.5) scenarios for TP based on a multimodel ensemble, which selects the best performing GCMs. The improved rank score and Delta downscaling method can be used to evaluate the GCMs and simulate future climate change. This study is expected to provide valuable information on climate change, and for water resources and agricultural management throughout TP.

2. Materials and Methods

2.1. Study Area

TP is located in East Asia. The study area in this work is limited to 26–40° N and 74–106° E (Figure 1). TP features a complex topography, snow mountains, glaciers, permafrost, and lakes. TP is called the roof of the world because of its high elevation, especially in the western TP. The complex terrain and the presence of the Asian monsoon, which exerts an important influence on the regional climate, are the major factors controlling the amount and patterns of precipitation [46].

2.2. Data

2.2.1. GCM Data

The assessment and projection presented in this study are based on the 33 GCMs of the CMIP5 (Table 1), including historical monthly precipitation data from 1961 to 2005 and future outputs data from 2006 to 2100 under the RCP4.5 and RCP8.5 scenarios. Table 1 provides summary information on the GCMs, whereas more details are available on the CMIP5 website. In view of the different spatial resolutions of the GCMs, precipitation data of the GCMs were all resampled to a 2° × 2° grid using a bilinear interpolation approach [29].

2.2.2. Observed Data

The observed data from 1961 to 2005 used in this study were obtained from the China Meteorological Data Sharing Service System. The dataset was interpolated into a high spatial resolution grid of 0.5° × 0.5° on the basis of records from Chinese meteorological stations, accounting for the elevation effect using the Thin Plate Spline interpolation method [47], and verified through data quality control. To facilitate assessment and comparisons, the observed data were also resampled to a 2° × 2° grid to be consistent with the GCMs data. TP contains 89 of such grid cells (Figure 1), all of which were utilized in the comparisons.

2.3. Methods

2.3.1. Assessment of CMIP5 GCMs

Considering that a single assessment criterion can lead to a biased result [30,48], multiple criteria were adopted for the assessment, including the mean value (M), standard deviation (SD), temporal correlation coefficient (r_t), spatial correlation coefficient (r_s), Mann–Kendall test statistics (Z and Slope), and probability density function (PDF) statistics (Brier score (BS) and Significance score (Sscore)). Then, accounting for all criteria, we used an improved rank score method to comprehensively assess the performance of GCMs in simulating precipitation for TP.
M and SD reflects the homogeneity of the GCMs simulations. The monthly and seasonal M and SD were calculated as follows.
  M = 1 n i = 1 n P i
S D   = i = 1 n ( P i P ¯ ) n 1
where Pi represents the monthly or seasonal precipitation for the GCMs and the observed value at time i, P ¯ represents the mean precipitation, and n represents the number of time series.
The correlation coefficient (r) was used to measure the correlation of temporal and spatial distributions between the GCMs and observations. Monthly and seasonal correlation coefficients were calculated in order to perform the time series correlation analysis. For the spatial correlation coefficient, the r was calculated based on the mean value of monthly and seasonal data in each grid (89 cells in total). The calculation is performed according to the following formula.
r _ t   = i = 1 n ( P o i P o ¯ ) ( P m i P m ¯ ) i = 1 n ( P o i P o ¯ ) 2 × i = 1 n ( P m i P m ¯ ) 2
where Poi and Pmi represent the precipitation of observation and GCMs at time i, respectively; P o ¯ and P m ¯ represent the corresponding mean precipitation of observation and GCMs, respectively; and n represents the length of the time series.
r _ s   = g = 1 n ( P o g P o ¯ ) ( P m g P m ¯ ) g = 1 n ( P o g P o ¯ ) 2 × g = 1 n ( P m g P m ¯ ) 2
where Pog and Pmg represent the precipitation of observation and GCMs at cell g, respectively; P o ¯ and P m ¯ represent the corresponding mean precipitation of observation and GCMs, respectively; and n represents the number of cells in the grid.
The long-term trend of precipitation was identified using the Z statistic and the Slope of the Mann–Kendall test based on annual time series, so that the ability of the various GCMs in representing the actual precipitation trend could be compared. The Z and Slope statistics are defined as follows [49,50,51].
Z   = { S 1 var ( S ) , S > 0 0 ,   S = 0 S 1 var ( S ) , S > 0
S = i = 1 n 1 k = i + 1 n sgn ( x k x i )
sgn ( θ ) = { 1 , θ > 0 0 ,   θ = 0 1 , θ > 0
var [ S ]   = [ n ( n 1 ) ( 2 n + 5 ) t t ( t 1 ) ( 2 t + 5 ) ] / 18
where xk and xi represent sequential precipitation values, t represents the extent of any given time, and n is the length of the time series.
S l o p e   =   median ( x i x j i j )
where 1 < j < i < n and the slope is considered as the median of the entire dataset.
The BS and Sscore of PDF statistics were used to evaluate the effect of the GCMs simulations on the probability density distribution of monthly precipitation [52,53].
B S   =   i = 1 n ( P m i P o i ) 2 n
  S s c o r e =   i = 1 n Minimum ( P m i , P o i )
where Pmi and Poi are the probabilities related to GCMs and observed precipitation, respectively, at the i-th bin, and n is the number of bins. BS is the mean square error of the measurement in probability prediction. The Sscore describes the degree of overlap between the observed and simulated probability distributions.
The improved rank score method distinguishes relative error indices from the nonrelative error indices, which could provide consistent results in multiple criteria assessment [29,30]. In this study, M, SD, Z, Slope, and BS are relative error indices, while r_t, r_s, and Sscore are nonrelative error indices. The GCM rank score of each criterion can be calculated as follows.
R S e   =   { 1 T e T min T max T min , T   represents   the   relative   error   index T e - T min T max - T min , T   represents   the   non - relative   error   index
For the relative error indices of M, SD, Z, and Slope, Te represents the absolute error of the statistics between the GCM and observation, and a smaller Te indicates a better performance of the GCM. For the relative error indices of BS, Te represents the absolute value of the statistics for a GCM, and a smaller Te indicates a better performance of the GCM. On the other hand, for the nonrelative error indices of r_t, r_s, and Sscore, Te represents the absolute value of the statistics, and a larger Te indicates a better performance of the GCM. Tmax and Tmin are the corresponding maximum and minimum values of all GCMs, respectively.
For M, SD, r_t, and r_s, the RS is calculated on both monthly and seasonal data. The weights for each season are set to 0.25, whereas the weight assigned to the whole year is 1. For Z, Slope, BS and Sscore, the overall GCM rank score of each criterion is RSe. For M, SD, r_t, and r_s, the overall GCM rank score of each criterion can be calculated as follows.
R S e o   =   R S s p r × 0.25 + R S s u m × 0.25 + R S a u t × 0.25 + R S w i n × 0.25 + R S a × 1 2
where RSspr represents the rank score in spring, RSsum represents the rank score in summer, RSaut represents the rank score in autumn, RSwin represents the rank score in winter, and RSa represents the rank score based on the data of the whole year.
According to the calculated RS values for each criterion, the overall RS value of all criteria for precipitation can be obtained using the following formula.
R S p   = e = 1 n R S p × W e W s
where RSe represents the rank score of the e-th criterion, We represents the corresponding weight, Ws represents the overall weight, and n represents the number of criteria (eight in this study). For the two criteria describing the same characteristic, the weights are set to 0.5, while the weights of the single criterion describing characteristics are set to 1. Therefore, the weights of M, SD, Z, Slope, BS, and Sscore are set to 0.5, and the weights of the temporal and spatial r are set to 1.

2.3.2. Projection of Future Precipitation Change

According to the assessment of the performance of the GCMs, the multimodel ensemble (MME), based on the arithmetic mean method, is utilized to forecast future precipitation under RCP4.5 and RCP8.5 scenarios. In addition, the sub-multimodel ensemble, which selects the GCMs that perform better in the study region, is also used in this study. The formula is as follows.
M M E   = 1 n k = 1 n P k
where Pk is the future precipitation outputs of the GCMs, and n represents the number of selected GCMs.
The Delta method is then applied to project future precipitation changes based on the historical MME data from 1961 to 2005 (45 years) and future outputs with the same duration: 2006–2050 and 2051–2095. The changes can be calculated as follows.
P c   = P f P h
where Pf and Ph are the mean precipitation of the future and historical MME outputs.

3. Results

3.1. Annual Cycle of Precipitation

The mean monthly precipitation across an annual cycle (observed data and GCMs outputs) from 1961–2005 is shown in Figure 2. It is apparent that most GCMs can reasonably simulate the annual cycle of precipitation, but they generally overestimate the amount of precipitation over TP. All GCMs exhibit the same single-peak precipitation pattern as in the observations, which show that precipitation is concentrated in June–July–August–September (JJAS). For TP, the mean monthly precipitation during 1961 to 2005 over the TP is 32.1 mm (ranging from 2.9 mm to 87.6 mm), while that of the GCMs varies from 10.5 mm to 212.3 mm, with an average of 80.3 mm. The GCMs overestimate the precipitation, on average, by 48.2 mm, especially in spring (March–April–May (MAM)) and summer (June–July–August (JJA)), for which the average mean monthly errors are 57.1 mm and 66.0 mm, respectively, whereas the errors are 45.4 mm and 24.2 mm in autumn (September–October–November (SON)) and winter (December–January–February (DJF)), respectively.

3.2. Comparison of GCMs Based on Statistical Criteria

Table 2 presents the statistics, for the observations and the GCMs, of the eight assessment criteria: M, SD, r_t, r_s, Z, Slope, Sscore, and BS. For the mean monthly precipitation, a smaller absolute error indicates a better performance of the GCMs. The EC-EARTH, IPSL-CM5A-LR, and MRI-CGCM3 demonstrate a better ability in simulating the mean precipitation for TP, and exhibit relatively small absolute errors of 24.0 mm, 24.0 mm, and 24.1 mm, respectively, while the CESM1(WACCM), FIO-ESM, and BNU-ESM perform poorly.
The SD of the observations is 30.3 mm, while that of the GCMs ranges from 25.2 mm to 66.7 mm, with a mean value of 47.3 mm. GISS-E2-R, IPSL-CM5A-MR, and IPSL-CM5B-LR show good performance in simulating the SD, whereas CESM1(CAM5), CESM1(WACCM), and NorESM1-M do not simulate SD well.
The value of r_t is above 0.90 for all GCMs, with a maximum of 0.99, which indicates that the GCMs provide superior simulations of the characteristics of the time series of annual precipitation; among them, the CNRM-CM5 and BNU-ESM models perform best. On the contrary, r_s performs inconsistently across all GCMs, as it varies from 0.38 to 0.88. The spatial correlation coefficient of 10 GCMs (approximately 30.3% of the total number of GCMs) is higher than 0.8, indicating that these 10 GCMs (e.g., the GFDL-CM3, INMCM4.0, and CanESM2 models) provide a better description of the characteristics of spatial distribution than the remaining GCMs. Figure 3 presents the correlation coefficient of the GCMs in each season. Generally, the GCMs can effectively simulate the time characteristics in spring and autumn with a mean r_t value of 0.99 and 0.99, while the r_t values in summer and winter are 0.80 and 0.80, respectively. The GCMs do not perform as well in reproducing the spatial distribution as they do in reproducing the temporal distribution, especially in winter.
The annual observed precipitation shows a significant (p < 0.05) increasing trend (0.41 mm/year) from 1961 to 2005 in TP. In total, 25 GCMs exhibit an increasing trend, which is significant in 10 of them. This indicates that most GCMs could capture the same trend as that in the observations. The FGOALS-g2, INMCM4.0, and GFDL-ESM2G exhibit Z values closest to the observations. The slope values in IPSL-CM5A-LR, CMCC-CMS, and IPSL-CM5A-MR are those that agree the most with the observations. The GISS-E2-H, GFDL-CM3, GISS-E2-R, and BNU-ESM perform relatively poor in reproducing the annual precipitation variation trend.
The Sscore of the GCMs ranges from 0.48 to 0.63, with a mean value of 0.57. This indicates, in general, a relatively limited performance, in spite of the Sscore of nine GCMs being higher than 0.6, which means a better representation of the probability density distribution compared with the observations. The BS of the GCMs varies from 0.039 to 0.051, with a mean value of 0.045. In general, a larger Sscore usually implies a smaller BS. The CSIRO-Mk3.6.0, EC-EARTH, and HadGEM2-AO show a good ability in simulating the characteristics of the probability density distribution, while the FIO-ESM, BNU-ESM, and BCC-CSM1.1 are not able to simulate them well.

3.3. Comprehensive Assessment by Rank Score

Figure 4 illustrates the rank score of the eight chosen criteria and the overall results. Different criteria produce different rank scores for the same GCM. For instance, EC-EARTH scores relatively high in the eight criteria and in the overall result, while GISS-E2-R has higher scores for M, SD, and r_t, but lower ones for r_s, Z, Sscore, and BS. Similarly, CESM1(CAM5) shows a superior ability in simulating the annual variation trend and probability density distribution, whereas it is not able to capture the characteristics of the M and SD well, but exhibits an average ability in describing the temporal and spatial distribution characteristics. This demonstrates that the ability of individual GCMs in simulating certain aspects is insufficient, thus a comprehensive assessment using multiple criteria is of great significance.
In the overall assessments (Figure 4), the rank score ranges from 0.38 to 0.89, and 22 GCMs (approximately 66.7%) score above 0.6. The five best GCMs, which exhibit better performance in terms of precipitation simulation over TP are CSIRO-Mk3.6.0 (0.888), EC-EARTH (0.886), MRI-CGCM3 (0.849), CNRM-CM5 (0.788), and CanESM2 (0.786).

3.4. Sensitivity Analysis of GCMs Scores

The sensitivity of the rank scores of the GCMs was investigated by comparing the overall score with the results after removing each statistic individually. The results (Figure 5) indicate that the rank score is insensitive to the addition or removal of a single criterion. This suggests that the improved rank score method with multiple criteria can provide a robust assessment of GCMs performance. In addition, CSIRO-Mk3.6.0, EC-EARTH, MRI-CGCM3, CNRM-CM5, and CanESM2 always provided better performance, which was unaffected by the addition or removal of a specific criterion.

3.5. Future Precipitation Projection

The multiple ensemble method is deemed capable to mitigate the uncertainty of GCMs in regional climate projection [54,55,56]. Table 3 shows the statistics relative to the assessment criteria of MME and SMME. The GCMs that ranked within the top 20% (the SMME in this study), including CSIRO-Mk3.6.0, EC-EARTH, MRI-CGCM3, CNRM-CM5, CanESM2, HadGEM2-AO, and GFDL-ESM2G, were selected for future precipitation projection for TP. Undoubtedly, the MME and SMME can both capture the precipitation trend over an annual cycle (Figure 2), whereas the SMME performs better in simulating the precipitation (Table 3). The future precipitation change was assessed under RCP4.5 and RCP8.5 scenarios using the Delta method in the near-term (2006–2050) and far future (2051–2095) periods.
Table 4 shows the change of future precipitation during 2006 to 2050 and 2051 to 2095 compared with the period 1961–2005 under both RCP4.5 and RCP8.5 scenarios. The magnitude of annual precipitation increase in the far future is much larger than in the near-term. This is particularly true for the period of 2051 to 2095 under the RCP8.5 scenario, which exhibits a value of 116.7%, representing a 16.7% increase of precipitation compared to that in the period 1961–2005. The future annual precipitation is projected to increase by ~6% in the near-term relative to 1961–2005, while increases of 12.3% and 16.7% in the far future under RCP4.5 and RCP8.5 scenarios, respectively, are expected. Moreover, a slightly larger increase in precipitation is expected to occur in spring (MAM) with respect to the other seasons. Figure 6 shows the evident increasing trend of annual precipitation, and highlights that the increasing trend under the RCP8.5 scenario is the most apparent. The difference between the two RCP scenarios is small in the near-term, but becomes more substantial with time, indicating that the projected change in precipitation is more sensitive to the emission scenarios in the far future than in the near-term (Figure 6).
Figure 7 presents the spatial distribution of mean annual future precipitation changes during 2006–2050 and 2051–2095 relative to the period 1961–2005 under RCP4.5 and RCP8.5 scenarios for TP. Similar spatial distributions can be seen in the near-term (2006–2050) and far future (2051–2095) under the two scenarios. This suggests that the most predominant increase in precipitation is expected to occur in the northern part of the study area, whereas the expected change near the eastern edge is not so drastic. Additionally, most of the grid cells show an increasing trend from the near-term to the far future, which is larger in magnitude under the RCP8.5 scenario than under the RCP4.5 scenario.

4. Discussion

In this paper, it has been shown that most GCMs can reproduce the seasonal pattern of precipitation for TP reasonably. However, all GCMs overestimate the amount of precipitation compared with the observations. Similar results have also been shown by Xu et al. and Su et al. [22,57], notwithstanding the different approaches followed by the authors for assessing the performance of the CMIP5 GCMs. In addition, the wet bias was also identified in the CMIP3 GCMs, suggesting that the CMIP5 has unsolved limitations deriving from the CMIP3 [2,17]. Moreover, these limitations appear to be more obvious in the steep mountain regions [58]. In various studies, a correction of the observed values for orographic effects was attempted, because the interpolation of station data (point data) of precipitation to assign values to the grid cells is considered to be biased by the complex topography [59,60]. Nonetheless, most GCMs still overestimate precipitation [22]. In further studies, an algorithm to modify GCMs simulations of precipitation over steep mountains was also explored [61]. Additionally, the horizontal resolution of the models is an important factor for simulated precipitation, especially for the orographic precipitation. In this study, we have found that the GCMs with higher horizontal resolution seem to perform better than the model with lower resolution. In fact, many factors control the precipitation in mountain regions. Therefore, it is always essential to better understand physical parameterization schemes and dynamical process for improving the models in simulating precipitation.
We assessed and ranked the performance of CMIP5 GCMs in simulating precipitation using the improved score-based method. Similar results can also be found in studies of Su et al. [22], which suggest that CSIRO-Mk3.6.0, MRI-CGCM3, and CanESM2 have a better performance compared to the other GCMs. However, the fact that these three models perform relatively better for TP does not means that they will perform as well in other regions. Previous studies also showed that the performance of GCMs depends on the region they are applied to [29,32]. Therefore, the performance of GCMs should be assessed at the regional scale to obtain more reliable information.
Many studies have indicated that GCMs generally do not perform as well in simulating precipitation as they do in simulating temperature at a regional scale, especially for TP [2,22,30,32,62]. Extracting the precipitation outputs of the GCMs directly may not provide an accuracy which is sufficient for actual applications. Multiple model ensemble and downscaling methods could mitigate the uncertainty of GCMs for regional climate projection. Different MME methods have been used in GCMs studies, mainly including the arithmetic mean method, the Bayesian model averaging, and the reliability ensemble averaging, all of which indicate that the MME performs better than any individual GCM in simulating climate factors [33,63]. In this study, we adopted the arithmetic mean method to obtain an MME from the GCMs that exhibited the best performance. Additionally, we chose the Delta method for projecting future precipitation change. For reducing the uncertainty on future precipitation projection systematically, multiple methods should be considered and compared in further studies.

5. Conclusions

This study focused on assessing the performance of 33 CMIP5 GCMs in simulating precipitation and projecting future precipitation changes for TP. The performance was evaluated using an improved score-based method, which adopted multiple criteria to achieve a comprehensive assessment. The future precipitation change was obtained using the Delta method and the submultiple model ensemble in the near-term (2006–2050) and in the far future (2051–2095) under RCP4.5 and RCP8.5 scenarios. The main conclusions are summarized as follows.
(1) Most GCMs can reasonably simulate the annual cycle of precipitation. They successfully reproduce a single-peak pattern of precipitation, in which most of the precipitation is concentrated in JJAS. However, all the GCMs overestimate the monthly precipitation for TP, on average by 48.2 mm, especially in spring and summer.
(2) The GCMs provide superior simulations of the temporal pattern of precipitation, with a correlation coefficient above 0.9 for the annual precipitation, while do not perform so well in reproducing the spatial distribution characteristics. Most GCMs are able to capture the same annual variation trend as in the observation, but have relatively limited performance in simulating the probability density distribution of precipitation.
(3) Different assessment criteria yield different rank scores for the same GCM, and, therefore, a comprehensive evaluation using multiple criteria is of great significance. The improved rank score method with multiple criteria achieved a robust assessment of GCMs performance.
(4) The results of the comprehensive assessment indicated that CSIRO-Mk3.6.0, EC-EARTH, MRI-CGCM3, CNRM-CM5, and CanESM2 have better performance in simulating precipitation for TP compared to the other GCMs that we have assessed.
(5) The future annual precipitation was projected to increase by about 6% in the near-term with respect to the period 1961 to 2005, while it increases by 12.3% and 16.7% in the far future under RCP4.5 and RCP8.5 scenarios, respectively. The future precipitation showed an increasing trend, which is much more evident under the RCP8.5 scenario than under the RCP4.5 scenario.
(6) Similar spatial distributions of precipitation changes can be seen in the near-term (2006–2050) and far future (2051–2095) under the two scenarios. These distributions suggest that precipitation might increase in the north of TP more than in other parts of TP, and that the precipitation change in the eastern margin of TP is not so predominant.
Assessing the performance of GCMs effectively and simulating future precipitation are important for understanding ongoing climate change and its impact on hydrology and water resources, agriculture, and ecology. The results of this study can provide valuable input for further studies focusing on TP. Moreover, in further studies, multiple methods for ensembling GCMs and for producing future precipitation projections should be considered and compared for mitigating the uncertainty of GCMs outputs at the regional scale.

Author Contributions

K.J. wrote the manuscript text and contributed to the graphics; Y.R., Y.Y., and C.Z. contributed to the revision of the methods, results, analysis, and discussion of the manuscript.

Funding

This research was funded by the “Second Tibetan Plateau Scientific Expedition and Research” (STEP) program (2019QZKK1006) and the Strategic Priority Research Program of the Chinese Academy of Sciences (XDA20010201).

Acknowledgments

The authors would like to thank the World Climate Research Programme’s Working Group on Coupled Modeling and the institutions listed in Table 1 for access to the related GCMs data. The authors also appreciate the China Meteorological Information Center for providing the observed precipitation data.

Data Availability

The observed data used to support the findings of this study are from the China Meteorological Data Sharing Service System. The GCMs outputs and related dataset used to support the findings of this study are available on the CMIP5 website.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Qiu, J. The third pole. Nature 2008, 454, 393–396. [Google Scholar] [CrossRef] [PubMed]
  2. Xu, J.; Gao, Y.; Chen, D.; Xiao, L.; Ou, T. Evaluation of global climate models for downscaling applications centred over the Tibetan Plateau. Int. J. Climatol. 2017, 37, 657–671. [Google Scholar] [CrossRef]
  3. Immerzeel, W.W.; van Beek, L.P.H.; Bierkens, M.F.P. Climate Change Will Affect the Asian Water Towers. Science 2010, 328, 1382–1385. [Google Scholar] [CrossRef] [PubMed]
  4. Liu, X.D.; Chen, B.D. Climatic warming in the Tibetan Plateau during recent decades. Int. J. Climatol. 2000, 20, 1729–1742. [Google Scholar] [CrossRef]
  5. Wang, B.; Bao, Q.; Hoskins, B.; Wu, G.; Liu, Y. Tibetan plateau warming and precipitation changes in East Asia. Geophys. Res. Lett. 2008, 35, L1470214. [Google Scholar] [CrossRef]
  6. Rangwala, I.; Sinsky, E.; Miller, J.R. Amplified warming projections for high altitude regions of the northern hemisphere mid-latitudes from CMIP5 models. Environ. Res. Lett. 2013, 8, 0240402. [Google Scholar] [CrossRef]
  7. Busuioc, A.; Chen, D.L.; Hellstrom, C. Performance of statistical downscaling models in GCM validation and regional climate change estimates: Application for Swedish precipitation. Int. J. Climatol. 2001, 21, 557–578. [Google Scholar] [CrossRef]
  8. Choudhary, A.; Dimri, A.P. Assessment of CORDEX-South Asia experiments for monsoonal precipitation over Himalayan region for future climate. Clim. Dynam. 2018, 50, 3009–3030. [Google Scholar] [CrossRef]
  9. Eekhout, J.P.C.; Hunink, J.E.; Terink, W.; de Vente, J. Why increased extreme precipitation under climate change negatively affects water security. Hydrol. Earth Syst. Sci. 2018, 22, 5935–5946. [Google Scholar] [CrossRef] [Green Version]
  10. Karl, T.R.; Knight, R.W.; Plummer, N. Trends in High-Frequency Climate Variability in the 20th-Century. Nature 1995, 377, 217–220. [Google Scholar] [CrossRef]
  11. Held, I.M.; Soden, B.J. Robust responses of the hydrological cycle to global warming. J. Clim. 2006, 19, 5686–5699. [Google Scholar] [CrossRef]
  12. Min, S.; Zhang, X.; Zwiers, F.W.; Hegerl, G.C. Human contribution to more-intense precipitation extremes. Nature 2011, 470, 378–381. [Google Scholar] [CrossRef] [PubMed]
  13. Berg, N.; Hall, A. Increased Interannual Precipitation Extremes over California under Climate Change. J. Clim. 2015, 28, 6324–6334. [Google Scholar] [CrossRef]
  14. Ramesh, K.V.; Goswami, P. Assessing reliability of regional climate projections: The case of Indian monsoon. Sci. Rep. 2014, 4, 4071. [Google Scholar] [CrossRef] [PubMed]
  15. Taylor, K.E.; Stouffer, R.J.; Meehl, G.A. An Overview of CMIP5 and the Experiment Design. Bull. Am. Meteorol. Soc. 2012, 93, 485–498. [Google Scholar] [CrossRef] [Green Version]
  16. Sperber, K.R.; Annamalai, H.; Kang, I.S.; Kitoh, A.; Moise, A.; Turner, A.; Wang, B.; Zhou, T. The Asian summer monsoon: An intercomparison of CMIP5 vs. CMIP3 simulations of the late 20th century. Clim. Dynam. 2013, 41, 2711–2744. [Google Scholar] [CrossRef]
  17. Chen, L.; Frauenfeld, O.W. A comprehensive evaluation of precipitation simulations over China based on CMIP5 multimodel ensemble projections. J. Geophys. Res. Atmos. 2014, 119, 5767–5786. [Google Scholar] [CrossRef]
  18. Sun, Q.; Miao, C.; Duan, Q. Comparative analysis of CMIP3 and CMIP5 global climate models for simulating the daily mean, maximum, and minimum temperatures and daily precipitation over China. J. Geophys. Res. Atmos. 2015, 120, 4806–4824. [Google Scholar] [CrossRef]
  19. Meher, J.K.; Das, L.; Akhter, J.; Benestad, R.E.; Mezghani, A. Performance of CMIP3 and CMIP5 GCMs to Simulate Observed Rainfall Characteristics over the Western Himalayan Region. J. Clim. 2017, 30, 7777–7799. [Google Scholar] [CrossRef]
  20. Wei, K.; Xu, T.; Du, Z.; Gong, H.; Xie, B. How well do the current state-of-the-art CMIP5 models characterise the climatology of the East Asian winter monsoon? Clim. Dynam. 2014, 43, 1241–1255. [Google Scholar] [CrossRef]
  21. Hasson, S.; Pascale, S.; Lucarini, V.; Boehner, J. Seasonal cycle of precipitation over major river basins in South and Southeast Asia: A review of the CMIP5 climate models data for present climate and future climate projections. Atmos. Res. 2016, 180, 42–63. [Google Scholar] [CrossRef] [Green Version]
  22. Su, F.; Duan, X.; Chen, D.; Hao, Z.; Cuo, L. Evaluation of the Global Climate Models in the CMIP5 over the Tibetan Plateau. J. Clim. 2013, 26, 3187–3208. [Google Scholar] [CrossRef] [Green Version]
  23. Su, F.; Zhang, L.; Ou, T.; Chen, D.; Yao, T.; Tong, K.; Qi, Y. Hydrological response to future climate changes for the major upstream river basins in the Tibetan Plateau. Glob. Planet. Chang. 2016, 136, 82–95. [Google Scholar] [CrossRef]
  24. Kumar, S.; Merwade, V.; Kinter, J.L.I.; Niyogi, D. Evaluation of Temperature and Precipitation Trends and Long-Term Persistence in CMIP5 Twentieth-Century Climate Simulations. J. Clim. 2013, 26, 4168–4185. [Google Scholar] [CrossRef]
  25. Zhou, B.; Wen, Q.H.; Xu, Y.; Song, L.; Zhang, X. Projected Changes in Temperature and Precipitation Extremes in China by the CMIP5 Multimodel Ensembles. J. Clim. 2014, 27, 6591–6611. [Google Scholar] [CrossRef]
  26. Yoo, C.; Cho, E. Comparison of GCM Precipitation Predictions with Their RMSEs and Pattern Correlation Coefficients. Water 2018, 10, 28. [Google Scholar] [Green Version]
  27. Hussain, M.; Yusof, K.W.; Mustafa, M.R.; Mahmood, R.; Jia, S. Evaluation of CMIP5 models for projection of future precipitation change in Bornean tropical rainforests. Theor. Appl. Climatol. 2018, 134, 423–440. [Google Scholar] [CrossRef]
  28. Kadel, I.; Yamazaki, T.; Iwasaki, T.; Abdillah, M.R. Projection of future monsoon precipitation over the central Himalayas by CMIP5 models under warming scenarios. Clim. Res. 2018, 75, 1–21. [Google Scholar] [CrossRef] [Green Version]
  29. Ruan, Y.; Yao, Z.; Wang, R.; Liu, Z. Ranking of CMIP5 GCM Skills in Simulating Observed Precipitation over the Lower Mekong Basin, Using an Improved Score-Based Method. Water 2018, 10, 1868. [Google Scholar] [CrossRef]
  30. Fu, G.; Liu, Z.; Charles, S.P.; Xu, Z.; Yao, Z. A score-based method for assessing the performance of GCMs: A case study of southeastern Australia. J. Geophys. Res. Atmos. 2013, 118, 4154–4167. [Google Scholar] [CrossRef]
  31. Das, L.; Dutta, M.; Mezghani, A.; Benestad, R.E. Use of observed temperature statistics in ranking CMIP5 model performance over the Western Himalayan Region of India. Int. J. Climatol. 2018, 38, 554–570. [Google Scholar] [CrossRef]
  32. Li, J.; Liu, Z.; Yao, Z.; Wang, R. Comprehensive assessment of Coupled Model Intercomparison Project Phase 5 global climate models using observed temperature and precipitation over mainland Southeast Asia. Int. J. Climatol. 2019, 39, 1–15. [Google Scholar] [CrossRef]
  33. Miao, C.; Duan, Q.; Sun, Q.; Huang, Y.; Kong, D.; Yang, T.; Ye, A.; Di, Z.; Gong, W. Assessment of CMIP5 climate models and projected temperature changes over Northern Eurasia. Environ. Res. Lett. 2014, 9, 0550075. [Google Scholar] [CrossRef]
  34. Clorinda, P.O.; Antonio, R.J. Regional aspects of future precipitation and meteorological drought characteristics over Southern South America projected by a CMIP5 multi-model ensemble. Int. J. Climatol. 2016, 36, 974–986. [Google Scholar]
  35. Risbey, J.S.; Stone, P.H. A case study of the adequacy of GCM simulations for input to regional climate change assessments. J. Clim. 1996, 9, 1441–1467. [Google Scholar] [CrossRef]
  36. Xu, Y.; Xu, C.; Gao, X.; Luo, Y. Projected changes in temperature and precipitation extremes over the Yangtze River Basin of China in the 21st century. Quat. Int. 2009, 208, 44–52. [Google Scholar] [CrossRef]
  37. Su, B.; Huang, J.; Gemmer, M.; Jian, D.; Tao, H.; Jiang, T.; Zhao, C. Statistical downscaling of CMIP5 multi-model ensemble for projected changes of climate in the Indus River Basin. Atmos. Res. 2016, 178, 138–149. [Google Scholar] [CrossRef]
  38. Luo, M.; Liu, T.; Frankl, A.; Duan, Y.; Meng, F.; Bao, A.; Kurban, A.; De Maeyer, P. Defining spatiotemporal characteristics of climate change trends from downscaled GCMs ensembles: How climate change reacts in Xinjiang, China. Int. J. Climatol. 2018, 38, 2538–2553. [Google Scholar] [CrossRef]
  39. Chu, J.T.; Xia, J.; Xu, C.Y.; Singh, V.P. Statistical downscaling of daily mean temperature, pan evaporation and precipitation for climate change scenarios in Haihe River, China. Theor. Appl. Climatol. 2010, 99, 149–161. [Google Scholar] [CrossRef]
  40. Choi, W.; Rasmussen, P.F.; Moore, A.R.; Kim, S.J. Simulating streamflow response to climate scenarios in central Canada using a simple statistical downscaling method. Clim. Res. 2009, 40, 89–102. [Google Scholar] [CrossRef] [Green Version]
  41. Liu, L.; Liu, Z.; Ren, X.; Fischer, T.; Xu, Y. Hydrological impacts of climate change in the Yellow River Basin for the 21st century using hydrological model and statistical downscaling model. Quat. Int. 2011, 244, 211–220. [Google Scholar] [CrossRef]
  42. Rahimi, J.; Ebrahimpour, M.; Khalili, A. Spatial changes of Extended De Martonne climatic zones affected by climate change in Iran. Theor. Appl. Climatol. 2013, 112, 409–418. [Google Scholar] [CrossRef]
  43. Jiang, D.B.; Wang, H.J.; Lang, X.M. Evaluation of East Asian climatology as simulated by seven coupled models. Adv. Atmos. Sci. 2005, 22, 479–495. [Google Scholar]
  44. Ding, Y.; Ren, G.; Zhao, Z.; Xu, Y.; Luo, Y.; Li, Q.; Zhang, J. Detection, causes and projection of climate change over China: An overview of recent progress. Adv. Atmos. Sci. 2007, 24, 954–971. [Google Scholar] [CrossRef]
  45. Wang, L.; Chen, W. A CMIP5 multimodel projection of future temperature, precipitation, and climatological drought in China. Int. J. Climatol. 2014, 34, 2059–2078. [Google Scholar] [CrossRef]
  46. Bookhagen, B.; Burbank, D.W. Toward a complete Himalayan hydrological budget: Spatiotemporal distribution of snowmelt and rainfall and their impact on river discharge. J. Geophys. Res. Earth 2010, 115, F03019. [Google Scholar] [CrossRef]
  47. Hutchinson, M.F. Interpolation of rainfall data with Thin Plate Smoothing Splines-Part II: Analysis of topographic dependence. J. Geogr. Inf. Decis. Anal. 1998, 2, 152–167. [Google Scholar]
  48. Ruan, Y.; Liu, Z.; Wang, R.; Yao, Z. Assessing the Performance of CMIP5 GCMs for Projection of Future Temperature Change over the Lower Mekong Basin. Atmosphere 2019, 10, 93. [Google Scholar] [CrossRef]
  49. Mann, H.B. Nonparametric Tests against Trend. Econometrica 1945, 13, 245–259. [Google Scholar] [CrossRef]
  50. Sen, P.K. Estimates of Regression Coefficient Based on Kendall’s tau. J. Am. Stat. Assoc. 1968, 63, 1379–1389. [Google Scholar] [CrossRef]
  51. Hamed, K.H. Trend detection in hydrologic data: The Mann-Kendall trend test under the scaling hypothesis. J. Hydrol. 2008, 349, 350–363. [Google Scholar] [CrossRef]
  52. Brier, G.W. Verification of forecasts expressed in terms of probability. Mon. Weather Rev. 1950, 78, 1–3. [Google Scholar] [CrossRef]
  53. Perkins, S.E.; Pitman, A.J.; Holbrook, N.J.; Mcaneney, J. Evaluation of the AR4 climate models’ simulated daily maximum temperature, minimum temperature, and precipitation over Australia using probability density functions. J. Clim. 2007, 20, 4356–4376. [Google Scholar] [CrossRef]
  54. Tebaldi, C.; Sanso, B. Joint projections of temperature and precipitation change from multiple climate models: A hierarchical Bayesian approach. J. R. Stat. Soc. A Stat. 2009, 172, 83–106. [Google Scholar] [CrossRef]
  55. Overland, J.E.; Wang, M.; Bond, N.A.; Walsh, J.E.; Kattsov, V.M.; Chapman, W.L. Considerations in the Selection of Global Climate Models for Regional Climate Projections: The Arctic as a Case Study. J. Clim. 2011, 24, 1583–1597. [Google Scholar] [CrossRef]
  56. Mcsweeney, C.F.; Jones, R.G.; Lee, R.W.; Rowell, D.P. Selecting CMIP5 GCMs for downscaling over multiple regions. Clim. Dynam. 2015, 44, 3237–3260. [Google Scholar] [CrossRef]
  57. Xu, Y.; Xu, C. Preliminary Assessment of Simulations of Climate Changes over China by CMIP5 Multi-Models. Atmos. Ocean. Sci. Lett. 2012, 5, 489–494. [Google Scholar]
  58. Mehran, A.; Aghakouchak, A.; Phillips, T.J. Evaluation of CMIP5 continental precipitation simulations relative to satellite-based gauge-adjusted observations. J. Geophys. Res. Atmos. 2014, 119, 1695–1707. [Google Scholar] [CrossRef] [Green Version]
  59. Ye, B.S.; Yang, D.Q.; Ding, Y.J.; Han, T.D.; Koike, T. A bias-corrected precipitation climatology for China. J. Hydrometeorol. 2004, 5, 1147–1160. [Google Scholar] [CrossRef]
  60. Adam, J.C.; Clark, E.A.; Lettenmaier, D.P.; Wood, E.F. Correction of global precipitation products for orographic effects. J. Clim. 2006, 19, 15–38. [Google Scholar] [CrossRef]
  61. Yu, R.; Li, J.; Zhang, Y.; Chen, H. Improvement of rainfall simulation on the steep edge of the Tibetan Plateau by using a finite-difference transport scheme in CAM5. Clim. Dynam. 2015, 45, 2937–2948. [Google Scholar] [CrossRef]
  62. Sabeerali, C.T.; Rao, S.A.; Dhakate, A.R.; Salunke, K.; Goswami, B.N. Why ensemble mean projection of south Asian monsoon rainfall by CMIP5 models is not reliable? Clim. Dynam. 2015, 45, 161–174. [Google Scholar] [CrossRef]
  63. Ahmadalipour, A.; Moradkhani, H.; Rana, A. Accounting for downscaling and model uncertainty in fine-resolution seasonal climate projections over the Columbia River Basin. Clim. Dynam. 2018, 50, 717–733. [Google Scholar] [CrossRef]
Figure 1. Study area.
Figure 1. Study area.
Water 11 01771 g001
Figure 2. Patterns of precipitation during an annual cycle from 1961 to 2005 for the Tibetan Plateau (TP): observations and global climate models (GCMs).
Figure 2. Patterns of precipitation during an annual cycle from 1961 to 2005 for the Tibetan Plateau (TP): observations and global climate models (GCMs).
Water 11 01771 g002
Figure 3. Time series and spatial correlation coefficient between the observations and the GCMs during the period 1961–2005 in TP. (ad) Spring, summer, autumn, and winter, respectively.
Figure 3. Time series and spatial correlation coefficient between the observations and the GCMs during the period 1961–2005 in TP. (ad) Spring, summer, autumn, and winter, respectively.
Water 11 01771 g003
Figure 4. Rank scores of the GCMs. Columns 1–8 refer, in order, to criteria M, SD, r_t, r_s, Z, Slope, Sscore, and BS; column 9 represents the overall rank score.
Figure 4. Rank scores of the GCMs. Columns 1–8 refer, in order, to criteria M, SD, r_t, r_s, Z, Slope, Sscore, and BS; column 9 represents the overall rank score.
Water 11 01771 g004
Figure 5. Comparison of the overall rank score and that after removing one criterion.
Figure 5. Comparison of the overall rank score and that after removing one criterion.
Water 11 01771 g005
Figure 6. Future precipitation changes based on SMME under RCP4.5 and RCP8.5 scenarios for the period 1961 to 2005 in TP. (a) Actual values and (b) three-year moving average.
Figure 6. Future precipitation changes based on SMME under RCP4.5 and RCP8.5 scenarios for the period 1961 to 2005 in TP. (a) Actual values and (b) three-year moving average.
Water 11 01771 g006
Figure 7. Spatial distribution of mean annual precipitation changes based on SMME during 2006–2050 and 2051–2095 relative to the period 1961-2005 under RCP4.5 and RCP8.5 scenarios in TP.
Figure 7. Spatial distribution of mean annual precipitation changes based on SMME during 2006–2050 and 2051–2095 relative to the period 1961-2005 under RCP4.5 and RCP8.5 scenarios in TP.
Water 11 01771 g007
Table 1. Description of the CMIP5 climate models used in this study.
Table 1. Description of the CMIP5 climate models used in this study.
IDModel NameModeling Centre (or Group)NationResolution
(Lon × Lat)
1ACCESS1.0Commonwealth Scientific and Industrial Research Organization/Bureau of MeteorologyAustralia1.88° × 1.25°
2ACCESS1.3Commonwealth Scientific and Industrial Research Organization/Bureau of MeteorologyAustralia1.88° × 1.25°
3BCC-CSM1.1Beijing Climate Center, China Meteorological AdministrationChina2.81° × 2.79°
4BNU-ESMBeijing Normal UniversityChina2.81° × 2.79°
5CanESM2Canadian Centre for Climate Modeling and AnalysisCanada2.81° × 2.79°
6CCSM4National Center for Atmospheric ResearchUSA1.25° × 0.94°
7CESM1(CAM5)National Center for Atmospheric ResearchUSA1.25° × 0.94°
8CESM1(WACCM)National Center for Atmospheric ResearchUSA2.50° × 1.88°
9CMCC-CMSCentro Euro-Mediterraneo sui Cambiamenti ClimaticiItaly1.88° × 1.88°
10CNRM-CM5Centre National de Recherches Météorologiques Centre Européen de Recherche et Formation Avancée en Calcul ScientifiqueFrance1.41° × 1.40°
11CSIRO-Mk3.6.0Commonwealth Scientific and Industrial Research Organization/Queensland Climate Change Centre
of Excellence
Australia1.88° × 1.88°
12EC-EARTHEC-EARTH consortium published at Irish Centre for High-End ComputingNetherlands
/Ireland
1.13° × 1.13°
13FGOALS-g2Institute of Atmospheric Physics, Chinese Academy of SciencesChina2.81° × 2.81°
14FIO-ESMThe First Institute of Oceanography, SOAChina2.80° × 2.80°
15GFDL-CM3NOAA Geophysical Fluid Dynamics LaboratoryUSA2.50° × 2.00°
16GFDL-ESM2GNOAA Geophysical Fluid Dynamics LaboratoryUSA2.00° × 2.02°
17GFDL-ESM2MNOAA Geophysical Fluid Dynamics LaboratoryUSA2.50◦ × 2.02°
18GISS-E2-HNASA/GISS (Goddard Institute for Space Studies)USA2.50° × 2.00°
19GISS-E2-RNASA/GISS (Goddard Institute for Space Studies)USA2.50° × 2.00°
20HadGEM2-AONational Institute of Meteorological Research, Korea Meteorological AdministrationKorea1.88° × 1.25°
21HadGEM2-CCMet Office Hadley CenterUK1.88° × 1.25°
22HadGEM2-ESMet Office Hadley CenterUK1.88° × 1.25°
23INMCM4.0Russian Academy of Sciences, Institute for Numerical MathematicsRussia2.00° × 1.50°
24IPSL-CM5A-LRInstitute Pierre-Simon LaplaceFrance3.75° × 1.89°
25IPSL-CM5A-MRInstitute Pierre-Simon LaplaceFrance2.50° × 1.27°
26IPSL-CM5B-LRInstitute Pierre-Simon LaplaceFrance3.75° × 1.89°
27MIROC5Atmosphere and Ocean Research Institute (The University of Tokyo), National Institute for Environmental Studies, and Japan Agency for Marine-Earth Science and TechnologyJapan1.41° × 1.40°
28MIROC-ESMThe same as 27Japan2.81° × 2.79°
29MIROC-ESM-CHEMThe same as 27Japan2.81° × 2.79°
30MPI-ESM-LRMax Planck Institute for MeteorologyGermany1.88° × 1.87°
31MPI-ESM-MRMax Planck Institute for MeteorologyGermany1.88° × 1.87°
32MRI-CGCM3Meteorological Research InstituteJapan1.13° × 1.12°
33NorESM1-MBjerknes Centre for Climate Research, Norwegian Climate CenterNorway2.50° × 1.89°
Table 2. Statistics of the assessment criteria for the observations and the GCMs over TP. The symbols “”, “△”, “▼”, and “▽” represent a significant increasing trend, an increasing trend, a significant decreasing trend, and a decreasing trend, respectively, where “significant” means p-value<0.05.
Table 2. Statistics of the assessment criteria for the observations and the GCMs over TP. The symbols “”, “△”, “▼”, and “▽” represent a significant increasing trend, an increasing trend, a significant decreasing trend, and a decreasing trend, respectively, where “significant” means p-value<0.05.
ModelMean
(mm)
SD
(mm)
r_tr_sMann–KendallPDF
ZSlope (mm/y)SscoreBS
Observations32.130.3 1.810.41
Access1.078.152.30.940.72−1.24−0.420.590.044
Access1.391.855.60.920.760.320.100.540.048
BCC-CSM1.189.935.90.950.441.520.910.500.050
BNU-ESM117.845.10.990.383.712.840.490.050
CanESM259.844.80.970.873.511.710.630.041
CCSM484.555.90.950.680.440.160.590.045
CESM1(CAM5)92.964.00.950.691.130.530.630.042
CESM1(WACCM)107.664.10.900.832.221.320.570.045
CMCC-CMS79.646.10.970.750.640.430.550.048
CNRM-CM568.043.60.990.783.241.520.610.041
CSIRO-Mk3.6.060.643.50.970.860.950.510.630.040
EC-EARTH56.040.30.970.801.070.480.630.040
FGOALS-g276.338.50.940.601.830.920.530.048
FIO-ESM111.537.50.950.752.671.730.480.051
GFDL-CM386.550.50.970.88−2.49−1.080.560.048
GFDL-ESM2G76.246.10.980.852.040.990.560.046
GFDL-ESM2M78.546.90.960.861.320.660.560.046
GISS-E2-H75.036.00.950.54−2.63−1.230.520.048
GISS-E2-R72.031.10.950.51−2.30−0.930.510.049
HadGEM2-AO78.256.90.950.730.890.260.630.039
HadGEM2-CC81.857.50.950.650.440.140.620.040
HadGEM2-ES80.155.90.950.65−0.79−0.270.620.041
INMCM4.079.944.50.960.881.990.780.540.047
IPSL-CM5A-LR56.025.20.900.781.030.420.520.048
IPSL-CM5A-MR59.433.20.970.701.380.470.540.048
IPSL-CM5B-LR63.525.60.900.780.280.150.530.048
MIROC578.352.50.960.82−0.17−0.070.590.044
MIROC-ESM92.354.80.960.392.261.160.560.045
MIROC-ESM-CHEM91.954.80.960.442.161.280.570.045
MPI-ESM-LR84.857.10.980.760.000.010.580.044
MPI-ESM-MR84.856.70.980.75−0.95−0.360.590.044
MRI-CGCM356.241.20.980.760.340.270.620.040
NorESM1-M99.366.70.980.810.850.470.570.046
Table 3. Statistics relative to the assessment criteria of a multiple model ensemble for TP.
Table 3. Statistics relative to the assessment criteria of a multiple model ensemble for TP.
ModelMean
(mm)
SD
(mm)
r_tr_sMann–KendallPDF
ZSlope (mm/y)SscoreBS
observation32.130.3 1.810.41
MME80.345.20.970.863.730.700.430.050
SMME65.044.10.980.874.220.460.510.048
Table 4. Changes in precipitation for TP based on submultiple model ensemble (SMME) under RCP4.5 and RCP8.5 scenarios relative to the period of 1961 to 2005.
Table 4. Changes in precipitation for TP based on submultiple model ensemble (SMME) under RCP4.5 and RCP8.5 scenarios relative to the period of 1961 to 2005.
PeriodRCP4.5RCP8.5
AnnualMAMJJASONDJFAnnualMAMJJASONDJF
2006–2050106.4%109.3%105.6%105.8%104.8%105.8%109.2%105.3%104.5%102.2%
2051–2095112.3%117.3%110.3%111.1%113.9%116.7%125.0%114.3%113.4%116.9%

Share and Cite

MDPI and ACS Style

Jia, K.; Ruan, Y.; Yang, Y.; Zhang, C. Assessing the Performance of CMIP5 Global Climate Models for Simulating Future Precipitation Change in the Tibetan Plateau. Water 2019, 11, 1771. https://doi.org/10.3390/w11091771

AMA Style

Jia K, Ruan Y, Yang Y, Zhang C. Assessing the Performance of CMIP5 Global Climate Models for Simulating Future Precipitation Change in the Tibetan Plateau. Water. 2019; 11(9):1771. https://doi.org/10.3390/w11091771

Chicago/Turabian Style

Jia, Kun, Yunfeng Ruan, Yanzhao Yang, and Chao Zhang. 2019. "Assessing the Performance of CMIP5 Global Climate Models for Simulating Future Precipitation Change in the Tibetan Plateau" Water 11, no. 9: 1771. https://doi.org/10.3390/w11091771

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop