Despite the growing awareness in academia and industry of the importance of solar probabilistic forecasting for further enhancing the integration of variable photovoltaic power generation into electrical power grids, there is still no benchmark study comparing a wide range of solar probabilistic methods across various local climates. Having identified this research gap, experts involved in the activities of IEA PVPS T161 agreed to establish a benchmarking exercise to evaluate the quality of intra-hour and intra-day probabilistic irradiance forecasts. The tested forecasting methodologies are based on different input data including ground measurements, satellite-based forecasts and Numerical Weather Predictions (NWP), and different statistical methods are employed to generate probabilistic forecasts from these. The exercise highlights different forecast quality depending on the method used, and more importantly, on the input data fed into the models. In particular, the benchmarking procedure reveals that the association of a point forecast that blends ground, satellite and NWP data with a statistical technique generates high-quality probabilistic forecasts. Therefore, in a subsequent step, an additional investigation was conducted to assess the added value of such a blended point forecast on forecast quality. Three new statistical methods were implemented using the blended point forecast as input. To ensure a fair evaluation of the different methods, we calculate a skill score that measures the performance of the proposed model relative to that of a trivial baseline model. The closer the skill score is to 100%, the more efficient the method is. Overall, skill scores of methods that use the blended point forecast ranges from 42% to 46% for the intra-hour scenario and 27% to 32% for the intra-day scenario. Conversely, methods that do not use the blended point forecast exhibit skill scores ranging from 33% to 43% for intra-hour forecasts and 8% to 16% for intra-day forecasts. These results suggest that using (a) blended point forecasts that optimally combine different sources of input data and (b) a post-processing with a statistical method to produce the quantile forecasts is an effective and consistent way to generate high-quality intra-hour or intra-day probabilistic forecasts.