Skip to main content
Scientific Reports logoLink to Scientific Reports
. 2026 Jun 2;16:25262. doi: 10.1038/s41598-026-53540-1

Inference limits in partially observable Ethereum blockchains

Muhammad Zeshan Arshad 1,✉, Ali Algrani 2,✉
PMCID: PMC13470478  PMID: 42230851

Abstract

While full ledger access is theoretically possible on public blockchains, in reality it is often not possible. Things that can be seen are limited by storage limitations, client design, indexing services, and off-chain execution pathways. This means that entire ledger objects are rarely used for empirical blockchain analysis; instead, observable projections are typically used. In this research, the observability of blockchain is recast as an inferential problem with incomplete observation. Studying identifiability, information loss, and irreducible uncertainty under coarsened access, the framework defines a full ledger, an observable ledger, and an observability mechanism. Three distinct visibility regimes, independent Bernoulli, clustered, and activity-dependent, are assessed in the simulation study. Reduced visibility raises uncertainty inflation, root mean squared error, variance, and mean squared error across all three regimes. The most severe deterioration happens when the condition of the underlying ledger determines visibility. This empirical study employs Google BigQuery’s publicly indexed Ethereum block data spanning blocks 18,000,000 to 18,001,000. Over the chosen Ethereum period, descriptive summaries reveal a large amount of fluctuation in gas utilised, transaction count, and basic charge per gas at the block level. Experiments with controlled missingness on the observed slice reveal that RMSE and trend estimate bias grow with increasing missingness, and that the degree of distortion is significantly affected by whether the incompleteness is MCAR-like, MAR-like, or MNAR-like. This research proves that partial observability isn’t just a secondary data issue; it can significantly affect inference on Ethereum block-level summaries.

Keywords: Missing data, Observability, Blockchain, Simulation, Ethereum

Subject terms: Mathematics and computing, Physics

Introduction

Public blockchains are decentralised databases that record transactions on ledgers that are meant to be visible to everyone and are designed to be additive only. Actually, who may view the whole ledger is dictated by system limits, not just protocol requirements. Storage constraints, client architecture, indexing services, and off-chain execution pathways determine the visible parts of the ledger at any given moment in time. Because of this, empirical blockchain analyses do not employ exact replicas but rather incomplete representations of the on-chain state. Since observed data often serve as a representation of the whole system, this differentiation is vital for auditing, detecting anomalies, evaluating performance, and reviewing policies.

All information may be visible, according to early blockchain models. The ledger was thought to be both globally accessible and locally verifiable according to the fundamental protocols, which meant that all participants had to keep detailed records of all transactions and state changes1,2. Despite having existed before networks reached their present size, this paradigm made formal consideration of security and consistency easier. With the growth of blockchains came higher costs for storage and connectivity. Many nodes stopped keeping full ledgers when participation shifted to include partial replication and lightweight clients. This change and the subsequent restrictions on ledger visibility for nodes and outside observers have been documented in empirical and architectural studies3–5.

The statistical ramifications of less exposure are huge. In controlled trials, the estimator variance increases from about 0.0050 to 0.0064, uncertainty inflation rises to 1.28, and bias is modest when observable coverage is reduced from full visibility (π = 1.0) to 80% (π = 0.8). With 60% visibility (π = 0.6), the uncertainty inflation is 1.66, and the variance is more than 0.0083. Uncertainty inflation reaches 2.5 times full observability and variation more than doubles when visibility drops to 40%. On average, less than 41 components are visible in the lowest visibility regime (π = 0.2). There is an increase in the uncertainty inflation to 5.0, the RMSE to0.14, and the variance to about 0.0253. Neither random noise nor the choice of an estimator can explain these patterns; rather, they result from data loss.

Users of blockchains often have limited visibility. Instead of directly accessing data, lightweight and superlight clients rely on indirect evidence from distant servers or concise proofs to ensure consistency via limited query interfaces that allow them to communicate with the ledger6,7. As time goes on, ledger visibility fragmentation between participants increases due to pruning and state-minimization techniques that let nodes to function while discarding prior data8,9.

This constraint is made clear by layer-2 rollup designs. Only compressed summaries or proofs are included in the base layer, and execution is moved off-chain. While this approach makes scaling easier, it makes direct auditing more complicated. Since observers in these systems rely on imperfect on-chain representations to form conclusions, data availability is crucial for inference10. Even still, a number of empirical investigations persist in treating observed ledger data as almost full, often supposing that missing entries only contribute to noise rather than structural uncertainty.

This setup is in line with missing-data theory, which states that the mechanism controlling the unseen components is what determines inference11. Reconstruction could be badly organised, and more samples or more precise estimators won’t help when observation is limited12. It has been shown in robust statistics and decision theory13–15 that using coarser data raises risk irreducibly and cannot be mitigated by post hoc adjustment.

A common starting point for works on blockchain auditability is the idea that, since ledger data is publicly available, it should be possible to conduct direct empirical research with it. Storage constraints, client design, indexing services, and off-chain execution pathways all restrict what can be monitored, weakening this premise in practice. As a result of treating partial views as though they were virtually complete or as if missingness just added noise, statistical treatments of blockchain data fail to adequately address the gap between the hypothetical whole ledger and the accessible observable projection. By recasting blockchain observability as an inferential problem with incomplete observation, this paper fills that knowledge gap. An observable ledger, an observability mechanism, and a full ledger object form the basis of the analysis’s formal framework, which is then used to investigate issues related to identifiability, information loss, irreducible uncertainty, information visibility, and visibility-dependent variance inflation. Combining publicly indexed Ethereum block data from Google BigQuery with multi-regime simulation becomes the empirical strategy. Reduced visibility increases variance, mean squared error, root mean squared error, and uncertainty inflation; the simulation contrasts Bernoulli, clustered, and activity-dependent visibility regimes, with activity-dependent masking exhibiting the worst degradation. After that, the Ethereum study separates the descriptive variation in gas usage, transaction count, and base fee per gas from controlled-missingness validation on the observed slice. This demonstrates that trend-estimation bias and RMSE increase with missingness and are highly dependent on whether the incompleteness is MCAR-like, MAR-like, or MNAR-like. The paper addresses a methodological gap in the scientific literature by demonstrating, theoretically and empirically, how limited availability changes the reliability of blockchain-based statistical conclusions and by elevating blockchain observability from an implicit background assumption to an explicit inferential object.

Methodology

Let Inline graphic denote the full block-level ledger object over the selected Ethereum interval, with variables including gas used, transaction count, and base fee per gas. Let Inline graphic denote the observable ledger returned by the selected public access pathway. The formal inferential target is defined on Inline graphic, but the empirical analysis is performed on Inline graphic. The distinction between these two objects formalizes the observability constraint studied throughout the paper.

The notation and its correspondence to the simulation and Ethereum empirical analysis are summarized in Appendix Table A.

Spaces, objects, and observation operator

Let Inline graphic be a probability space. Let Inline graphic denote the space of full ledger realizations and let Inline graphic denote the space of observable ledger realizations. In the present study, the ledger is defined at block level over a fixed Ethereum block interval. For each block index t∈ I, let

graphic file with name d33e276.gif

Where Inline graphic is gas used, Inline graphic is transaction count, and Inline graphic is base fee per gas. The full ledger is the random element

graphic file with name d33e294.gif 1

Let Inline graphic be a class of observability mechanisms. Each Inline graphic acts as a measurable map

graphic file with name d33e308.gif 2

Thus, M maps the full ledger object to the ledger object available for inference. In the empirical analysis, Inline graphic represents the block-level data returned by the selected public access pathway. The framework does not assume that all ledger components outside this pathway are observed.

To allow observer-specific or time-varying access conditions, M may itself be random. In that case,

graphic file with name d33e327.gif

The corresponding observable information is

graphic file with name d33e332.gif

Definition 1

(Partially observable blockchain). The ledger is partially observable under M if

graphic file with name d33e351.gif 3

Remark 1

(Full observability). If Inline graphic, where Inline graphic for all Inline graphic, then Inline graphic

Visibility mask and missingness structure

Let Inline graphic denote an index set of ledger components. In the general framework, these components may represent blocks, block-level fields, transactions, receipts, logs, traces, witnesses, or other ledger objects, depending on the access model under study. For the empirical analysis in this paper, the observed object is restricted to block-level variables over the selected Ethereum block interval17.

Define the random visibility mask

graphic file with name d33e390.gif

where

graphic file with name d33e394.gif

For a realized ledger Inline graphic, define the induced observable ledger by

graphic file with name d33e404.gif 4

Thus, the observable ledger is the restriction of the full ledger to the visible index set, and

graphic file with name d33e409.gif

Definition 2

(Observability mechanism). An observability mechanism is a random mask Inline graphic together with the induced projection Inline graphic. Its stochastic behavior is characterized by the conditional visibility probabilities

graphic file with name d33e431.gif 5

or, more generally, by the conditional law.

graphic file with name d33e435.gif

The collection Inline graphic describes how access constraints map the full ledger to its observable projection.

Remark 2

(Connection to missing-data mechanisms). The visibility process is of MCAR type if

graphic file with name d33e451.gif 6

and of MAR type if

graphic file with name d33e456.gif 7

These are formal benchmark cases. They are introduced to classify observability regimes and not to claim that empirical blockchain access constraints necessarily satisfy MCAR or MAR.

Targets, estimators, and reliability functionals

Let Inline graphic. The inferential target is a functional of the full ledger,

graphic file with name d33e469.gif

An estimator is any Inline graphic-measurable map of the observable ledger,

graphic file with name d33e478.gif

For a fixed observability mechanism M, define the estimation error by

graphic file with name d33e487.gif

The corresponding bias, covariance, and mean squared error are

graphic file with name d33e492.gif
graphic file with name d33e495.gif

and

graphic file with name d33e500.gif

A scalar reliability functional may then be written as

graphic file with name d33e505.gif

or, more generally, as a weighted combination of squared bias and total variance,

graphic file with name d33e510.gif

To compare uncertainty under partial observability with the full-visibility benchmark Inline graphic, define the uncertainty inflation index

graphic file with name d33e520.gif 8

Definition 3

(Audit functional). Let

Inline graphic

be a scalar functional defined on the full ledger. In the present framework, A represents any scalar summary whose stability under reduced observability is of interest. This includes, for example, block-level rolling summaries derived from gas used, transaction count, or base fee per gas.

Define

graphic file with name d33e547.gif

The audit deviation induced by mechanism M is

graphic file with name d33e556.gif

When a bounded reporting scale is useful, define

graphic file with name d33e561.gif

The quantity Inline graphic is the theoretical object of interest. The transformation AC(M) is retained only as an optional reporting index.

Remark 3

The audit functional is introduced to connect the abstract framework to empirical summaries. In the empirical section, the relevant summaries are rolling dispersion and related block-level indicators computed from the observed Ethereum series. No claim is made that AC(M) is a primary inferential quantity.

Identifiability (partial visibility)

Definition 4

(Identifiability under partial observability). Let Inline graphic be an observability mechanism. For each realized ledger Inline graphic, define the observational equivalence class

graphic file with name d33e603.gif

A parameter Inline graphic is identifiable under M if

graphic file with name d33e616.gif

Thus, identifiability holds when the observable projection Inline graphic determines the target Inline graphic uniquely up to null sets.

Proposition 1

(Information loss monotonicity). Let Inline graphic. If Inline graphic is coarser than Inline graphic, in the sense that

graphic file with name d33e660.gif 9

then for any square-integrable estimand Inline graphic,

graphic file with name d33e671.gif 10

Proof

Under squared loss, the optimal estimator among Inline graphic-measurable functions is Inline graphic and the corresponding minimum risk equals Inline graphic 15. Since Inline graphic, conditional variance is monotone under refinement, which yields Eq. (10). Equivalently, Inline graphic Blackwell-dominates Inline graphic, so the coarser experiment cannot achieve uniformly smaller squared-error risk14.

Proposition 2

(Conditional-variance lower bound). Let Inline graphic with Inline graphic Then

graphic file with name d33e739.gif 11

Proof

By the Inline graphic projection identity,

graphic file with name d33e754.gif

The first term is nonnegative and vanishes when Inline graphic. Hence the infimum equals the conditional-variance term12,15.

Definition 5

(Irreducible uncertainty). The irreducible uncertainty induced by mechanism M is

graphic file with name d33e785.gif 12

This is the minimum achievable mean-squared error under squared loss among all estimators measurable with respect to the observed ledger.

Scope constraint

The analysis is conducted entirely on the observable ledger Inline graphic. No reconstruction of the full ledger Inline graphic from Inline graphic is attempted, and no surrogate object Inline graphic is introduced as a recovered version of the hidden ledger.

The purpose of the framework is therefore not to recover unobserved ledger components. It is to characterize, for a given observability mechanism M, the inferential quantities induced by partial visibility, including

graphic file with name d33e817.gif

The framework treats observability as part of the inferential setting and studies the statistical consequences of restricted access on estimation and uncertainty.

Visibility regimes and variance inflation

We first consider an independent Bernoulli visibility regime as a benchmark case. This regime is introduced for analytical tractability and baseline comparison. It does not represent the full range of structured observability constraints that may arise in blockchain data systems.

Let Inline graphic be a component-wise visibility mask with independent entries

graphic file with name d33e832.gif

Let Inline graphic denote the visibility profile. The induced observability mechanism is

graphic file with name d33e841.gif

Proposition 3

(Variance inflation under Bernoulli visibility). Let Inline graphic with Inline graphic. Under squared-error loss, the optimal estimator based on the observed ledger is Inline graphic The corresponding irreducible uncertainty is Inline graphic If Inline graphic, then

graphic file with name d33e891.gif 13

Proof

By Definition 5, irreducible uncertainty equals the expected conditional variance under the observed σ-field. If Inline graphic component wise, then Inline graphic yields a finer observable projection than Inline graphic. The corresponding observable σ-field is therefore richer, and conditional variance decreases under refinement. This gives Eq. (13).

Corollary 1

(Uniform visibility). If Inline graphic ∀ Inline graphic, define Inline graphic Then Inline graphic is non-increasing in π, with limits

graphic file with name d33e977.gif 14

Definition 6

(Variance inflation factor). Let Inline graphic denote full observability. Define the variance inflation factor by

graphic file with name d33e997.gif 15

Then

graphic file with name d33e1004.gif

and, in the uniform-visibility regime, Inline graphic is non-increasing as π increases. A small-bias regime under independent Bernoulli visibility should therefore be interpreted as a property of this benchmark observability model. It does not imply that bias remains negligible under structured, clustered, or activity-dependent visibility constraints.

Figure 1 summarises the process by which access constraints drive the non-invertible projection from the whole blockchain ledger to an observable ledger state. Impairment in identification, coarsening of data, and missing components are the results of restricted access, which in turn causes inflation of variance, bias based on mechanisms, and irreducible uncertainty in inferences. These consequences are a direct result of the observability mechanism. Do not attribute them solely to stochastic noise or adversarial behaviour; estimator choice or more processing will not eradicate them.

Fig. 1.

Fig. 1

Chart for conceptual framework of blockchain observability as a statistical inference problem.

Simulation design

Let Inline graphic be i.i.d. ledger realizations drawn from a common distribution Inline graphic,

graphic file with name d33e1041.gif

For each realization, define the full-ledger target

graphic file with name d33e1046.gif

For a given observability regime, the observable ledger is generated by applying the corresponding mechanism M to each realization:

graphic file with name d33e1055.gif

The associated estimator is

graphic file with name d33e1060.gif

The simulation study evaluates three classes of observability regimes.

  1. Independent Bernoulli visibility: Each component is retained independently with probability Inline graphic.

  2. Clustered visibility loss: Consecutive components are removed in blocks, to represent bursty access failures or indexer interruptions.

  3. Activity-dependent visibility: Visibility probabilities depend on the realized ledger state, so that highly active components may be more likely to be hidden than low-activity components.

The first regime is a baseline benchmark. The second and third regimes are included to reflect the possibility that blockchain observability constraints are structured rather than independent.

For each regime and each visibility level, the empirical mean estimator is

graphic file with name d33e1095.gif

The empirical bias, variance, and mean squared error are defined by

graphic file with name d33e1100.gif
graphic file with name d33e1103.gif

and

graphic file with name d33e1108.gif

Definition 7

(Empirical uncertainty inflation). Let Inline graphic denote full observability. The empirical uncertainty inflation under mechanism M is

graphic file with name d33e1132.gif 16

In the Bernoulli benchmark regime, the visibility grid is taken as

graphic file with name d33e1139.gif 17

For each regime and each visibility setting, the simulation reports

graphic file with name d33e1144.gif

Under i.i.d. sampling and finite second moments, Inline graphic is a consistent empirical analogue of the corresponding variance-inflation quantity. In the independent Bernoulli benchmark, it is expected to increase as visibility decreases. Under clustered or activity-dependent visibility, the same monotone pattern need not preserve the same bias profile, and this distinction is part of the simulation design rather than an exception to it.

Simulation

In this simulation study, we appear at how changing the observation mechanism alone affects inference while the full-ledger target stays the same. We computed the target functional from the full ledger after generating a ledger realisation with (m = 200) components for each replication. Afterwards, three visibility regimes, activity-dependent visibility, clustered visibility loss, and independent Bernoulli visibility, were used to enforce partial observability. The standard example is the Bernoulli regime. The clustered regime stands for omission that is either bursty or block-correlated. Highly active realisations may become less observable than low-activity realisations due to the activity-dependent regime, which reflects observability loss that depends on the realised ledger state. In “Methodology” section, the methodological framework is matched by this configuration, where observability is considered an integral component of the inferential environment instead of an after-the-fact disruption.

The visibility levels π = (1.0, 0.8, 0.6, 0.4, 0.2) were assessed in the simulation, which utilised (N = 3000) realisations. Uncertainty inflation, variance, empirical bias, and root mean squared error were calculated for each visibility level and regime. Figure 2 summarises the combined behaviour of variance, mean squared error, root mean squared error, and uncertainty inflation, whereas Table 1 reports the complete numerical data. Separate from each other, Fig. 3 displays the corresponding bias patterns.

Fig. 2.

Fig. 2

Simulation metrics under alternative visibility regimes plot.

Table 1.

Simulation metrics across visibility levels under Bernoulli, clustered, and activity-dependent observability regimes for m = 200.

Regime π Inline graphic AOC Bias Var MSE RMSE Var full UI
Activity-dependent 1 3000 196.0387 0.0003 0.0051 0.0001 0.0101 0.0051 1.0000
0.8 3000 149.1207 0.0018 0.0081 0.0030 0.0552 0.0051 1.5791
0.6 3000 115.6690  − 0.0011 0.0137 0.0089 0.0943 0.0051 2.6641
0.4 2999 84.5869  − 0.0017 0.0260 0.0212 0.1456 0.0051 5.0716
0.2 2997 50.9296  − 0.0020 0.0537 0.0490 0.2215 0.0051 10.4646
Bernoulli 1 3000 200.0000 0.0001 0.0050 0.0001 0.0001 0.0050 1.0000
0.8 3000 160.1440  − 0.0001 0.0064 0.0013 0.0355 0.0050 1.2745
0.6 3000 120.0487 0.0006 0.0088 0.0034 0.0583 0.0050 1.7562
0.4 3000 80.1077  − 0.0017 0.0128 0.0078 0.0881 0.0050 2.5520
0.2 3000 39.9893  − 0.0015 0.0248 0.0202 0.1422 0.0050 4.9647
Clustered 1 3000 200.0000 0.0001 0.0050 0.0001 0.0001 0.0050 1.0000
0.8 3000 157.9420 0.0007 0.0063 0.0014 0.0369 0.0050 1.2670
0.6 3000 116.4060  − 0.0002 0.0086 0.0036 0.0602 0.0050 1.7273
0.4 3000 76.7513  − 0.0003 0.0132 0.0081 0.0902 0.0050 2.6413
0.2 3000 37.4150  − 0.0002 0.0268 0.0217 0.1474 0.0050 5.3692

Fig. 3.

Fig. 3

Bias across visibility regimes plot.

Degradation trends are comparable in the Bernoulli and clustering regimes. Table 1 shows that both begin with an uncertainty inflation of 1,000,000 and a variance of close to 0.005 when both are fully visible. Figure 2's four panels show that in both regimes, variance, mean squared error, root mean squared error, and uncertainty inflation all rise monotonically as visibility decreases. Table 1 shows that variance increases from 0.0050 at π = 1 to 0.0248 at π = 0.2 in the Bernoulli regime, while uncertainty inflation grows from 1.0000 to 4.9647. In the clustered regime, variance rises from 0.0050 to 0.0268 and uncertainty inflation from 1.0000 to 5.3692, again as reported in Table 1 and reflected in the corresponding trajectories in Fig. 2. These findings demonstrate that the independent benchmark is not the only place where the inflation pattern is observed. It remains even when the loss of vision is organised over different parts.

If visibility is low, the activity-dependent regime will cause inferential degradation to be much stronger. The uncertainty inflation goes up from 1.0000 to 10.4646, and the variance goes up from 0.0051 at π = 1 to 0.0537 at π = 0.2, as shown in Table 1. The behaviour of the root mean squared error and the mean squared error are identical. From 0.0101 at full visibility to 0.2215 at π = 0.2, the root mean squared error increases, as illustrated in Table 1. The activity-dependent curve stays above the Bernoulli and clustered curves across the visibility grid in all four panels of Fig. 2, indicating this stronger degradation. The comparison shows that independent censoring is not always the best strategy, and that observability loss associated with the realised ledger state can lead to far higher uncertainty inflation.

While variations in variance and mean squared error have a larger impact on the extent of bias, the bias profile varies depending on the regime. At π = 0.2 and 0.0006 at π = 0.6 in Table 1, the bias varies close to zero in the Bernoulli regime across the visibility grid. As can be seen in Table 1 and Fig. 3, the deviations are similarly modest and practically nonexistent in the clustered regime. According to Table 1 and Fig. 3, the absolute values of bias range from (− 0.0020) at π = 0.2 to 0.0018 at π = 0.8 in the activity-dependent regime, which is bigger than in the benchmark setting. The sign of the bias changes as well. It is not possible to establish as a mechanism-free conclusion the preceding assertion that bias is still limited; this is especially true for the Bernoulli benchmark.

Combined, the findings from the simulation lend credence to two arguments. For starters, there isn’t just one idealised masking scheme that might cause inferential instability under reduced visibility; all three regimes in Fig. 2 and Table 1 exhibit the same monotonic worsening of variance, mean squared error, root mean squared error, and uncertainty inflation. Secondly, the observability mechanism’s structure determines the magnitude of the instability. Figure 2 and Table 1 show that, at low coverage, activity-dependent visibility causes the greatest inflation in uncertainty and error, while clustered visibility causes the mildest deterioration and a closely related but slightly stronger pattern. Further evidence that low bias is not universal across visibility techniques is shown by the bias behaviour in Fig. 3. Results like these support the methodological argument that observability isn’t a secondary data limitation but rather an inferential difficulty that needs modelling.

Ethereum data analysis

For blocks 18,000,000 to 18,001,00, we analysed Ethereum block data collected using Google BigQuery. In this part, the concrete item is the observable series at the block level that the chosen public access route returns. The gas used, transaction count, and base charge per gas are block-level variables that make up this observable object in the present investigation. It omits features like receipts, logs, traces, archival state, and delayed-access recovery of hidden components, as well as transaction-level reconstruction. We skip reconstructing the whole ledger and instead do the analysis on the observed projection. Differences in petrol use, number of transactions, and base fee per petrol are summarised in the descriptive component. The validation part measures the distortion of inference caused by partial observability by applying controlled incompleteness to the observed slice.

The three series’ observed variability at the block level is summarised in Fig. 4. In the timeframe under consideration, the observed block slice does not exhibit variance stability, as demonstrated by the rolling-dispersion panels. In contrast to discrete variations, the raw-series panels reveal continuous shifts in level and spread. Descriptive plots are what these are. They prove that Ethereum’s observable series vary across the chosen block range, but they can’t tell you for sure if the instability is due to on-chain intrinsic temporal variation or partial observability.

Fig. 4.

Fig. 4

Observable Ethereum block-level variability across gas used, transaction count, and base fee per gas.

We used three different methods, MCAR, MAR-like, and MNAR-like, to apply controlled missingness to the observed Ethereum slice in order to directly evaluate inferential distortion. We compared the estimated slopes of the linear trends for gas utilised, transaction count, and base charge per gas with the full-view slope obtained from the observed slice without extra masking. We repeated this process for each mechanism and missingness rate. The results of the (n = 250) Monte Carlo replications for each setting are reported in Table 2, together with the RMSE and bias values. The RMSE profiles are summarised in Fig. 5, while the bias profiles are shown in Fig. 6.

Table 2.

Controlled-missingness distortion in ethereum block data for n = 250.

Metric Mechanism Miss rate (%) Bias RMSE
Base fee per gas MAR-like 10  − 8618 102,900
20  − 28,570 159,400
30  − 38,750 215,100
5  − 10,420 68,430
50  − 146,100 354,400
MCAR 10 3710 96,220
20 15,050 151,000
30 4508 177,800
5 3832 64,840
50 20,090 281,700
MNAR-like 10 176,900 222,900
20 476,900 519,300
30 962,300 1,015,000
5 75,460 125,300
50 3,290,000 3,303,000
Gas used MAR-like 10 7.242 192
20 34.29 268.1
30 128.3 461.7
5 8.261 134.1
50 383.5 663
MCAR 10  − 6.561 184.2
20 15.94 260.2
30  − 14.12 323.3
5  − 1.644 125.7
50  − 44.29 469
MNAR-like 10  − 73.85 243.1
20  − 145.1 361.5
30  − 337.5 550.4
5  − 16.6 150.1
50  − 478.5 595.9
Transaction count MAR-like 10 0.0002069 0.001526
20 0.0005136 0.002536
30 0.001112 0.003282
5 5.55E-05 0.00117
50 0.001774 0.003765
MCAR 10  − 7.52E-05 0.001394
20 3.48E-05 0.002083
30 4.65E-05 0.002592
5  − 0.0001143 0.0009164
50 4.82E-05 0.004258
MNAR-like 10  − 0.0001462 0.00193
20  − 6.86E-05 0.002611
30 0.0002146 0.003316
5  − 0.0001351 0.001162
50 0.002122 0.003519

Fig. 5.

Fig. 5

RMSE of linear trend estimates under controlled Missingness.

Fig. 6.

Fig. 6

Bias of linear trend estimates under controlled Missingness.

With the exception of MNAR-like masking, the RMSE results for all three variables rise as missingness increases. As seen in Table 2 and Fig. 5, the root-mean-squared error (RMSE) for the basic fee per petrol increases from 64,840 at 5% MCAR missingness to 281,700 at 50% MCAR missingness, with a corresponding MNAR-like increase from 125,300 to 3,303,000. The pattern for gas utilised is identical. Under MNAR-like masking, the RMSE increases from 150.1 to 595.9, as shown in Table 2 and traced in Fig. 5, and it goes up from 125.7 at 5% MCAR to 469.0 at 50% MCAR. The monotonic degradation is also apparent for transaction count, but on a smaller numerical scale. Figure 5 shows that the mechanism-specific differences persist even after adjusting the RMSE from 0.0009164 at 5% MCAR to 0.004258 at 50% MCAR. The results demonstrate that the distortion caused by decreased visibility is affected by both the extent of missingness and the mechanism by which it is generated.

Additionally, the bias results vary depending on the method. Table 2 and Fig. 6 show that, under MCAR, the bias for all three variables stays near zero for the majority of missingness rates. The bias becomes more apparent with MAR-like masking, especially for gas utilised and base fee per gas calculations. The bias increases significantly when MNAR-like masking is applied. The basic fee per petrol shows an MNAR-like bias of 3,290,000 at 50% missingness compared to 75,460 at 5% missingness (Table 2 and Fig. 6). Table 2 and Fig. 6 show that the MNAR-like bias changes for gas utilised from -16.6 at 5% missingness to − 478.5 at 50%. Although there is less absolute bias in the transaction count, the same mechanism reliance is still there. So, it’s not entirely mechanism-free to say that bias remains modest. Under MAR-like and MNAR-like incompleteness, it becomes less stable, but it is most compatible with the MCAR benchmark.

The findings of the validation and descriptive analyses, taken together, lend credence to a more limited empirical conclusion. As seen in Fig. 4, the amounts accessible through the public access method show a great deal of diversity in the reported Ethereum block slice. As demonstrated in Table 2, Figs. 5, and 6, the bias and RMSE both rise when controlled incompleteness is applied to that observed slice. The magnitude of this rise is highly dependent on whether the masking mechanism is MCAR-like, MAR-like, or MNAR-like. Partial observability can significantly affect inference on Ethereum block-level summaries, according to the real-data evidence. The more robust assertion that observability limitations are the sole source of volatility in the raw series is unnecessary.

Discussion and conclusions

In real-world blockchain analysis, full ledger visibility is unusual. Nothing can be accessed due to storage limitations, client architecture, indexing layers, or off-chain execution paths. So, rather than being a complete record, the observable ledger is a projection. This projection, and not just the estimator used to it, shapes inference. Data that is not visible to the naked eye cannot be recovered by further computation or local refining.

Why this matters theoretically

According to the findings, inferential dependability revolves around the observation process. It becomes more difficult to identify an individual and the minimum acceptable risk rises when multiple complete ledgers point to the same observable state. In such a case, the observation structure introduces uncertainty. This impact is independent of out-of-the-ordinary actions or selection of estimators. The available information is coarsened, and this is the result.

Results from computer models

There is a consistent pattern of degradation in low visibility, according to the simulation data. As visibility reduces, uncertainty inflation, root mean squared error, variance, and mean squared error all rise throughout clustered, Bernoulli, and activity-dependent regimes. The masking structure determines the magnitude of the same directional trend that occurs across regimes. The most severe degradation is observed in the activity-dependent regime. In the clustered regime and the Bernoulli benchmark, bias is quite minimal; however, under activity-dependent visibility, it becomes more mechanism-dependent. While demonstrating that bias behaviour is not mechanism-free, the simulation evidence also lends credence to a structural interpretation of inferential deterioration.

Proof from Ethereum public ledger information

Within a narrower empirical context, the Ethereum study lends credence to the identical result. Variation in gas utilised, transaction count, and base cost per gas is evident in the observed block-level slice. These patterns of description show that the observable series are different over the chosen interval, but they don’t tell us anything about where the variation is coming from. The more robust empirical outcome is provided by the controlled-missingness approach. The bias and root-mean-squared error (RMSE) rise when the observed Ethereum slice is incomplete; the magnitude of this rise is highly dependent on the type of masking method used, which can be MCAR, MAR, or MNAR. For base charge per gas and gas used, the biggest distortion happens under MNAR-like masking. Therefore, the real-data evidence demonstrates that inference on Ethereum block-level summaries can be significantly impacted by partial observability.

How blockchain analytics are affected

Because imperfect access is sometimes handled too carelessly, these findings significance for empirical blockchain research. It is common practice to treat observed ledger data as near entire records when conducting analyses, even when access is mediated through indexers, lightweight clients, or partial protocol views. Both the seeming stability and the level of uncertainty might be inflated by this. Accordingly, the access mechanism that produced the data should be considered alongside auditability claims when interpreting the data. When complete replication is not possible, a more solid foundation for empirical research can be established by treating blockchain observability as an inferential constraint.

The study concludes that blockchain analytics do not suffer from secondary annoyances caused by partial observability. This limitation is fundamental to inferential logic. Information loss reduces identifiability and increases uncertainty; the theoretical results show how this happens. This effect is observed in both the benchmark and structured observability regimes, according to the simulation and Ethereum analyses. Understanding the statistical findings supported by blockchain technology requires keeping the observable projection in mind.

Limitations and future work

Intentionally, the study’s scope is small. Absent any effort to recover concealed ledger states, the study focuses on the inferential consequences of limited observability. While this does make it easier to spot the statistical impact of coarsened access, it does so at the expense of considering all aspects of blockchain systems that could influence the data that is actually observed.

Capacity for modelling

Data is collected and analysed at the block level. It doesn’t treat receipts, logs, execution traces, archival state, mempool dynamics, or ordering at the transaction level as independent inferential objects. Therefore, the current design does not account for intra-block dependencies or the behaviour of miners during execution. Not only are the types of information loss discussed above not accounted for, but there may be additional types due to data propagation effects and delays in communication across layers.

Evidence-based coverage

The Ethereum study can only cover a small range of consecutive blocks. This window describes long-run network behaviour or greater structural changes across time, yet it is enough to show block-level variability and validate inferential distortion under controlled incompleteness. Hence, the empirical results are not meant to represent a comprehensive explanation of Ethereum dynamics, but rather proof of inferential sensitivity under partial observability during the chosen interval part.

Future work

There are a number of open extensions. One approach is to be more explicit when modelling observability mechanisms that are time-varying, field-correlated, or client-specific. Second, we may build on top of the current architecture to support more advanced blockchain objects like archival state views, traces, logs, and receipts. There is an operable third direction. According to Ressi et al.16, AI-assisted methods have the potential to aid in observing profiles, detecting indexing drift, supporting observability-aware analytics, and calibrating uncertainty based on access quality. However, it is important to note that these methods do not guarantee complete reconstruction of concealed ledger states. The link between statistical inference and real-world blockchain data systems would be strengthened by these extensions.

Implementation

The observable ledger is the sole platform on which the framework is applied. In order to retrieve previously hidden data, no surrogate ledger is used, and no whole ledger states are restored. Not a modelling convenience, but the access pathway defines the difference between the complete ledger and the observable ledger. For every calculation, we only use data that is truly accessible via the chosen interface.

The verifiable ledger projection is the basis for the analytical process. Here, we use this forecast as the returned data at the block level from Ethereum’s chosen public access channel. Outside of that perspective, it is not presumed that full ledger states are available. Therefore, the data set used for inference is decided by the access model.

The observed block-level series are the only outcomes of any statistical techniques. We do not reconstruct, impute, or backfill any missing blocks, transactions, or state variables. At the validation stage, we see how inference changes when visibility degrades under MCAR, MAR-like, and MNAR-like methods by applying controlled incompleteness to the observed Ethereum slice. This maintains coherence between the inferential model and the data that was actually analysed.

This same implementation idea can be used in several blockchain environments where access is limited due to client design, storage limits, indexing technique, or protocol architecture. Modifying protocols or replicating archives in their whole is not necessary for the framework. In the context of actual operational limitations, it is responsible for quantifying the impact of restricted access on inferential dependability.

Acknowledgements

The project was funded by KAU Endowment (WAQF) at King Abdulaziz University, Jeddah, Saudi Arabia. The authors, therefore, acknowledge with thanks WAQF and the Deanship of Scientific Research (DSR) for technical and financial support.

Appendix

See Table 3.

Table 3.

Notation and empirical mapping.

Symbol/concept Formal meaning Simulation/Ethereum instantiation
Inline graphic Underlying probability space Probability space supporting ledger realizations and observability mechanisms
Inline graphic Space of full blockchain ledgers Full simulated ledger space; block-level Ethereum ledger object over the selected interval
Inline graphic Space of observable ledgers Masked simulated ledger space; observable BigQuery block-level projection
Inline graphic Random full ledger Full simulated realization; block-level Ethereum slice treated as the full empirical object for the present study
Inline graphic Block at time index (t) Ethereum block in the selected interval
Inline graphic Gas used in block (t) BigQuery gas-used field
Inline graphic Transaction count in block (t) BigQuery transaction-count field
Inline graphic Base fee per gas in block (t) BigQuery base-fee field for post-EIP-1559 blocks
Inline graphic Class of observability mechanisms Bernoulli, clustered, and activity-dependent simulation regimes; MCAR, MAR-like, and MNAR-like controlled masking in Ethereum validation
Inline graphic Observation operator / ledger–observer mapping Masking rule applied to the full ledger or observed Ethereum slice
Inline graphic Observable ledger induced by (M) Masked simulated ledger; observable Ethereum block-level series returned by the selected access pathway
Inline graphic Block-level state at index t Gas used, transaction count, and base fee per gas in block t
Inline graphic σ-field generated by Inline graphic Information available after masking or restricted access
Inline graphic Index set of ledger components Component positions in simulation; block-level variables or observations in the Ethereum slice
Inline graphic Visibility mask Binary mask over simulated components or over Ethereum observations in controlled-missingness validation
Inline graphic Component (i) is observable Retained simulated component or retained Ethereum observation
Inline graphic Component (i) is hidden Masked simulated component or removed Ethereum observation
Inline graphic Visibility probability of component (i) Component-wise retention probability
Inline graphic Visibility profile Visibility level in simulation, e.g. ({1.0,0.8,0.6,0.4,0.2})
Inline graphic Estimand defined on the full ledger Target functional in simulation; linear trend slope in Ethereum validation
Inline graphic Estimator based on Inline graphic Estimator computed after masking or restricted observation
Inline graphic Irreducible uncertainty under mechanism (M) Minimum achievable squared-error risk under the selected visibility mechanism
Inline graphic Uncertainty inflation relative to full observability Variance ratio in simulation
Inline graphic Variance inflation factor Visibility-dependent variance inflation under Bernoulli benchmark
Inline graphic Identity / full-visibility mechanism No masking; uncensored benchmark
Inline graphic Audit or summary functional Rolling dispersion or other block-level summary of gas used, transaction count, or base fee per gas
Inline graphic Audit deviation under (M) Difference between full and observed summary under the selected mechanism
MCAR Missing completely at random Controlled Ethereum masking independent of the target variable
MAR-like Missingness depending on observed covariates Controlled Ethereum masking depending on observed block-level quantities
MNAR-like Missingness depending on the target itself Controlled Ethereum masking depending on the variable being inferred

Author contributions

M.Z.A. conceived the study, developed the theoretical framework, carried out the statistical analysis, and wrote the manuscript. A.A. contributed to the protocol-level perspective, interpretation of the results, and critical revision of the manuscript. Both authors reviewed and approved the final manuscript.

Funding

This research received no specific grant from any funding agency in the public, commercial, or not-for-profit sectors.

Data availability

The analysis uses publicly indexed Ethereum blockchain data representing an observable projection of the on-chain ledger. Specifically, data were obtained from the Google BigQuery *Ethereum Cryptocurrency* dataset, accessed through the bigquery-public-data.crypto_ethereum tables. The empirical study focuses on blocks 18,000,000–18,001,000. All results can be reproduced using the SQL queries described in the Methods section.

Code availability

The custom R code and supporting algorithmic workflow used to generate the simulation results, Ethereum analyses, tables, and figures central to this study have been archived in Zenodo and are available at 10.5281/zenodo.20094031. The repository includes the real-data Ethereum analysis script, the multi-regime simulation script, documentation, and instructions required to reproduce the reported results.

Declarations

Competing interests

The authors declare no competing interests.

Footnotes

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Contributor Information

Muhammad Zeshan Arshad, Email: vf_mzeshanarsha@brocku.ca.

Ali Algrani, Email: ahalgarni@kau.edu.sa.

References

  • 1.Nakamoto, S. Bitcoin: A peer-to-peer electronic cash system (2008).
  • 2.Garay, J. A., Kiayias, A. & Leonardos, N. The Bitcoin backbone protocol: Analysis and applications. In Advances in Cryptology—EUROCRYPT 2015. Lecture Notes in Computer Science Vol. 9056 (eds Oswald, E. & Fischlin, M.) 281–310 (Springer, 2015). 10.1007/978-3-662-46803-6_10. [Google Scholar]
  • 3.Ștefănescu, D., Montalvillo, L., Galán-García, P., Unzilla, J. & Urbieta, A. A systematic literature review of lightweight blockchain for IoT. IEEE. Access10, 123138–123159. 10.1109/ACCESS.2022.3224222 (2022). [Google Scholar]
  • 4.Ali, M. S. et al. Applications of blockchains in the Internet of Things: A comprehensive survey. IEEE. Commun. Surv. Tutor.21(2), 1676–1717. 10.1109/COMST.2018.2886932 (2019). [Google Scholar]
  • 5.Croman, K. et al. On scaling decentralized blockchains (A position paper). In Financial Cryptography and Data Security: International Workshops, FC 2016, BITCOIN, VOTING, and WAHC, Christ Church, Barbados, February 26, 2016, Revised Selected Papers. Lecture Notes in Computer Science Vol. 9604 (eds Rohloff, K. et al.) 106–125 (Springer, 2016). 10.1007/978-3-662-53357-4_8. [Google Scholar]
  • 6.De Angelis, S., Visconti, I., Vitaletti, A. & Zecchini, M. Efficient query verification for blockchain superlight clients using SNARKs. Blockchain Res. Appl.6, 100396. 10.1016/j.bcra.2025.100396 (2025). [Google Scholar]
  • 7.Gervais, A., Karame, G. O., Wüst, K., Glykantzis, V., Ritzdorf, H. & Čapkun, S. (2016). On the security and performance of proof-of-work blockchains. In Proceedings of the 2016 ACM SIGSAC Conference on Computer and Communications Security 3–16. ACM. 10.1145/2976749.2978341
  • 8.Cao, H., Murugesan, R. K., Cao, H. & Shen, H. Improved lightweight node storage solutions in blockchain. Egypt. Inform. J.30, 100648. 10.1016/j.eij.2025.100648 (2025). [Google Scholar]
  • 9.Buterin, V. A next-generation smart contract and decentralized application platform (2014).
  • 10.Saif, M. B., Migliorini, S. & Spoto, F. A survey on data availability in layer 2 blockchain rollups: Open challenges and future improvements. Future Internet16(9), 315. 10.3390/fi16090315 (2024). [Google Scholar]
  • 11.Rubin, D. B. Inference and missing data. Biometrika63(3), 581–592. 10.1093/biomet/63.3.581 (1976). [Google Scholar]
  • 12.van der Vaart, A. W. Asymptotic Statistics (Cambridge University Press, 1998). [Google Scholar]
  • 13.Hampel, F. R., Ronchetti, E. M., Rousseeuw, P. J. & Stahel, W. A. Robust Statistics: The Approach Based on Influence Functions (Wiley, 1986). [Google Scholar]
  • 14.Blackwell, D. Equivalent comparisons of experiments. Ann. Math. Stat.24(2), 265–272. 10.1214/aoms/1177729032 (1953). [Google Scholar]
  • 15.Lehmann, E. L. & Casella, G. Theory of Point Estimation 2nd edn. (Springer, 1998). [Google Scholar]
  • 16.Ressi, D., Romanello, R., Piazza, C. & Rossi, S. AI-enhanced blockchain technology: A review of advancements and opportunities. J. Netw. Comput. Appl.225, 103858 (2024). [Google Scholar]
  • 17.Carpenter, J. R. & Smuk, M. Missing data: A statistical framework for practice. Biom. J.63(5), 915–947. 10.1002/bimj.202000196 (2021). [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Data Availability Statement

The analysis uses publicly indexed Ethereum blockchain data representing an observable projection of the on-chain ledger. Specifically, data were obtained from the Google BigQuery *Ethereum Cryptocurrency* dataset, accessed through the bigquery-public-data.crypto_ethereum tables. The empirical study focuses on blocks 18,000,000–18,001,000. All results can be reproduced using the SQL queries described in the Methods section.

The custom R code and supporting algorithmic workflow used to generate the simulation results, Ethereum analyses, tables, and figures central to this study have been archived in Zenodo and are available at 10.5281/zenodo.20094031. The repository includes the real-data Ethereum analysis script, the multi-regime simulation script, documentation, and instructions required to reproduce the reported results.


Articles from Scientific Reports are provided here courtesy of Nature Publishing Group

RESOURCES