AI & ML
On the Validity of Fisher Randomization Tests under the Weak Null
arXiv stat.TH0 views
arXiv:2611.24821v1 Announce Type: cross Abstract: Consider the problem of testing the Neyman weak null of no sample average treatment effect $H_{0N}:\tau = 0$ in randomized experiments with binary outcomes. Although the Fisher Randomization Test (FRT) is typically justified under Fisher's sharp null of no individual treatment effect, we show that it is finite-sample-valid for the weak null $H_{0N}$ in three common combinations of study design and test statistic: 1) balanced completely randomized experiments with the difference-in-means test statistic, 2) matched pairs experiments with the same test statistic, and 3) balanced Bernoulli randomized experiments with the centered Horvitz-Thompson test statistic. As an immediate corollary, Fisher's exact test in a balanced completely randomized experiment is valid under the weak null, and so is McNemar's test in a matched pairs experiment. Similar results hold for the one-sided null $H_0:\tau \leq 0$. Beyond balanced designs, we show that twice the one-sided FRT $p$-value with the same test statistics is valid under $H_{0N}$. In simulation experiments, the FRTs compare favorably to other exact procedures.
Source:https://arxiv.org/abs/2611.24821PreviousAnytime-valid goodness-of-fit test by $e$-spacingsNextAssessing model calibration with boosting trees
Related posts

llm-gemini 0.38
0Simon Willison
How to detect user frustration in chatbot conversations
0dev.to
Mình Đã Biến Gemini Thành Trợ Lý Cá Nhân Như Thế Nào (Lịch, Drive, Gmail và Những Lần Suýt Toang)
0dev.to
Im looking fr any free ai models / tools are there?, leaVE UR Lights💡
0dev.to
I checked 10 SEO agency websites for AI-search readiness. The real bugs were the boring ones.
0dev.to

How much GPU memory does an LLM need? The whole sum, worked out on real cards
0dev.to