Researchers release CHORD for label-free debiasing, PACT for incremental time-series adaptation, AnisoFlow for learnable flow targets, and GlyphAtlas for high-fidelity scene text synthesis.
Read the full article on Pneumetron →
Deep learning systems frequently exploit dataset shortcuts that collapse under distribution shifts. Recent arXiv papers introduce methods to mitigate these failures, adapt to new conditions, and improve generative stability. The following covers four independent releases.
CHORD: Cross-View Debiasing Without Labels
Deep models trained with empirical risk minimization often rely on spurious features that correlate with labels in the majority of training samples but fail on underrepresented groups. Existing debiasing techniques either require costly human annotations of bias attributes or infer shortcuts from a single representation space. A single view can provide noisy or incomplete evidence, especially when spurious features are entangled with semantic variation.
The CHORD framework addresses this by decoupling where bias candidates are proposed from where they are validated. It operates on a frozen target encoder and classifier head, assuming the learned representations retain sufficient core features for the task. CHORD aggregates candidate biases from multiple views of the same labeled samples. These views include the target model itself, pretrained encoders trained with different objectives, and a geometry-enhanced view that whitens the target features to emphasize low-variance directions.
Each view proposes a candidate bias as a within-class partition. Using relative prototype distance, every view splits its class into bias-aligning samples and bias-conflicting outliers. The framework then transfers these partitions into the target feature space for validation. It learns a lightweight, class-shared diagonal affine transformation to suppress the feature differences highlighted by each partition. Samples that move back to their correct class after this transformation become correction evidence. A heuristic admission rule filters views, keeping only those that provide nonempty reversal sets. The framework aggregates evidence across admitted views into soft sampling weights to retrain the classifier head. Auxiliary views are discarded after training.
Evaluated on seven benchmarks across vision, language, speech, and medical imaging, CHORD achieves the highest worst-group accuracy among competing methods that do not use bias supervision. The method relies on the assumption that the frozen encoder retains recoverable core features, which may not hold for all architectures or tasks.
PACT: Incremental Adaptation for Time-Series Foundation Models
Pretrained time-series foundation models provide strong representations, but adapting them to changing operating conditions without forgetting previous ones remains difficult. Standard fine-tuning changes shared parameters and degrades earlier conditions, while regularization methods introduce a stability-plasticity trade-off. Domain-incremental methods often rely on hard routing or require condition identity at inference.
PACT adapts frozen time-series models by learning local residual corrections in the embedding space. The authors observe that domain shifts degrade representations non-uniformly: some local regions change substantially while others remain stable. PACT partitions the source embeddings into fixed Voronoi regions, or charts, using k-means. When a new domain condition arrives, it learns a lightweight rank-8 residual transport for each chart using a small calibration set. The source branch remains a fixed identity path.
At inference, a two-layer MLP gate softly routes each embedding through the accumulated transports for observed conditions. The gate is trained to predict domain identity from retained embeddings and refit after each new condition. A non-source branch with fewer than five calibration embeddings in a chart is masked before the softmax. The identity branch is always available, allowing the gate to apply large corrections where needed, combine overlapping conditions, or leave embeddings unchanged. The method requires only 5% labeled calibration data per condition and does not need condition identity at test time.
PACT was evaluated on five time-series benchmarks: bearing-fault diagnosis, WISDM, HHAR, UCI-HAR, and Sleep-EDF. On the frozen Sundial backbone, PACT maintains an average macro-F1 above 0.95 on the bearing-fault stream while keeping forgetting below 0.05. Performance retention varies across datasets. UCI-HAR shows a larger decline in source performance after multiple updates, dropping over six points below its initial value. The method transfers across classification-pretrained, forecasting-pretrained, and task-specific backbones without architectural changes.

Illustrative image: KiranJyothi / Pixabay
AnisoFlow: Learnable Prediction Targets for Flow Models
Flow-based generative models are trained to predict a target along a noising path, such as velocity, noise, or clean data. This choice strongly affects training behavior and sample quality. Standard targets assign uniform noise weights across all directions, which increases prediction difficulty in low-variance directions or makes velocity recovery ill-conditioned at low noise levels.
AnisoFlow replaces the fixed prediction target with a fully learnable one. It scales the noise component of the velocity target anisotropically, assigning a separate nonnegative weight to each direction in a jointly learned orthogonal basis. A closed-form map recovers the velocity from the network's prediction, leaving the architecture, flow-matching loss, and sampler unchanged. The learned basis aligns closely with the data's principal component analysis, and the noise weights scale near-linearly with data variance in each direction. This resolves the tradeoff between high-variance and low-variance directions.
The basis is updated using a spectral method that tracks a running moment matrix of prediction errors and eigendecomposes it at every training step. Weights are shared across timesteps, as analysis shows that estimation errors vary in opposite directions across timesteps, canceling out the need for time-dependent weights.
On ImageNet 256x256, AnisoFlow improves FID from 1.90 to 1.55 over the JiT baseline. In pixel-space text-to-image generation using the JiT-L/16-T2I backbone, the method improves image quality and largely eliminates patch-seam artifacts under reduced-precision inference. The approach adds computational overhead during training due to the eigendecomposition step, but requires no architectural changes and keeps the learned basis fixed at inference.
GlyphAtlas: Decoupling Stroke Detail from Layout
Scene text synthesis requires rendering accurate characters in specified layouts while maintaining visual coherence with the background. Standard methods pre-render target text into a glyph image that serves as both a spatial anchor and a stroke reference. This ties the resolution of each glyph to its target region, causing failures on small, dense, or structurally complex text.
GlyphAtlas decouples these roles. The framework retains the glyph image for layout and coarse structure, but supplies fine-grained stroke guidance through a dedicated glyph atlas. Each character or word is rendered into a separate cell at a fixed resolution, encoded by the diffusion backbone's native VAE, and appended to the token sequence. The authors introduce atlas-anchored attention, which restricts scene and glyph-image tokens to attend only to the atlas cells of their overlapping regions. This coarse-to-fine conditioning simplifies stroke rendering, as the model only needs to refine strokes that are already roughly in place.
The model is trained with a mask-weighted flow matching objective and a timestep-weighted text perceptual loss. Random resolution augmentation of atlas cells during training supports adjustable token budgets at inference. A soft allocator prioritizes smaller glyphs when the total token count exceeds the limit.
Evaluated on four scene text benchmarks, GlyphAtlas achieves state-of-the-art sentence accuracy. It leads on AnyText, TextOCR, Total-Text, and ReCTS. The method also shows strong zero-shot transfer to unseen scripts, leading on STIPLAR without language-specific fine-tuning. Performance on complex scripts like Chinese drops if the inference cell resolution mismatches the training height, though random augmentation mitigates this sensitivity. The added token budget increases generation time by roughly three percent when lowering cell resolution.
Sources
- arXiv: Let Samples Sing in Chorus: Mitigating Spurious Correlations via Cross-view Consensus
- arXiv: Recurrent Domain Incremental Adaptation of Time-Series Foundation Models
- arXiv: Learning Anisotropic Prediction Targets for Flow Models
- arXiv: GlyphAtlas: Disentangling Stroke Detail from Layout for Scene Text Synthesis
Originally published on Pneumetron.
