Source Pages
Curation Fields
Source pages use importance: landmark|important|normal|context and
read_status: read|skimmed|none. Agents MUST prioritize landmark and
important sources during search and synthesis.
Landmark Sources
Read
- chemeris-latent-state-time-series-2026.md - Alex’s landmark position source for why observation forecasting is too narrow and why time-series foundation models should optimize for useful internal state.
- context-is-key-2024.md - ServiceNow Context is Key benchmark showing that essential natural-language context can be required for accurate time-series forecasts.
- lecun-autonomous-machine-intelligence-2022.md - LeCun autonomous machine intelligence proposal centered on world models, intrinsic objectives, and hierarchical JEPA.
- pararnn-2025.md - Apple ParaRNN framework for parallel training of nonlinear RNNs at billion-parameter language-model scale.
Skimmed
- world-models-2018.md - Ha and Schmidhuber landmark source for VAE + MDN-RNN latent world models, controller training in learned dreams, and simulator-exploitation caveats.
Important Sources
Read
- aionoscope-2026.md - MILETS 2026 diagnostic benchmark for latent-state accessibility in frozen time-series representations, with exact categorical and dense labels from controlled Process-to-View generation.
- beyond-language-modeling-2026.md - Controlled multimodal pretraining study using Transfusion, visual data, world modeling, and MoE scaling.
- bolmo-2025.md - Byteification method for converting subword LMs into competitive byte-level language models.
- cauker-2025.md - Synthetic causally coherent time-series generator for TSFM pretraining.
- chatts-2024.md - Synthetic-data-trained time-series MLLM for understanding and reasoning over multivariate series.
- conceptmoe-2026.md - MoE architecture that merges semantically similar tokens into concept representations.
- dinov3-2025.md - Scaled self-supervised vision foundation model with improved dense features.
- dragon-hatchling-2025.md - Pathway BDH / Dragon Hatchling source for sparse positive recurrent fast state, synapse-level probes, language/translation scaling, and a cautionary architecture narrative around brain-model and Sudoku claims.
- dynamic-fine-tuning-2025.md - Reward-rectified SFT method that links SFT and RL through implicit rewards and token-level gradient scaling.
- exprl-2026.md - Exploratory RL mid-training method that uses reference solutions as hidden dense-reward scaffolds instead of imitation targets.
- evolution-strategies-at-scale-2025.md - Full-parameter ES fine-tuning of billion-parameter LLMs as an RL alternative.
- florence-2-2023.md - Microsoft Florence-2 paper using FLD-5B and an iterative visual data engine to train a compact prompt-based generalist vision model.
- gemma-4-12b-2026.md - Google DeepMind production/open-weight release for an encoder-free multimodal 12B model with text, image, and audio inputs.
- h-net-2025.md - End-to-end hierarchical byte model with learned dynamic chunking.
- guillotine-regularization-2022.md - Layer-cutting analysis showing why SSL projectors can improve training while hiding worse downstream representations at the output.
- iclr-time-series-meta-analysis-2026.md - Local ICLR 2026 field-map source for time-series forecasting, representation learning, and physiology-heavy representation clusters.
- latent-variable-energy-based-models-2023.md - Lecture-note introduction to latent-variable energy-based models and H-JEPA.
- lejepa-2025.md - JEPA theory and SIGReg objective for Gaussian predictive representations.
- lenepa-2026.md - MILETS 2026 no-augmentation next-latent prediction recipe for time-series representation learning, using temporal SIGReg instead of stop-gradient or EMA stabilization.
- leworldmodel-2026.md - Stable end-to-end JEPA world model from pixels using next-embedding prediction and Gaussian regularization.
- mamba-2023.md - Selective state space model architecture for linear-time sequence modeling.
- mamba-2-2024.md - Structured state space duality framework and Mamba-2 architecture.
- mamba-3-2026.md - Mamba-family architecture adding exponential-trapezoidal discretization, complex state, and MIMO updates.
- moda-2026.md - Mixture-of-Depths Attention source for content-based retrieval over prior layer key/value memories and hardware-aware depth attention.
- natural-language-guidance-tts-2024.md - Scalable synthetic annotation method for natural-language-controlled high-fidelity text-to-speech.
- nepa-2025.md - Next-embedding predictive autoregression for visual self-supervised learning.
- synergy-2025.md - Tokenizer-free byte-level language model with learned abstraction routing.
- prism-hypothesis-2025.md - Spectral hypothesis unifying semantic and pixel encoders through frequency structure.
- armt-2024.md - Associative Recurrent Memory Transformer source for layerwise associative memory over RMT-style segments.
- rate-2023.md - ICLR 2026 RATE source for recurrent memory in offline RL trajectories.
- rmt-2022.md - NeurIPS 2022 Recurrent Memory Transformer source for segment-level memory tokens.
- timeomni-1-2026.md - Time-series reasoning suite and TimeOmni-1 model for complex temporal reasoning.
- timeomni-vl-2026.md - Vision-centric unified model for time-series understanding and generation.
- tuna-2-2026.md - Pixel-space unified multimodal model that removes pretrained vision encoders.
- u-cast-2025.md - HDTSF formulation, Time-HD benchmark, and U-Cast baseline for high-dimensional multivariate forecasting.
- flow-of-ranks-2025.md - Rank-structure analysis and compression recipe for time-series Transformers.
- vjepa-2026.md - ICML 2026 probabilistic JEPA source for distributional latent-state prediction, Bayesian-filtering semantics, modular prior conditioning, and the demonstrated-unimodal-versus-multi-modal-futures boundary.
- vl-jepa-2025.md - Vision-language JEPA that predicts text embeddings instead of autoregressive tokens.
Skimmed
- levljepa-2026.md - Non-contrastive end-to-end vision-language pretraining method using cross-modal prediction, stop-gradient targets, and per-modality SIGReg, with dense patch-token gains relevant to TSL-JEPA.
- adajepa-2026.md - Adaptive JEPA latent world model that updates inside the MPC loop using observed transitions before replanning under distribution shift.
- agentic-automata-learning-2026.md - Controlled benchmark showing that tool-calling LLM agents still struggle to infer hidden DFA world models through interaction, especially as state complexity and accumulated evidence grow.
- aristotelian-representation-hypothesis-2026.md - ICML 2026 calibration critique of raw representational-similarity metrics; global PRH-style convergence largely disappears after width/depth null calibration, while local-neighborhood alignment remains.
- exploration-fine-tuning-parameter-decomposition-2026.md - Goodfire hackathon/source-code/X snapshot showing a VPD component-basis edit that removes a small LM’s German prediction ability by tuning one scalar, with LoRA and off-target-language caveats.
- llm-emu-2026.md - vLLM wall-clock emulator that preserves the online serving stack while replacing GPU forward execution with profile-sampled latency and synthetic output tokens.
- minimax-sparse-attention-2026.md - MiniMax block-sparse GQA attention source with trained per-group block selection, 109B MoE evidence, released MSA kernels, and MiniMax-M3 open-weight model context.
- llmservingsim-2024.md - IISWC 2024 HW/SW co-simulation infrastructure for LLM inference serving, with iteration-level modeling and computation reuse.
- llmservingsim-2-0-2025.md - IEEE CAL 2025 LLMServingSim 2.0 bridge paper on trace-driven heterogeneous-hardware simulation and serving-technique interfaces.
- llmservingsim-2-0-2026.md - Current LLMServingSim 2.0 source for heterogeneous and disaggregated LLM serving simulation.
- pretraining-recurrent-networks-without-recurrence-2026.md - MIT SMT/DMT source for pretraining nonlinear RNNs from predictive memory labels without standard BPTT.
- maya-2025.md - EuroSys 2026 transparent GPU runtime emulation method for deep-learning training workloads.
- revati-2026.md - GPU-free time-warp emulator for LLM serving that runs real vLLM/SGLang control logic through CUDA virtualization.
- sageserve-2025.md - ACM POMACS 2025 forecast-aware LLM serving autoscaling and routing system using Microsoft O365 production workloads.
- vidur-2024.md - Microsoft large-scale LLM inference simulator and Vidur-Search baseline for deployment configuration search.
- act-2023.md - Action Chunking with Transformers source for continuous robot action chunks and temporal ensembling.
- agentic-world-modeling-2026.md - Survey and taxonomy source for L1 predictors, L2 simulators, L3 evolvers, and physical/digital/social/scientific law regimes.
- atlas-2025.md - ATLAS test-time memory module and DeepTransformers family for optimized long-context memorization.
- awesome-agentic-time-series-2026.md - June 2026 curated repository and survey map for agentic time-series systems, benchmarks, memory, temporal world models, and reliability.
- bridge-2025.md - ICML 2025 text-controlled time-series generation source using multi-agent description refinement and diffusion/prototype conditioning.
- catsg-2025.md - Microsoft TimeCraft causal diffusion source for observational, interventional, and counterfactual time-series generation.
- diff-mn-2026.md - Continuous time-series generation source for irregular observations with diffusion-parameterized MoE-NCDE dynamics.
- diga-2026.md - AAAI 2026 oral financial market generation source using a diffusion-guided meta-agent for controllable order flow.
- invdiff-2025.md - KDD 2025 adjacent diffusion source for invariant guidance and unknown-bias mitigation.
- mars-2025.md - ICLR 2025 financial market simulation engine powered by order-level generative foundation models.
- mg-tsd-2024.md - ICLR 2024 multi-granularity diffusion source for probabilistic time-series forecasting.
- mira-2025.md - NeurIPS 2025 Microsoft medical time-series foundation model for irregular clinical forecasting.
- oats-2026.md - Online data augmentation method for TSFM pretraining using influence scores and guided diffusion.
- tardiff-2025.md - KDD 2025 target-oriented diffusion source for synthetic EHR time-series generation.
- timecraft-2025.md - Microsoft TimeCraft repository and blog source for time-series generation approaches.
- timedp-2025.md - AAAI 2025 prototype/domain-prompt diffusion source for cross-domain time-series generation.
- timeraf-2025.md - TKDE 2025 retrieval-augmented zero-shot time-series forecasting source.
- audio-interaction-model-2026.md - Context-level Audio-Interaction source for caveated silence/response triggering, heavy SoundFlow data construction, FIFO scheduling, and proactive audio intervention.
- bitter-lesson-data-filtering-2026.md - Stanford preprint showing that heuristic data filtering can help at low compute but lose to unfiltered Common Crawl at larger model/compute scales.
- bittokens-2025.md - IEEE 754 bit-level single-token number encoding for language-model numeracy.
- boom-2025.md - Datadog BOOM observability metrics forecasting benchmark.
- charm-2025.md - Channel-description-conditioned JEPA embedding model for multivariate time series.
- citylearn-2020.md - CityLearn Gymnasium environment and dataset schema for building energy coordination, load shaping, and demand response.
- ai-challenge-safe-low-carbon-grid-2025.md - Energy and AI source on the L2RPN 2023 IDF safe low-carbon challenge, 118-node scenarios, winning multimodal action engineering, and alert modules.
- active-power-correction-distributed-2021.md - Distributed multi-agent DRL source for active-power correction and adaptability in the L2RPN power-grid control lineage.
- adversarial-training-power-systems-2020.md - Adversarial robustness source for power-grid control under line-disconnection contingencies.
- conditional-autoencoders-electrical-consumption-2020.md - ECML PKDD source on conditional autoencoders for atypical conditions in electrical-consumption time series.
- expert-system-remedial-action-discovery-2018.md - Expert-system source for discovering topological remedial actions in smart grids.
- gibbs-priors-topology-control-2026.md - Physics-informed Grid2Op preprint using a GNN post-action overload-risk surrogate and Gibbs prior for topology-control action ranking.
- graph-neural-solver-power-systems-2019.md - IJCNN source for graph neural solver methods in power systems.
- graph-rl-power-grids-survey-2024.md - Energy and AI/arXiv survey mapping graph RL for power grids, Grid2Op evaluation pitfalls, and learned GNN surrogate planning.
- gnn-transmission-grid-topology-2025.md - TenneT/Radboud preprint on heterogeneous graph representations for Grid2Op transmission-grid topology control.
- grid-topology-reconfiguration-2020.md - Simple deep-RL baseline source for power-grid topology reconfiguration.
- guided-dropout-power-system-2018.md - Guided-dropout source for fast power-system security analysis across topology variants.
- guided-power-grid-segmentation-2017.md - Guided machine-learning source for topology-aware power-grid segmentation.
- l2rpn-challenge-retrospective-2021.md - PMLR competition-track source describing the NeurIPS 2020 L2RPN challenge and Grid2Op framework.
- l2rpn-topology-controllers-2020.md - PSCC/arXiv source framing L2RPN as a topology-controller training challenge.
- leap-net-power-grid-perturbations-2019.md - LEAP-net source for learning under power-grid structural perturbations.
- leap-nets-system-identification-2020.md - Neurocomputing/HAL metadata source for LEAP nets in system identification and power systems.
- line-flow-control-time-series-atcs-2019.md - IEEE/arXiv source for autonomous line-flow control through topology adjustment and early warning.
- machine-learning-power-system-operation-2017.md - Historical source introducing machine learning for power-system operation support.
- marl2grid-tr-2026.md - ICLR 2026 benchmark source for multi-agent Grid2Op topology and redispatch control with partial observability and safety constraints.
- neural-networks-power-flow-graph-neural-solver-2020.md - PSCC/EPSR source for graph neural power-flow solving.
- power-grid-alphazero-2022.md - L2RPN WCCI 2022 winning AlphaZero-style topology-optimization source.
- power-grid-contingencies-screening-2018.md - Fast neural-net screening source for power-grid contingencies.
- power-system-risk-assessment-2018.md - Source on allocating simulator budget for power-system risk assessment.
- rl2grid-2025.md - Grid2Op/RTE benchmark preprint for RL in power-grid operation; OpenReview status checked and marked withdrawn.
- soft-label-topology-actions-2025.md - ECML PKDD 2025 ADS source on soft-label GNN imitation learning from simulated topology-action outcomes.
- targeted-exploration-cascading-failures-2024.md - Climate Change AI/arXiv source using power-flow sensitivity factors for Grid2Op cascading-failure mitigation.
- winning-l2rpn-afterstate-actor-critic-2021.md - ICLR 2021 Spotlight source for the WCCI 2020 winning semi-Markov afterstate actor-critic agent.
- convergent-evolution-number-representations-2026.md - Number-representation study separating universal Fourier-spectrum spikes from functionally usable modular geometry.
- compress-attend-transformer-2025.md - Chunk-compressive Transformer architecture with a test-time quality/efficiency knob and an ICLR 2026 rejection caveat.
- comparing-transformers-hybrid-models-2026.md - Ai2 token-level comparison of Olmo 3 and Olmo Hybrid showing hybrid gains on state-conditioned meaning-bearing predictions and transformer strength on exact repetition and structural closure.
- compute-optimal-tokenization-2026.md - Meta FAIR / University of Washington scaling-law study arguing that tokenization changes should be compared in bytes per parameter rather than tokens per parameter.
- cookbook-self-supervised-learning-2023.md - Beginner-friendly survey and practical taxonomy of SSL methods, recipes, evaluation protocols, and implementation gotchas as of early 2023.
- cwm-2025.md - Meta FAIR Code World Model technical report for execution-trace and agentic-code action-observation training.
- diffusion-models-dont-memorize-2025.md - NeurIPS 2025 oral/Best Paper source on implicit dynamical regularization, diffusion generalization windows, and late memorization.
- diffusionblocks-2026.md - ICLR 2026 block-wise training framework from Sakana AI that turns residual networks into independently trainable diffusion-style denoising blocks.
- dmax-2026.md - DMax diffusion-language-model source for on-policy self-correction and soft parallel decoding, with released code, 16B checkpoints, and math/code trajectory datasets.
- illada-2026.md - iLLaDA masked diffusion language-model source, with 8B from-scratch training, 12T pre-training tokens, public weights, and an instruct-gap caveat versus Qwen2.5 Instruct.
- thinking-pixel-2026.md - Recursive Sparse Reasoning method for sparse latent-step refinement inside multimodal diffusion attention layers.
- gated-deltanet-2025.md - ICLR 2025 NVIDIA linear recurrent attention paper combining scalar gating with the delta rule for bounded associative-memory updates.
- gated-deltanet-2-2026.md - NVIDIA preprint on decoupling key-side erase and value-side write gates in linear recurrent attention, with code and matched 1.3B language-model experiments.
- diffusion-policy-2023.md - Robotics source for denoising future continuous action trajectories in a receding-horizon visuomotor policy.
- ebt-2025.md - Energy-Based Transformer paper using learned compatibility scores and gradient-based candidate refinement for scalable learning and inference-time thinking.
- embedded-language-flows-2026.md - MIT ELF preprint showing continuous embedding-space flow matching for language generation, useful as text-side evidence for multimodal diffusion/flow substrates.
- eidos-2026.md - Time-series foundation model family trained through latent-space predictive learning and SiGLU point-wise scalar tokenization.
- elt-2026.md - Elastic Looped Transformer source for parameter-efficient visual generation, ILSD loop-boundary supervision, and any-time loop-count inference.
- fast-2025.md - Frequency-space action tokenization method for making continuous robot action chunks compatible with autoregressive VLAs.
- exploring-large-models-time-series-2024.md - Tsinghua/THUML historical overview of early large time-series models, Timer, AutoTimes, Timer-XL, and OpenLTM.
- flowstate-2025.md - SSM-based time-series foundation model with a functional basis decoder for sampling-rate-invariant forecasting.
- fone-2025.md - Fourier Number Embedding method for precise single-token number representations.
- fprm-2026.md - Fixed-Point Reasoning Model source for pre-norm/residual-scaled looped Transformers with fixed-point halting.
- generative-recursive-reasoning-2026.md - GRAM source for stochastic multi-trajectory recursive reasoning, width-based inference scaling, and puzzle-focused constraint-satisfaction evidence.
- gemini-robotics-1-5-2025.md - Google DeepMind robotics source for embodied reasoning, Motion Transfer, and hierarchical VLA action execution.
- genie-2024.md - Google DeepMind ICML 2024 source for learning action-controllable visual world models from unlabeled videos via latent actions.
- gr00t-n1-2025.md - NVIDIA humanoid VLA source with a VLM System 2 and DiT/flow-matching System 1 action module.
- gqt-2025.md - Graph Quantized Tokenizer source for learned discrete graph vocabularies before Transformer processing.
- graph-tokenization-2026.md - ICLR 2026 graph tokenizer using reversible graph serialization plus BPE for standard Transformers.
- graphgpt-2025.md - ICML 2025 Graph Eulerian Transformer source for reversible graph-to-sequence pretraining.
- graphormer-2021.md - Classic graph Transformer baseline using centrality, shortest-path, and edge attention biases.
- io-aware-gnn-layers-2026.md - ICML 2026 Spotlight source and Turbo-GNN code for IO-aware GNN layer kernels, fused graph attention, degree-aware reductions, and cached cuSPARSE baselines.
- helix-2025.md - Figure AI technical writeup on a fast/slow humanoid VLA for continuous upper-body control.
- helix-02-2026.md - Figure AI follow-on writeup extending Helix to full-body humanoid loco-manipulation with S2/S1/S0 hierarchy.
- hierarchical-reasoning-model-2025.md - HRM recurrent fast/slow reasoning architecture for small-model puzzle and ARC-style tasks.
- hyperloop-transformers-2026.md - Looped Transformer with loop-level hyper-connections for parameter-efficient language modeling.
- hybrid-associative-memories-2026.md - Zyphra preprint on selective KV-cache growth where a recurrent state compresses predictable context and attention stores hard-to-predict tokens.
- illusion-of-superposition-2026.md - Latent-CoT interpretability source showing soft-token collapse, fine-tuned shortcutting, and limited from-scratch superposition.
- implicit-curriculum-hypothesis-2026.md - Under-review arXiv source proposing that LLM pretraining follows a stable compositional skill-emergence order readable from function-vector geometry.
- language-models-need-sleep-2026.md - Sleep-time memory-consolidation method for SSM-attention hybrids that loops before KV-cache eviction.
- latent-context-language-models-2026.md - Encoder-decoder soft-token context-compression family for long-context language models and compressed agent memory.
- latent-thought-flow-2026.md - LTF source for GFlowNet-trained variable-length continuous latent reasoning trajectories and efficient hidden CoT, with entropy/prior regularization caveats.
- looped-world-models-2026.md - LoopWM technical report applying recurrent-depth Transformers to action-conditioned world modeling, with spectral state retention, adaptive early exit, deferred decoding, and reproducibility caveats.
- lt2-2026.md - Linear-Time Looped Transformers source replacing full attention inside recurrent-depth loops with linear, sparse, or hybrid mixers, with released code and Ouro-hybrid-1.4B checkpoint.
- hidden-uniform-cluster-prior-2022.md - SSL analysis showing that volume-maximization and prototype methods can impose hidden uniform cluster priors that hurt long-tailed data.
- jepa-slow-features-2022.md - JEPA failure-mode analysis showing latent predictive objectives can focus on fixed slow distractors instead of action-relevant state.
- lejepa-identifiability-2026.md - LeJEPA identifiability theory proving Gaussian-latent state recovery up to rotation under OU-style assumptions, with author X narrative, project page, code, and Lean proof artifacts.
- learning-is-forgetting-2026.md - ICLR 2026 Information Bottleneck analysis of LLM training as lossy compression.
- llms-noisy-channels-2026.md - ICML 2026 source proposing the Shannon Scaling Law for LLMs as noisy channels, with SNR-aware fits for overtraining, SFT, and quantization degradation.
- llms-time-series-analysis-2024.md - Position paper on using LLM interfaces, modality switching, and question answering for time-series analysis.
- llms-use-fourier-features-addition-2024.md - Mechanistic analysis of Fourier features in pretrained LLM addition.
- mhc-2025.md - DeepSeek-AI constrained Hyper-Connections method for stable matrix-valued residual streams.
- neorl2-2025.md - NeoRL-2 near-real-world offline RL benchmark with explicit action-conditioned transition tuples.
- nextlat-2026.md - Microsoft Research preprint and code release adding a self-supervised next-hidden-state objective to autoregressive Transformers, with belief-state theory, compact world-model diagnostics, and self-speculative decoding evidence.
- no-filter-cultural-socioeconomic-diversity-2024.md - NeurIPS 2024 VLM source showing English-only filtering improves familiar benchmarks while reducing cultural and socioeconomic coverage.
- octo-2024.md - Open-source generalist robot policy with Transformer backbone and diffusion action head.
- openvla-2024.md - Open action-token VLA model for image/language-conditioned robot control.
- own-latents-not-tokens-2026.md - Sample-complexity theory arguing that own-latent prediction can recover hidden hierarchy at the local clustering scale on the Random Hierarchy Model.
- oryx-2026.md - Google/CMU Multi-Mixer/Oryx preprint on sequence-axis switching between attention and linear recurrent mixers with shared representations.
- pi0-2024.md - Physical Intelligence VLA flow model with a semantic VLM backbone and continuous action expert.
- pi0-7-2026.md - Steerable generalist VLA model using rich context, metadata, subgoal images, and a flow-matching action expert.
- raev2-2026.md - RAEv2 paper and X discussion on multi-layer representation autoencoders, REPA self-guidance, and action-conditioned navigation world-model rollouts.
- rdt-1b-2024.md - Robotics Diffusion Transformer source for scaled bimanual continuous action chunk generation.
- reconstruction-or-semantics-2026.md - Evaluation of reconstruction and semantic latent spaces for robotic diffusion world models.
- reinforcement-learning-small-subnetworks-2025.md - NeurIPS 2025 source showing RL post-training updates a sparse, full-rank, broadly distributed subnetwork while SFT updates more densely.
- rlpt-2025.md - Tencent/CUHK work-in-progress preprint on applying RL to pre-training text through next-segment reasoning rewards.
- rt-2-2023.md - VLA action-as-language source showing web-scale VLM transfer to robot action tokens.
- s4l-2019.md - ICCV 2019 oral source combining self-supervised and semi-supervised image learning, with careful label-scarce ImageNet baselines and Alex-provided Lucas Beyer X context.
- scaling-law-time-series-forecasting-2024.md - Theory and experiments for scaling laws in time-series forecasting with look-back horizon as a scaling variable.
- scaling-laws-carefully-2026.md - Lilian Weng’s scaling-law synthesis and X announcement, useful as a method-hygiene anchor for compute-optimal allocation, data-limited scaling, and fixed-FLOPs training experiments.
- scaling-laws-large-time-series-models-2024.md - Empirical power-law scaling evidence for decoder-only time-series foundation models.
- scaling-test-time-compute-agentic-coding-2026.md - Agentic-coding test-time scaling source showing structured rollout summaries outperform raw traces for selection and reuse.
- self-teaching-autoencoder-2026.md - Blog/code/demo source for transformed latent-consistency autoencoder training without direct image-space reconstruction loss.
- sensorimotor-world-models-2026.md - Inverse-dynamics-regularized JEPA world model that preserves action-relevant controllable state and filters action-irrelevant distractors.
- stable-worldmodel-2026.md - Platform source for reproducible JEPA/world-model research, standardized trajectory data handling, MPC solvers, and factor-of-variation evaluation.
- skyjepa-2026.md - JEPA-style latent dynamics and physics-inspired prober for real-time zero-shot sim-to-real quadrotor control.
- synthetic-data-any-differentiable-target-2026.md - Stanford DPG preprint showing metagradient-optimized synthetic text can steer downstream model weights and differentiable metrics through ordinary SFT, with clean-label poisoning implications.
- superhuman-adaptable-intelligence-2026.md - Position paper arguing that AGI terminology should be replaced by specialization plus adaptation speed, with SSL, world models, latent prediction, and modularity as likely substrates.
- tabm-2024.md - MLP-based tabular deep-learning model with parameter-efficient ensembling and numerical feature embeddings.
- tennessee-eastman-process-2017.md - Rieth et al. Tennessee Eastman Process simulation data for industrial anomaly detection and fault diagnosis.
- tiny-recursive-model-2025.md - TRM minimalist recursive reasoning model that simplifies HRM with a single tiny network.
- turboquant-2025.md - ICLR 2026 online vector quantization method for KV-cache and vector-search state; vLLM critique narrows production value to memory-pressure cases versus FP8.
- universal-weight-subspace-hypothesis-2025.md - Johns Hopkins preprint and code arguing for reusable low-rank weight subspaces across model families, with a tracked mean-adapter baseline caveat.
- variable-width-transformers-2026.md - MIT / MIT-IBM preprint introducing the
><formerstatic bowtie layer-width Transformer, with lower language-model loss, fitted FLOPs, and KV-cache width than uniform baselines. - vla-jepa-2026.md - VLA pretraining source using leakage-free JEPA-style latent state prediction, latent-action tokens, and a flow-matching robot action head.
- visreg-2026.md - SIGReg-family visual SSL regularizer that decouples variance scale and Sliced-Wasserstein shape matching for JEPA training.
- world-model-robot-learning-survey-2026.md - 2026 robot-learning world-model survey separating policy coupling, simulator/evaluator roles, robotic video generation, evaluation, datasets, and open challenges.
- training-in-imagination-2026.md - Theory source for training policies in learned world models with separate dynamics/reward errors, sample-budget allocation, and reward-noise versus reward-bias hygiene.
- time-hd-2025.md - Time-HD high-dimensional time-series forecasting benchmark introduced with U-Cast.
- titans-2025.md - Titans neural long-term memory architecture for learning to memorize context at test time.
- tokengt-2022.md - TokenGT source for treating graph nodes and edges as ordinary Transformer tokens.
- topological-neural-operators-2026.md - Topological Neural Operators preprint extending neural operators from point/edge functions to cochain-valued fields on cell complexes with DEC-based cross-rank coupling.
- toto-2-tsalm-2026.md - TSALM @ ICLR 2026 presentation transcript and slides for Toto 2.0 scaling, training recipe, data mix, ARFBench, Toto-1.0-QA-Experimental, and observability world-model roadmap.
- universal-transformers-2018.md - Universal Transformer root source for recurrent-depth self-attention and adaptive per-position halting.
- universal-transformers-need-memory-2026.md - Study of memory tokens and ACT depth-state tradeoffs in Universal Transformer recursive reasoning.
Normal Sources
Read
- perception-encoder-2025.md - Meta Perception Encoder paper showing strong visual embeddings can be hidden in intermediate layers and exposed through alignment tuning.
- reinpatch-2026.md - Reinforcement-trained adaptive patcher for time-series forecasting and zero-shot patch-policy transfer.
Skimmed
- atst-2023.md - Audio Teacher-Student Transformer for clip-level and frame-level self-supervised audio representations.
- chronos-2-2025.md - Universal forecasting extension of Chronos with grouped time series, covariates, and cross-series in-context learning.
- graph-distributed-rl-grid-control-2025.md - Preprint on graph-based distributed RL for Grid2Op using line-level agents, a high-level manager, GNN local observations, and imitation learning.
- fade-2026.md - FADE adaptive per-parameter weight-decay method for controlled forgetting in continual learning.
- fast-slow-training-2026.md - Fast-Slow Training method for LLM continual adaptation using prompt/context fast weights and parameter slow weights.
- kairos-2025.md - Adaptive time-series forecasting model family with benchmarked 10M, 23M, and 50M variants.
- mantis-2025.md - Lightweight calibrated foundation model for user-friendly time-series classification.
- mantisv2-2026.md - Synthetic-data and test-time-strategy extension of Mantis for zero-shot time-series classification.
- moirai-2-2025.md - Smaller Moirai 2.0 forecasting model emphasizing efficiency and calibration.
- moirai-2024.md - Universal time-series forecasting Transformer family trained across heterogeneous series.
- moirai-moe-2024.md - Sparse mixture-of-experts extension of Moirai for time-series forecasting.
- molmo-pixmo-2024.md - Open-weight and open-data VLM family and data engine from Allen AI.
- moment-2024.md - Open time-series foundation-model family for forecasting, classification, and representation learning.
- moshi-2024.md - Kyutai full-duplex speech-to-speech model with Mimi streaming codec, Inner Monologue text stream, low-latency serving, and temporal artifact metrics.
- nutime-2023.md - Numerically multi-scaled embedding method for large-scale time-series pretraining.
- pretrained-transformers-universal-computation-engines-2021.md - Frozen language-pretrained Transformers transferred to non-language sequence tasks.
- interpretable-policy-distillation-grid-control-2026.md - Preprint distilling a Grid2Op PPO topology-control teacher into auditable tree-based policies.
- llm-guided-safe-rl-grid-topology-2026.md - Exploratory preprint on Safety-SAC plus LLM-guided transition refinement for Grid2Op-style topology reconfiguration.
- reverso-2026.md - Efficient zero-shot forecasting model centered on compact recurrent-style sequence modeling.
- runtime-safety-shielding-power-grid-2026.md - Preprint on hierarchical Grid2Op control with runtime forward-simulation safety shielding.
- rwkv-ts-2024.md - RWKV-style recurrent backbone adapted to time-series forecasting and related passive tasks.
- simmtm-2023.md - Multi-neighbor masked time-series modeling framework for forecasting and classification pretraining.
- stochastic-sharpness-gap-2026.md - SGD edge-of-stability theory source explaining batch-size-dependent sharpness gaps through projected gradient-noise variance.
- sundial-2025.md - THUML time-series foundation-model family for forecasting across heterogeneous tasks.
- t2s-2025.md - Text-to-time-series generation model using LA-VAE and flow-matching Diffusion Transformer.
- t-loss-2019.md - Scalable unsupervised representation learning baseline for multivariate time series.
- tabicl-2025.md - Tabular in-context learning model that scales row-wise context beyond small-data TabPFN settings.
- tabpfn-3-2026.md - Prior Labs technical report for TabPFN-3, its Thinking/API variants, and TabPFN-TS-3.
- tabpfn-v2-2025.md - Tabular prior-data fitted network for fast small-data classification and regression.
- telecomts-2025.md - Multimodal 5G observability dataset with scale-preserving KPI time series, anomaly/root-cause labels, and language Q&A fields.
- tempopfn-2025.md - Synthetic-pretrained linear RNN prior-data fitted network for zero-shot forecasting.
- time-moe-2024.md - Billion-scale mixture-of-experts time-series foundation-model family.
- timer-2024.md - Generative pretrained Transformer line framing time-series forecasting as large sequence modeling.
- timesfm-2023.md - Decoder-only forecasting foundation model from Google Research.
- tiny-time-mixers-2024.md - Compact pretrained MLP-mixer forecasting models for zero-shot and few-shot use.
- tirex-2025.md - Zero-shot forecasting model using enhanced in-context learning across short and long horizons.
- tivit-2025.md - Time-series classification via frozen vision-model hidden representations.
- ts2vec-2021.md - Hierarchical contrastive time-series representation learning with timestamp-level embeddings.
- tsmixer-2023.md - All-MLP time-series forecasting architecture that mixes over time and feature dimensions.
- toto-2-2026.md - Datadog article announcing the Toto 2.0 open-weights forecasting model family and scaling results.
- toto-2025.md - Observability-oriented time-series foundation model from Datadog.
- unitime-2023.md - Early language-instruction-conditioned cross-domain time-series forecasting model.
- units-2024.md - Unified multi-task time-series model using task tokenization and shared weights.
- unishape-2026.md - Shape-aware foundation model for time-series classification.
- utica-2026.md - Multi-objective self-distillation pretraining method for time-series classification.
- wavspa-2022.md - Wavelet-space attention method for long-sequence Transformers.
- varying-grid-topology-2022.md - IEEE ENERGYCON metadata-only source for an early Grid2Op learned GCN line-loading surrogate plus MCTS planning precedent.
Not Read
- anomod-2026.md - Multimodal microservice anomaly-detection and root-cause-analysis dataset with logs, metrics, traces, API responses, and code coverage.
- chronograph-2025.md - Graph-structured multivariate microservice time-series dataset with temporal node/edge features and incident labels.
- huginn-2025.md - Recurrent-depth language model scaling test-time compute through latent reasoning loops.
- latent-thoughts-2025.md - Looped Transformer reasoning source connecting repeated depth to latent thoughts.
- loopformer-2026.md - Elastic-depth looped Transformer trained for budget-conditioned latent reasoning.
- mesanet-2025.md - Mesa layer sequence model using locally optimal test-time training with conjugate-gradient updates.
- miras-2025.md - Associative-memory framework for test-time memorization, attentional bias, retention, and online optimization.
- parallel-samplers-recurrent-depth-2025.md - Parallel sampler connecting recurrent-depth models to diffusion language models.
- parcae-2026.md - Stable looped language-model architecture with scaling-law analysis.
- recurrent-transformer-2026.md - Transformer variant with layerwise recurrent memory for greater effective depth and efficient decoding.
- sparse-layers-looped-language-models-2026.md - Looped-MoE scaling and early-exit source for looped language models.
- titans-revisited-2025.md - Lightweight Titans reimplementation and critical analysis across language, time-series, and recommendation tasks.
- universal-reasoning-model-2025.md - UT-derived recursive reasoning model for ARC-AGI and Sudoku-style tasks.
- gaia-micross-2021.md - GAIA AIOps dataset collection with MicroSS metrics, traces, logs, and anomaly-injection records.
- gift-eval-2024.md - Salesforce GIFT-Eval general time-series forecasting benchmark and leaderboard.
- lemma-rca-2024.md - Large multi-modal multi-domain root-cause-analysis dataset collection spanning IT and OT operations.
- openrca-2025.md - LLM-agent root-cause-analysis benchmark over natural-language queries, KPI time series, trace graphs, and logs.
- ops-lite-2026.md - Compact RCA evaluation set with per-case causal-graph ground truth for microservice systems.
- rcaeval-2025.md - Microservice RCA benchmark and evaluation framework with RE1/RE2/RE3 datasets and reproducible baselines.
- time-2026.md - TIME contamination-resistant zero-shot forecasting benchmark.
- learning-from-leading-indicators-2024.md - LIFT plugin for local lead-lag channel dependence in multivariate forecasting.
- t-rep-2023.md - Self-supervised timestep-level time-series representation learning with learned time-embeddings.
- time-series-forecasting-manifold-learning-2021.md - Embed-predict-lift manifold-learning approach for high-dimensional time-series forecasting.
- evolution-strategies-at-the-hyperscale-2025.md - EGGROLL low-rank perturbation method for hyperscale ES.
- evolution-strategies-scalable-alternative-2017.md - OpenAI ES baseline showing scalable black-box policy optimization.
- evolutionary-strategies-catastrophic-forgetting-2026.md - Catastrophic-forgetting stress test for ES-based LLM fine-tuning.
Context Sources
Skimmed
- world-model-autonomous-power-system-control-2021.md - IEEE SmartGridComm metadata-only context source for WMAP, a non-Grid2Op power-system world-model and safety-shield architecture.
Not Read
- yahoo-contextual-bandit-2010.md - Yahoo! news recommendation contextual-bandit logs and evaluation method.
- amsterdamumcdb-2021.md - European ICU database with longitudinal observations, medications, fluids, and procedures.
- assistments-2009.md - ASSISTments student interaction data with hints, attempts, and tutoring-event sequences.
- causalworld-2020.md - Robotic manipulation benchmark for causal structure and transfer learning.
- criteo-uplift-2018.md - Marketing treatment/control dataset for uplift and treatment-effect modeling.
- d4rl-2020.md - Offline RL benchmark suite of state-action-reward trajectories.
- ednet-2019.md - Large-scale hierarchical student activity sequence dataset.
- eicu-crd-2018.md - Multi-center ICU database with longitudinal treatments and observations.
- heartsteps-2019.md - Mobile-health micro-randomized intervention data for activity suggestions.
- hirid-2020.md - High-resolution ICU time-series dataset with treatment/event records.
- kdd-cup-2010.md - Student-performance prediction dataset from intelligent tutoring logs.
- kuairand-2022.md - Sequential recommendation dataset with randomly exposed videos.
- mimic-iv-2023.md - Clinical EHR/ICU database with longitudinal measurements, orders, procedures, and treatments.
- ohio-t1dm-2018.md - Type-1 diabetes longitudinal glucose, insulin, meal, and activity dataset.
- open-bandit-dataset-2020.md - Logged bandit feedback dataset and pipeline for off-policy evaluation.
- pslc-datashop-2010.md - Learning-science repository with student/tutor event logs.
- rl-unplugged-2020.md - Offline RL benchmark suite built from logged transitions.
- causal-chambers-2024.md - Real physical systems with known causal structure and interventional data.
- bridge-data-v2-2023.md - Real-robot manipulation dataset used for language-conditioned policies and robotic world-model evaluation.
- droid-2024.md - In-the-wild robot manipulation dataset with synchronized visual observations and language annotations.
- open-x-embodiment-2023.md - Multi-embodiment robot-learning dataset and RT-X model source.
- roboturk-2018.md - Crowdsourced 6-DoF teleoperation platform and manipulation demonstration dataset.
- time-series-library-2024.md - THUML Time-Series-Library benchmark collection used as the LSF/LTSF handle.