Skip to content

#Research

1 today

Jan 10

Saturday
  1. Information-Driven Design of Imaging Systems

    Berkeley AI Research proposed a mutual-information framework to evaluate and optimise imaging from noisy measurements and noise models. A NeurIPS 2025 paper validates decoder performance predictions for colour photography, radio astronomy, lensless imaging and microscopy. Designs match end-to-end state-of-the-art approaches with less memory and compute, without task-specific decoder design.

Nov 1

Saturday
  1. RL without TD learning

    Berkeley AI Research proposed a divide-and-conquer off-policy reinforcement learning algorithm without temporal-difference (TD) learning. It reduces Bellman recursions from linear to logarithmic counts, scaling to long-horizon tasks.

Sep 1

Monday
  1. What exactly does word2vec learn?

    Berkeley AI researchers proposed the first theory quantitatively predicting word2vec learning. Under realistic training conditions, it reduces to unweighted least-squares matrix factorisation with a closed-form gradient-flow solution, and the resulting representation is equivalent to PCA of target matrix M*. From small initialisation, word2vec learns orthogonal linear subspaces in discrete steps, increasing embedding rank and reducing loss. These features are M*'s leading eigenvectors and can be calculated in advance from corpus statistics and hyperparameters.