Links, bookmarks, and some notes

2024

June 2024

2024-06-11

• One World Optimization Seminar in Vienna (2024). #optimization
• Cosma's notebooks. #homepage
• Alan U. Kennington. Writing a wtf 2000p books on differential geometry. #homepage #geodiff

2024-06-10

• leits/MeetingBar. menu-bar app for your calendar meetings. #macos
• Advanced Topics In Statistical Machine Learning by Tom Rainforth (Oxford). #ml #lecture-notes
• Probability by Tomasz Tkocz (CMU). Nice set of graduate notes on probbility. #probability #lecture-notes
• Let's reproduce GPT-2 (124M) by Andrej Kaparthy (Zero to Hero serie) via twitter. #llm

2024-06-09

• Scratchapixel. (Recently?) updated tutorial on computer graphics. #graphics
• Scalable MatMul-free Language Modeling (2024) by Zhu et al. Seems similar toMultiplication-Free Transformer Training via Piecewise Affine Operations (2023) by Kosson and Jaggi. #llm

2024-06-07

• huggingface/llm-vscode. LSP server for LLM (OpenAI or llama.cpp). #llm
• Lecture notes on rough paths and applications to machine learning (2024) by Thomas Cass and Cristopher Salvi. Around 100 pages going from controlled differential equations to machine learning applications (essentially Neural C/O/RDE). #rough-paths #neural-ode
• σ-GPTs: A New Approach to Autoregressive Models (2024) by Arnaud Pannatier, Evann Courdier, and François Fleuret. Basic idea: no fix order in the sequence, but keep an autoregressive model beyond that. via hn #llm
• The Variational Formulation of the Fokker--Planck Equation (1998) by Richard Jordan, David Kinderlehrer, and Felix Otto. Variational scheme converging to the solution of the Fokker-Planck equation. #fokker-planck
• CARTE: Pretraining and Transfer for Tabular Learning (2024) by Myung Jun Kim, Léo Grinsztajn, Gaël Varoquaux. Deep model for tabular data using graph representation (GAT behind). #tabular
• Everyone Should Learn Optimal Transport, Part 1 quick review of OT for ML. #optimal-transport
• Michael Fogleman insane set of projects such as a sdf builder, a voxel engine. #homepage

2024-06-06

• How I learned Vulkan and wrote a small game engine with it via hn. Semi-long post-mortem on learning Vulkan. Mention in particular vkguide. #graphics #vulkan
• Fast randomized least-squares solvers can be just as accurate and stable as classical direct solvers (2024) by Ethan N. Epperly, Maike Meier, Yuji Nakatsukasa. Stochastic LS solver supposed to be a dropin replacement of QR-based methods. #randomized-la
• Lecture Notes in Probabilistic Diffusion Models (2023) by Inga Strümke, Helge Langseth. Quick intro to diffusion models. #ddm
• nikitabobko/AeroSpace. Tiling manager for macOS (yubai style but without desactivation of SIP). #macos

2024-06-05

• tosh. Scratch text-based editor. #scratch
• jordanbaird/Ice. Bartender replacement. #macos

2024-06-04

• Generalization Bounds for Heavy-Tailed SDEs through the Fractional Fokker-Planck Equation (2024) by Benjamin Dupuis and Umut Şimşekli. Heavy tails seems to lead to a fractional FP equation. #fokker-planck #heavy-tails
• Patrick Kidger. Researcher at Google, working especially on Neural C/O/RDE. #homepage #neural-ode
• while True: learn(). Game where you play a cat that learns to code. #gaming
• Art Owen. Terrific book on Monte Carlo methods. #monte-carlo
• Nicholas Carlini. Researcher at Google Brain, working on adversarial robustness. #homepage #security
• Ask HN: Could you share your personal blog here?. List of personal blogs. #homepage

2024-06-01

• RetroDiffusion by AstroPulse. Generating pixel art with diffusion model. #ddm #pixel-art
• David Tong. Huge set of lecture notes in theoretical physics (from Newtonian dynamics to QFT). #physics

May 2024

2024-05-31

• Tweet of Peyman Milanfar on Tweedie's formula. #denoising
• List (X) of talks on normalizing flows. #normalizing-flows
• Introduction to Probabilistic Graphical Models and Deep Generative Models-MVA by Pierre-Alexandre Mattei and Pierre Latouche. #ddm

2024-05-30

• Understanding Transformer Reasoning Capabilities via Graph Algorithms (2024). #transformers-theory
• Using LaTeXML to convert your latex files to accessible html - HackMD. Tutorial on using LaTeXML. #latex
• Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations (2024). Do we need cosine scheduler? via twitter. #optimization
• delve. Fun experiment to explore connection between notions. via hn. #llm
• What We Learned from a Year of Building with LLMs (Part I). via hn. #llm
• Ray Tracing with Voxels in C++ Series – Part 1 – Jacco’s Blog by Jacco Bikker. Series on ray tracing with voxels. #graphics #ray-tracing
• How Do Transformers Learn Topic Structure: Towards a Mechanistic Understanding (2023) by Yuchen Li, Yuanzhi Li, Andrej Risteski. #transformers-theory
• Antonin Carette. Lots of post on graphics. #homepage #graphics

2024-05-28

• Masterclass by Nilaus - Master book - Factorio Blueprint. Factorio blueprint book for 2-rails city block. #factorio
• The effect of smooth parametrizations on nonconvex optimization landscapes | Mathematical Programming (2024) by Eitan Levin, Joe Kileel & Nicolas Boumal. Transform a nonsmooth problem into a smooth one. #optimization
• potamides/DeTikZify. TikZ generator (MCTS-based) + dataset with associated paper DeTikZify: Synthesizing Graphics Programs for Scientific Figures and Sketches with TikZ (2024) by Jonas Belouadi, Simone Paolo Ponzetto, Steffen Eger. #tikz #rl
• Getting Started In Computer Graphics. #graphics
• Emacs GTD flow evolved. #gtd #orgmode #emacs
• Écriture, relecture et publication multi-formats d’une thèse avec Quarto. #quarto
• Converting LaTeX to HTML: technical notes – Richard Zach. #latex

2024-05-26

• Tony Zorman. An auctex contributor. #homepage #emacs
• Show HN: I built an Obsidian plugin to create notes from BibTeX. #obsidian

2024-05-24

• ItzCrazyKns/Perplexica. Open source alternative to perplexity.ai. #llm
• Deep linear networks for regression are implicitly regularized towards flat minima (2024) by Pierre Marion, Lénaïc Chizat. #sharpness-ml

2024-05-23

• 10 Books Full of Rails. Whole set of rails blueprints. #factorio

2024-05-21

• Bento3D. 3D printable dividers (presentation) via hn. #3dprint
• ImageOptim/gifski. Highest-quality GIF encoder based on pngquant. #gif
• Breck's Blog. Lots of interesting stuff on writing. Scroll notation. #homepage
• Writing by Bob Doto. #homepage #zettelkasten

2024-05-19

• Working with Jumbo/Unity Builds (Single Translation Unit) - Austin Morlan (via hn). #cpp

2024-05-17

• 3,000 Best Free Movies on YouTube Playlist. #movies
• N-Dimensional Gaussians for Fitting of High Dimensional Functions (2024) by Stavros Diolatzis, Tobias Zirr, Alexandr Kuznetsov, Georgios Kopanas, Anton Kaplanyan. Going beyond 2d/3d gaussian splatting. #gaussian-splatting

2024-05-16

• yklcs/jaxsplat. 3D Gaussian Splatting in JAX (via reddit). #gaussian-splatting
• Llama 3 implemented in pure NumPy · The Missing Papers via (hn). #llm

2024-05-15

• Discovering Small GitHub Projects for Contributing to FOSS. Find software that have a small impact and contribute to them in any way. #foss
• Developing mathematical software in C. #c
• Blog @ tonsky.me programming blog. #homepage