Martin Loretz

Martin Loretz

Hey, I'm just a human trying to figure out how this universe works. I love engineering and building stuff, like a computer out of logic gates, a screaming plant or a motorized bobbycar. I'm interested in physics, rockets, artificial intelligence and molecular biology.


@martinloretzzz
@martinloretzzz
xxxx@xxxxxxxxxxxx.com

Blog

Polynomials as weights and activations for MLP's

03/05/2024 - I recently read the Kolmogorov-Arnold Networks paper and I'm fascinated by the idea of moving from fixed activations on the nodes of a MLP to learned ones at the edges. Combined with some other thoughts, I applied this idea to image classification and in this process came up with the idea of polynomial MLP's.

Random thoughts:

@martinloretzzz
Martin Loretz @martinloretzzz · May 17, 2023
Engineering is the fight against complexity.
@martinloretzzz
Martin Loretz @martinloretzzz · Dec 8, 2023
If you shake a box of lego long enough, at some point it will be assembled by chance.
@martinloretzzz
Martin Loretz @martinloretzzz · Aug 16, 2023
Does schrödingers cat observe itself being dead and alive?
@martinloretzzz
Martin Loretz @martinloretzzz · Apr 05, 2024
Life 4.0 will be able to rewrite the universe by exploiting the simulation and changing the rules of physics.
@martinloretzzz
Martin Loretz @martinloretzzz · Jun 17, 2023
I think turing was right in the sense that if you can't tell a difference, there is no difference.
@martinloretzzz
Martin Loretz @martinloretzzz · Dez 10, 2023
The universe is a computer built to compute itself.
@martinloretzzz
Martin Loretz @martinloretzzz · Nov 20, 2022
We need to build factories the same way we build computers: Software defines what is done, not hardware.

Stuff worth checking out:

The singularity is nearer - George Hotz
The Cook and the Chef: Musk's Secret Sauce - Tim Urban/Wait But Why
The Bitter Lesson - Rich Sutton
How to Get Rich - Naval
Life 3.0 - Max Tegmark
Micrograd - Andrej Karpathy
Hacking the Simulation & Learning to Drive with Neural Net - George Hotz/Lex Fridman Podcast#132
Moore's Law, Microprocessors, and First Principles - Jim Keller/Lex Fridman Podcast#70

Cool stuff I've built:

happyswing
happyswing
A huge swing that generates music and light effects, depending on how crazy you swing.
Three Body Problem
Three Body Problem
A simulation of the three body problem to explore how different initial conditions and why it's differential equation is unsolveable.
Project 8Bit
Project 8Bit
A turing complete, programmable 8 bit computer built from logic chips.
Electric bobbycar
Electric bobbycar
An electrically motorized bobbycar that drives 25km/h.
LedHoodie
LedHoodie
An hoodie with 2 led strips built in that syscronized to the music.
Screaming plant
Screaming plant
A plant that screams when it needs to be watered.
Homemade commabody
Homemade commabody
A self balancing robot based on commaai openpilot.
Space Invaders
Space Invaders
2.5D space invaders made in Jave + LWJGL.
© 2024 Martin Loretz - Imprint - Privacy