A LLM uncensoring technique by finding the embedding direction of refusals in the residual stream outputs. One can choose to negate the refusal direction in the output to block the representation of refusals.

More on LLM steering by adding activation vectors: https://www.lesswrong.com/posts/5spBue2z2tw4JuDCx/steering-gpt-2-xl-by-adding-an-activation-vector

A non-traditional neuron network architecture where the activation functions are trained instead of fixed as in multi-layer perceptron (MLP). The output of the activation functions are merely summed in each layer. Each of the activation function is described as a linear combination of basis functions where the coefficients are trained.

Read https://github.com/GistNoesis/FourierKAN/ for a simple implementation of the core idea. See further discussion at https://news.ycombinator.com/item?id=40219205.

This approach originates from the question: how much does the architecture compared to the weights that affect the performance of a neuron network?

This article describes a non-traditional machine learning approach: using genetic algorithm to find NN architectures optimized for 1) weight-agnostic and 2) least complex. The resulting architecture works for a wide range of weight shared across the nodes.

An IDE and debugger for the esoteric programming language Piet.

In-depth and low-level knowledge about GPU.

Normally when we implement ray tracing, each ray of light carries a RGB vector. Spectral Ray Tracing is the technique of instead of treating a ray of light as a particle in a straight line, the algorithm treats light as a wave spectrum - spectral power distribution (SPD). This allows more realistic rendering such as dispersion, diffraction, etc.

A 4-part writeup on how GPS works and how to implement a GPS receiver: I/Q data, asynchronous CDMA, GPS C/A and P code, Heterodyne demodulation, etc.

Even life as simple as virus has evolved mechanism of cooperation and competition - on a molecular level. Amazing!

Search images from Reddit and Instagram by semantic meaning or a similar image.

A comprehensive list of frequently seen concepts in electronics.

Netfilter TPROXY target explained.

The part most interest me is how to use Linux network namespace to experiment with network layouts on the same machine.

They look really fun!

Tool to draw/generate funnel diagram from textual input. "Came in a fluffer" style.

Valuable SQLite tips for the use on a production servers.

Chemotaxis is a great slice: it’s a triumph of systems biology—we understand it holistically but also in fine detail at almost every level.

A nice explainer of the JTAG protocol. JTAG started as a protocol for testing connectivity between pins of ICs on a circuit board.

TIL signed distance field. First I need to explain the concept of alpha testing. Alpha testing is a rendering technique for textures. It dictates that when rendering a texture, perform a test on the alpha value of that pixel against a threshold. Completely throw out or keep the data depending on the comparison result. Typically the alpha value for each pixel is set to the actual transparency of the pixel. This signed distance field method calculates the signed distance of each pixel to the nearest color pixels. The signed instance field is then saved in alpha channel in the texture. All the remaining alpha-testing mechanism is the same. It's claimed that this technique improves the rendering quality of low-resolution textures drastically.

Read the original paper: https://steamcdn-a.akamaihd.net/apps/valve/2007/SIGGRAPH2007_AlphaTestedMagnification.pdf

An interactive cheatsheet for the GPIO pins on Raspberry Pi.

Also check out https://microbit.pinout.xyz/ for the GPIO pins for BBC micro:bit.

What Hyperbole does is to add actions to textual patterns.