869 private links
A sundry of optimization techniques to transformer models to reduce the computation complexity associated with longer context.
In short, "ne" is the negation word, but "pas" originally means "step" (or "a small step"). "Je ne mange pas." originally mean "I didn't eat a little". The form then evolve into standard way of expression negation.
This discussion leads me to this article: https://en.wikipedia.org/wiki/Jespersen%27s_Cycle.
Jespersen's Cycle describe the historical development of the expression of negation: from a simple pre-verbal marker of negation, through a discontinuous marker (elements both before and after the verb) and in some cases through subsequent loss of the original pre-verbal marker.
It's interesting to note that English underwent the similar transition (e.g. "I ate not today") but now it ended up back to the first stage.
A figure of speech that uses negation to convey understatement. For example, one may say "It's not a masterpiece." instead of "It's mediocre."
SQLite replication through a s3-compatible storage. This seems like a good enough solution to many use cases while being a lot simpler.
This is enshittification: surpluses are first directed to users; then, once they're locked in, surpluses go to suppliers; then once they're locked in, the surplus is handed to shareholders and the platform becomes a useless pile of shit. From mobile app stores to Steam, from Facebook to Twitter, this is the enshittification lifecycle.
Enshittification is the new word I learned today. Beyond that, it's a really nicely written post against Reddit enshittification and advocate for diversification.
A technical article on how to run large scale models efficiently on CPU.
A comprehensive guide and links to models for playing with stable diffusion.
RARBG archive in SQLite served on IPFS, powered by sql.js-httpvfs library. Aside from being a useful tool, it may also be interesting to study the code.
A tool for editing magnet link and torrent files.
An article about tools and techniques used in wireless reverse-engineering.
Internal mechanisms of a TCP connection.
The article explained the working of VoIP in simple words. I'm not interested in building a personal VoIP system, but it's good to learn about the unfamiliar terminologies like SIP, ALG, DID, etc, which I saw on my modem. Now I feel more confident to I turn off ALG and other stuff.
A guide on how to create a network namespace, bind interfaces, set routes, and run programs in it.
An article on dithering techniques.
A really innovative way to store exact floating point numbers:
- for "safe numbers" (numbers whose value can be expressed precisely in floating point), store them as is
- for non-"safe numbers", store two safe numbers as denominator and nominator.
There is a lot of this method comparing to the other alternatives:
- BigDecimal: a lot faster than arbitrary precision BigDecimal
- Rational: denom and nom deoesn't blow up to extremely large numbers
And it is also faster and uses less space.
Nice visualization of dynamic math. Attractors, vector fields, fractal, flocking, and more.
An actually informative guide on prompt engineering. It talks about how to communicate format, prompt injection, how to prompt hack, etc.
What are the simple questions to ask that exploit the limitation of LLM? Interesting examples.
Disposable email service. Similar to temp-mail.org but doesn't have the Cloudflare traffic check, so it works even with VPN on.
De-DRM audible audio books.
Alternative URLs: