Best of all, that really is something LLMs are quite good at too. Aikido has a feature where you whitebox pentest your entire application.

Ikr, think of the shareholder value that is being created.

To expand on this, using tokens as a unit of billing is quite reasonable as it is also the unit of (inference) cost for LLMs.

The inference is essentially nothing but a loop of “Hey if the first X tokens are this, what would token X+1 most likely be?” until the LLM says its done. Every single loop is a ton of math which, on ridiculoudly expensive hardware, uses electricity and produces heat. So its a combination of those costs, and then we haven’t even taken into account the cost to train the model.

There still are email clients that allow setting the from: field, in fact there’s nothing in the base mailing protocol stopping you from doing so. However there are validation layers on top now that block such shenanigans.

We have a few dgx sparks in the office that are gathering dust right now because nobody wants to bother with them (and because IT doesn’t allow them on the network because Linux is scary so they’re a pain to get set up).

Matching the level of productivity of frontier models on the local models is possible to a limited degree (depending on the exact task), but takes getting used to. For the local models you have to lean into the fact that tokens are ‘free’ so its fine to burn a lot of them. (Whereas with frontier models the recommendation is to take a higher model for complex tasks because a lower would take more tries to get it right)

On windows there a program called ‘Everything’ that instantly finds files on your computer. Why windows doesn’t use the same method of searching? Who knows

MaM tightened their invite forum requirements quite a bit. They ‘found out’ that a ton of users were just there to use it as a springboard.