High Entropy & KL Divergence Token Masking for SFT

Truly love your content while I am fine tuning my agent ux/ui I am incorporating alot of your content and my agent is becoming more natural and easy to deal with. Still having some memory issues and issues with utilization of all systems. Some of it is constantly degraded and unsure how to tighten it all up.... still working. And thank you.

Great stuff, I often spend a lot of time trying to learn from the images, but when the AI images of "improvised" formulas that are simply "wrong" with labels that are simply "wrong", it makes it harder. It takes some extra work, but making sure those details are correct is important.

It seems the benchmarks are not measuring the behavior the model is actually optimizing for. If the objective is to prevent catastrophic forgetting, the evaluation should include tasks that are specifically designed to cause or known to cause catastrophic forgetting; otherwise, the benchmark may fail to capture whether the objective is being achieved.

This would have been nice to have 3 years ago.

Welcome to LoRA

❤ definitivamente no deberían de usar eso como cimentación de sus modelos sino como forma de expresión e integración de expresiones para los modelos y ya fuera de eso no parece un parámetro útil