Karpathy: Context Windows are a cheap way to manupilate AI

Karpathy: Context Windows are a cheap way to manupilate AI

Andrej Karpathy: "The science of manipulating the brains isn't fully developed yet." He explains that context windows are a cheap way to manipulate AI, but fine-tuning or customizing a model without losing its capabilities is a lot more tricky than most people realize.