I think there are huge areas we can optimize prompt engineering on the human-interface side. We can learn how to prompt better if we had more feedback, more verbose metrics. 1: Show me the amount of compute I use for every question. And if its possible, show me the amount of compute per word or per sentence . I bet that if people saw that info they could refine their questions to get answers with a tiny fraction of the compute. And people would start to add things to their prompts that greatly reduce the compute. I like adding “Be succinct” or “In 100 words or less.”, but I’m sure there are even better things you could do. 2: Put in a translator layer that converts your prompt into a hyper efficient one. You can toggle it off, or have it give you both replies, the one you would get if what you typed was sent directly, and the answer to the question after it was optimized. It will reword things you type to use less tokens but still get the core answer you were looking for. Sometimes all I really need is a 3 word answer but I forget to tell it “x words or less”. Right now the AI goes on and on and its wasting its own compute and my time. 3: Give a direct one line reply at the top of the output and if that’s what you want, you can hit the “Stop” button and skip all the compute. I think I’ve seen some AI implement this already, but everyone needs to do it. (The user interface needs to keep that one or two sentence reply on screen and not scroll past it when more text loads in, that way the user can actually read the whole thing.) Or maybe have a “short reply” button that uses the same model, but adds the hidden prompt “In 2 sentences or less.” These ideas won’t just help the big companies save a ton of electricity, but offline AIs are so slow and wasteful they also need optimizations. Humans getting better at using these tools is the future of AI. AI is going to hit a limit. 1,000 IQ may never be possible, but if we can speedrun our AI use we will save not just compute, but human time. Right now human attention needs to be optimized too. You can only read so fast. submitted by /u/Ordinary_Variable
Originally posted by u/Ordinary_Variable on r/ArtificialInteligence