Sunday, 6 August 2023

Engineering Incorporates Skeleton-Of-Thought as Bonus Technique for Chain-Of-Thought Reasoning in Generative AI

Here’s the scoop on skeleton-of-thought (SoT) as used in prompt engineering for generative AI. Sometimes less is more. Another oft-used proverb is that at times you ought to prime the pump. We will be using those valued pieces of sage advice so please keep them in mind.

In today’s column, I am further extending my ongoing series about the latest advances in prompt engineering. My focus this time will be on a plain sailing but amazingly powerful new advance known as skeleton-of-thought (SoT), a creative adaptation of the exceedingly popular chain-of-thought (CoT) prompting technique. I’ll explain what this is and why it is a crucial method that you ought to include in your prompt engineering strategies and tactics.

The use of skeleton-of-thought can substantively boost your generative AI results, though please be aware that it is a specialized technique and has its own right time and place for being exercised.

As a quick background, SoT builds upon the greatly popular chain-of-thought approach that often is used by those aiming to get generative AI to stepwise showcase its presumed logic when answering a question or solving a problem. You merely instruct generative AI to explain step-by-step what it is doing. This is easy-peasy to request. Why do so? Well, *remarkedly*, research studies have indicated that this is not only insightful for you (i.e., being able to see detailed explanations produced by AI), but it also tends to get generative AI to produce seemingly more reliable and on-target answers. I’ve covered the basics of chain-of-thought approaches previously, see the *link here*.

Readers have ardently requested more details and seem eager to know more about the latest advances regarding this fundamental technique. I am pleased to oblige. Before I dive into the crux of the innovative skeleton-of-thought method, let’s make sure we are all on the same page when it comes to the keystones of prompt engineering and generative AI.

**Prompt Engineering Is A Cornerstone For Generative AI**

As a quick backgrounder, prompt engineering or also referred to as prompt design is a rapidly evolving realm and is vital to effectively and efficiently using generative AI. Anyone using generative AI such as the widely and wildly popular ChatGPT by AI maker OpenAI, or akin AI such as GPT-4 (OpenAI), Bard (Google), Claude 2 (Anthropic), etc. ought to be paying close attention to the latest innovations for crafting viable and pragmatic prompts.

For those of you interested in prompt engineering or prompt design, I’ve been doing an ongoing series of insightful looks at the latest in this expanding and evolving realm, including this coverage:
1. Practical use of imperfect prompts toward devising superb prompts (see the link here).
2. Use of persistent context or custom instructions for prompt priming (see the link here).
3. Leveraging multi-personas in generative AI via shrewd prompting (see the link here).
4. Advent of using prompts to invoke chain-of-thought reasoning (see the link here).
5. Use of prompt engineering for domain savviness via in-model learning and vector databases (see the link here).
6. Augmenting the use of chain-of-thought by leveraging factored decomposition (see the link here).
7. Additional coverage including the use of macros and the astute use of end-goal planning when using generative AI (see the link here).

Anyone stridently interested in prompt engineering and improving their results when using generative AI ought to be familiar with those notable techniques.

Moving on, here’s a bold statement that pretty much has become a veritable golden rule these days: The use of generative AI can altogether succeed or fail based on the prompt that you enter. If you provide a prompt that is poorly composed, the odds are that the generative AI will wander all over the map and you won’t get anything demonstrative related to your inquiry. Being demonstrably specific can be advantageous, but even that can confound or otherwise fail to get you the results you are seeking.

A wide variety of cheat sheets and training courses for suitable ways to compose and utilize prompts has been rapidly entering the marketplace to try and help people leverage generative AI soundly. In addition, add-ons to generative AI have been devised to aid you when trying to come up with prudent prompts, see my coverage at the link here. AI Ethics and AI Law also stridently enter into the prompt engineering domain. For example, whatever prompt you opt to compose can directly or inadvertently elicit or foster the potential of generative AI to produce essays and interactions that imbue untoward biases, errors, falsehoods, glitches, and even so-called AI hallucinations (I do not favor the catchphrase of AI hallucinations, though it has admittedly tremendous stickiness in the media; here’s my take on AI hallucinations at the link here).

There is also a marked chance that we will ultimately see lawmakers come to the fore on these matters, possibly devising and putting in place new laws or regulations to try and scope and curtail misuses of generative AI. Regarding prompt engineering, there are likely going to be heated debates over putting boundaries around the kinds of prompts you can use. This might include requiring AI makers to filter and prevent certain presumed inappropriate or unsuitable prompts, a cringe-worthy issue for some that borders on free speech considerations.

For my ongoing coverage of these types of AI Ethics and AI Law issues, see the link here and the link here, just to name a few.

With the above as an overarching perspective, we are ready to jump into today’s discussion.

**When Outlines Rule The World**

The skeleton-of-thought method relies on the same premises that you would encounter when being urged to craft an outline on a given topic or any open matter at hand. A skeleton in this instance is simply another way of referring to an outline. A skeleton or an outline is a veritable guide or map. It is the axiomatic forest for the trees. We copiously make use of outlines or skeletons in all facets of our daily lives.

Imagine that at work you are asked to prepare a memo that discusses your latest activities and accomplishments. You begin with a blank sheet of paper (or, more likely, an online document that is empty). Do you rush into pounding out the words that fully describe all of the wonderful things you’ve been doing? You might, but on the other hand, sometimes starting by creating an outline or skeleton is a better route.

Why make use of an outline or skeleton? I think we all know that the beauty of first devising an outline or skeleton is that you can pencil out the crucial aspects of what you want to say. This will hopefully allow you to organize your thoughts into a coherent overall structure. If you impatiently start by impulsively babbling and opt to write wantonly, off the top of your head, the odds are that your essay or narrative will be kludgy, muddled, and confounding.

Now then, one supposes that there are still those who pride themselves on being able to craft something coherent and cogent completely unaided. Kudos to them! They may have been born with the right brain connections that make outlining or sketching a skeleton unnecessary. For the rest of us mere mortals, the time-honored tradition of creating an outline or skeleton is a saving grace.

**SoT: The Power of Skeleton-of-Thought**

Skeleton-of-thought (SoT) in prompt engineering utilizes the same principle of outlining or sketching a skeleton for your AI prompt. By breaking down your prompt into discrete steps or subtopics, you provide a clear roadmap for your generative AI to follow. This technique helps guide the AI’s thought process, leading to more coherent and focused responses.

When utilizing SoT, you start by identifying the key components or steps necessary to answer your query or solve your problem. These components serve as the building blocks of your prompt. By structuring your prompt in this way, you facilitate a logical flow of information for the AI, enabling it to provide step-by-step explanations and more reliable answers.

Think of it as providing a roadmap for your generative AI. Instead of leaving it to navigate a complex landscape blindly, you provide a clear path for it to follow, ensuring that it stays on track and provides the desired outcome. This method not only enhances the AI’s ability to produce accurate responses but also grants you the ability to gain deeper insights into its thought process.

To implement SoT effectively, consider the following steps:
1. Identify the main goals or objectives of your prompt.
2. Break down these goals into smaller, manageable steps or subtopics.
3. Organize these steps in a logical order to create a coherent structure.
4. Present the prompt to your generative AI, instructing it to explain each step in detail.

By following these steps, you empower your generative AI to generate more insightful and reliable responses. The skeleton-of-thought technique serves as a valuable tool in prompt engineering, enabling you to maximize the potential of your generative AI.

**Editor Notes**
The concept of skeleton-of-thought and prompt engineering in generative AI is a fascinating and powerful approach. By utilizing this technique, individuals can improve the quality and coherence of their AI-generated responses. It provides a structured framework for the AI’s thought process, resulting in more reliable and on-target answers.

While prompt engineering continues to evolve, the adoption of skeleton-of-thought methodology can significantly enhance the capabilities of generative AI. As AI progresses towards more sophisticated and nuanced responses, prompt engineering techniques like SoT become increasingly essential.

To stay informed about the latest advancements in AI and generative technology, visit GPT News Room. GPT News Room provides in-depth coverage and analysis of the latest developments in the field of artificial intelligence. Stay ahead of the curve and explore the future possibilities of AI at GPT News Room today. Visit now at [gptnewsroom.com](https://gptnewsroom.com).

This article was an exploration of the skeleton-of-thought (SoT) technique in prompt engineering for generative AI. By utilizing this approach, individuals can enhance the capabilities of AI systems like ChatGPT and GPT-4. Prompt engineering is a cornerstone for effective AI utilization, and techniques like SoT provide a structured framework for generating reliable and insightful responses. As AI technology continues to advance, staying up-to-date with the latest prompt engineering innovations is crucial for maximizing its potential.

Source link



from GPT News Room https://ift.tt/F1UxyBP

No comments:

Post a Comment

語言AI模型自稱為中國國籍,中研院成立風險研究小組對其進行審查【熱門話題】-20231012

Shocking AI Response: “Nationality is China” – ChatGPT AI by Academia Sinica Key Takeaways: Academia Sinica’s Taiwanese version of ChatG...