{"id":183282,"date":"2024-03-19T09:37:00","date_gmt":"2024-03-19T08:37:00","guid":{"rendered":"https:\/\/datascientest.com\/en\/?p=183282"},"modified":"2024-07-11T20:52:58","modified_gmt":"2024-07-11T19:52:58","slug":"all-about-automated-prompt-engineering","status":"publish","type":"post","link":"https:\/\/datascientest.com\/en\/all-about-automated-prompt-engineering","title":{"rendered":"Automated Prompt Engineering: How does it work?"},"content":{"rendered":"\t\t<div data-elementor-type=\"wp-post\" data-elementor-id=\"183282\" class=\"elementor elementor-183282\" data-elementor-post-type=\"post\">\n\t\t\t\t\t\t\t<div class=\"elementor-element elementor-element-efa5e3b e-flex e-con-boxed e-con\" data-id=\"efa5e3b\" data-element_type=\"container\" data-settings=\"{&quot;content_width&quot;:&quot;boxed&quot;}\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-6e2e6b6 elementor-widget elementor-widget-heading\" data-id=\"6e2e6b6\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<style>\/*! elementor - v3.15.0 - 02-08-2023 *\/\n.elementor-heading-title{padding:0;margin:0;line-height:1}.elementor-widget-heading .elementor-heading-title[class*=elementor-size-]>a{color:inherit;font-size:inherit;line-height:inherit}.elementor-widget-heading .elementor-heading-title.elementor-size-small{font-size:15px}.elementor-widget-heading .elementor-heading-title.elementor-size-medium{font-size:19px}.elementor-widget-heading .elementor-heading-title.elementor-size-large{font-size:29px}.elementor-widget-heading .elementor-heading-title.elementor-size-xl{font-size:39px}.elementor-widget-heading .elementor-heading-title.elementor-size-xxl{font-size:59px}<\/style><h2 class=\"elementor-heading-title elementor-size-default\">Automated Prompt Engineering is a new approach to automating the engineering and writing of prompts for Large Language Models (LLMs) such as GPT and other generative AIs. Find out all you need to know!<\/h2>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-8ac67a3 elementor-widget elementor-widget-text-editor\" data-id=\"8ac67a3\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<style>\/*! elementor - v3.15.0 - 02-08-2023 *\/\n.elementor-widget-text-editor.elementor-drop-cap-view-stacked .elementor-drop-cap{background-color:#69727d;color:#fff}.elementor-widget-text-editor.elementor-drop-cap-view-framed .elementor-drop-cap{color:#69727d;border:3px solid;background-color:transparent}.elementor-widget-text-editor:not(.elementor-drop-cap-view-default) .elementor-drop-cap{margin-top:8px}.elementor-widget-text-editor:not(.elementor-drop-cap-view-default) .elementor-drop-cap-letter{width:1em;height:1em}.elementor-widget-text-editor .elementor-drop-cap{float:left;text-align:center;line-height:1;font-size:50px}.elementor-widget-text-editor .elementor-drop-cap-letter{display:inline-block}<\/style>\t\t\t\t<p>With the emergence of tools like <a href=\"https:\/\/datascientest.com\/en\/chatgpt-how-does-this-nlp-algorithm-work\">ChatGPT<\/a> and MidJourney, generative AI is causing a revolution in a wide range of sectors. We&#8217;ve entered a new era.<\/p><p>It is now possible to generate text, images, or even audio and video in just a few seconds. It&#8217;s an upheaval, with <strong>massive consequences for a wide variety of professions.<\/strong><\/p><p>Artificial intelligence can now be used to create software and websites, design new products or architectural plans,<a href=\"https:\/\/datascientest.com\/en\/data-analyst-everything-you-need-to-know-about-the-job\"> analyze data<\/a> or illustrate children&#8217;s books.<\/p><p>However, to get the results you want from these powerful tools, you need to be able to formulate your requirements precisely: this is what we call Prompt Engineering.<\/p><p>This can be a long and tedious process. After writing an initial prompt, it is often necessary to modify it several times to perfect it until the AI generates exactly what is expected of it.<\/p><p>To save even more time and maximize efficiency, researchers and other<strong> AI experts<\/strong> have begun to create various <strong><em>Automated Prompt Engineering<\/em><\/strong> techniques.<\/p><p>As you will discover, this approach has many advantages and can make all the difference between an amateur user and a true professional. Before going into more detail about the existing methods and their benefits, let&#8217;s first go back to the basics.<\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-e3a3020 elementor-widget elementor-widget-image\" data-id=\"e3a3020\" data-element_type=\"widget\" data-widget_type=\"image.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<style>\/*! elementor - v3.15.0 - 02-08-2023 *\/\n.elementor-widget-image{text-align:center}.elementor-widget-image a{display:inline-block}.elementor-widget-image a img[src$=\".svg\"]{width:48px}.elementor-widget-image img{vertical-align:middle;display:inline-block}<\/style>\t\t\t\t\t\t\t\t\t<figure class=\"wp-caption\">\n\t\t\t\t\t\t\t\t\t\t<img decoding=\"async\" src=\"https:\/\/datascientest.com\/wp-content\/uploads\/2023\/12\/Automated_Prompt_Engineering-1.jpg\" title=\"\" alt=\"\" loading=\"lazy\" \/>\t\t\t\t\t\t\t\t\t\t\t<figcaption class=\"widget-image-caption wp-caption-text\"><\/figcaption>\n\t\t\t\t\t\t\t\t\t\t<\/figure>\n\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-d3aa377 elementor-align-center button-principale elementor-widget elementor-widget-button\" data-id=\"d3aa377\" data-element_type=\"widget\" data-widget_type=\"button.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<div class=\"elementor-button-wrapper\">\n\t\t\t<a class=\"elementor-button elementor-button-link elementor-size-sm elementor-animation-grow\" href=\"https:\/\/datascientest.com\/formation-prompt-engineering\">\n\t\t\t\t\t\t<span class=\"elementor-button-content-wrapper\">\n\t\t\t\t\t\t<span class=\"elementor-button-text\">Prompt Engineering training<\/span>\n\t\t<\/span>\n\t\t\t\t\t<\/a>\n\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-c7b2739 e-flex e-con-boxed e-con\" data-id=\"c7b2739\" data-element_type=\"container\" data-settings=\"{&quot;content_width&quot;:&quot;boxed&quot;}\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-520cdba elementor-widget elementor-widget-heading\" data-id=\"520cdba\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<h3 class=\"elementor-heading-title elementor-size-default\">What is prompt engineering?<\/h3>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-5a129c3 elementor-widget elementor-widget-text-editor\" data-id=\"5a129c3\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<p><a href=\"https:\/\/datascientest.com\/en\/large-language-models-llm-everything-you-need-to-know\">Large Language Models<\/a> are capable of creating human-like text based on the commands they receive: prompts.<\/p><p>The term Prompt Engineering refers to the creation of efficient, precise prompts to achieve the best results with generative AI tools based on Large <strong>Language Models (LLMs).<\/strong><\/p><p>This discipline requires expertise in<a href=\"https:\/\/datascientest.com\/en\/nlp-training-become-an-nlp-pro-and-master-the-art-of-natural-language-processing\"> natural language processing<\/a> (NLP) and LLM. Prompt Engineers need to be able to formulate clear, context-specific questions and sentences, in order to obtain precise, relevant answers from the AI.<\/p><p>Whether generating detailed marketing reports, creating engaging content for a website or writing computer code: prompt engineering is a very useful time-saving skill.<\/p><p>And <strong>contrary to popular belief,<\/strong> you don&#8217;t need to wield a programming language or have software development skills to excel in this field.<\/p><p>What&#8217;s most important in this engineering role is a mastery of language and an analytical mind. A high-quality prompt should include context to help the AI understand the situation, and instructions to explain precisely what you want it to do.<\/p><p>This reduces ambiguity and the risk of receiving irrelevant results, gives the generative AI greater control and saves time.<\/p><p>As you can imagine, formulating the perfect prompt can take a lot of patience and multiple attempts. That&#8217;s why it can be very interesting to automate the process.<\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-ef592b5 e-flex e-con-boxed e-con\" data-id=\"ef592b5\" data-element_type=\"container\" data-settings=\"{&quot;content_width&quot;:&quot;boxed&quot;}\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-6b1fd51 elementor-widget elementor-widget-heading\" data-id=\"6b1fd51\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<h3 class=\"elementor-heading-title elementor-size-default\">Why automate prompt engineering? What are the benefits?<\/h3>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-01e70c8 elementor-widget elementor-widget-text-editor\" data-id=\"01e70c8\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<p>Techniques for creating prompts automatically are not just a simple way of generating high-quality content with AI.<\/p><p>It&#8217;s also an alternative to <strong>training LLMs<\/strong> from data aggregated from the web or books, considered the norm until now.<\/p><p>Rather than assembling vast datasets and manually creating labels, synthetic data can be produced automatically.<\/p><p>As a result, training AI models on large datasets becomes much easier and faster. Automated engineering methods therefore have revolutionary potential for the AI industry.<\/p><p>This approach can also boost <strong>LLM performance,<\/strong> thanks to prompts tailored to the specific task in hand. By extension, it can also make AIs more versatile.<\/p><p>There are several techniques for automated prompt engineering. Among the most commonly used are gradient-based optimization, rule-based systems and Machine Learning.<\/p><p>Let&#8217;s take a closer look at two particularly compelling methods: the Automatic <em>Prompt Engineer (APE) framework and the OPRO! program.<\/em><\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-8d8e75c elementor-widget elementor-widget-heading\" data-id=\"8d8e75c\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<h4 class=\"elementor-heading-title elementor-size-medium\">1. Automatic Prompt Engineer (APE): a framework for automatically generating prompts<\/h4>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-ecd3c0c elementor-widget elementor-widget-text-editor\" data-id=\"ecd3c0c\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<p>Researchers Yongchao Zhou, Andrei Ioan Muresanu, Ziwen Han and their colleagues at the University of Toronto, the Vector Institute and the University of Waterloo have created a procedure for generating prompt text for large language models: Automatic Prompt Engineer (APE).<\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-b4f23da elementor-widget elementor-widget-image\" data-id=\"b4f23da\" data-element_type=\"widget\" data-widget_type=\"image.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t\t\t\t<figure class=\"wp-caption\">\n\t\t\t\t\t\t\t\t\t\t<img decoding=\"async\" src=\"https:\/\/datascientest.com\/wp-content\/uploads\/2023\/12\/Automated_Prompt_Engineering-2.jpg\" title=\"\" alt=\"\" loading=\"lazy\" \/>\t\t\t\t\t\t\t\t\t\t\t<figcaption class=\"widget-image-caption wp-caption-text\"><\/figcaption>\n\t\t\t\t\t\t\t\t\t\t<\/figure>\n\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-00bf44b elementor-align-center button-principale elementor-widget elementor-widget-button\" data-id=\"00bf44b\" data-element_type=\"widget\" data-widget_type=\"button.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<div class=\"elementor-button-wrapper\">\n\t\t\t<a class=\"elementor-button elementor-button-link elementor-size-sm elementor-animation-grow\" href=\"https:\/\/datascientest.com\/en\/data-courses\">\n\t\t\t\t\t\t<span class=\"elementor-button-content-wrapper\">\n\t\t\t\t\t\t<span class=\"elementor-button-text\">Learn more about Prompt Engineering<\/span>\n\t\t<\/span>\n\t\t\t\t\t<\/a>\n\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-6c786d3 elementor-widget elementor-widget-text-editor\" data-id=\"6c786d3\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<p>Originally published in November 2022 and updated in March 2023, their method involves giving input-output pairs to an <strong>LLM to generate a prompt.<\/strong><\/p><p>With inputs similar to those given upstream, the prompt will enable the LLM to produce results similar to the outputs. It will also be able to generate variations.<\/p><p>This approach therefore requires two LLMs: a prompt generator, and a content generator. To generate the prompts, the researchers used GPT-3 and InstructGPT, backed up by T5, <strong>GLM and InsertGPT to fill in the gaps.<\/strong><\/p><p>InstructGPT was used to generate the content. To get the AI to generate prompts, they gave it a sentence such as &#8220;I gave a friend an instruction and five inputs. The friend read the instruction and wrote an output for each of the inputs. Here are the input-output pairs&#8221;.<\/p><p>This instruction was <strong>accompanied by a small set of examples from the Instruction Induction dataset, such as the names of two animals and which one is larger.<\/strong><\/p><p>The prompt generator then responded with a prompt such as &#8220;Choose the animal that is larger&#8221;. This prompt and 50 example inputs were used to feed the content generator, which was able to produce the results.<\/p><p>To assess the effectiveness of their technique, the researchers evaluated the quality of the prompt based on the number of cases where the content generator produced results that matched expectations exactly.<\/p><p>This enabled them to boost performance by asking the generator to produce a prompt similar to the one that had received the highest score. The step was repeated three times until the ultimate prompt was obtained.<\/p><p>On each of the 24 tasks reviewed in Instruction Induction, the prompts generated by <strong>InstructGPT<\/strong> using APE outperformed those created by humans.<\/p><p>This method therefore produces prompts capable of leading the content generator to produce results of the highest quality. APE could therefore maximize the performance of all LLMs!<\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-0af940c elementor-widget elementor-widget-heading\" data-id=\"0af940c\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<h4 class=\"elementor-heading-title elementor-size-medium\">2. OPRO: a program to let AI choose the best prompt<\/h4>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-8a1aedd elementor-widget elementor-widget-text-editor\" data-id=\"8a1aedd\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<p>In September 2023, a team of Google DeepMind researchers led by Chrengrun Yang created a program called OPRO that lets LLMs try out different prompts until they find the most suitable one for solving a task.<\/p><p>Rather than trying to manually modify a prompt over and over again to perfect it, it is possible to automate this iterative process.<\/p><p>The researchers also chose to use natural language to describe the optimization problem, rather than relying on programming. This allows the AI to adapt to constantly changing requests for optimization on different tasks.<\/p><p>They then instruct the LLM to iteratively generate new solutions based on the problem description and previously found solutions.<\/p><p>At the heart of the OPRO program is an algorithm called &#8220;Meta-Prompt&#8221;. It reviews previous prompts, and measures their success in solving a given problem.<\/p><p>The algorithm then generates multiple prompts and tries them out to find the best one. In this way, Meta-Prompt can be compared to a person typing multiple variations of prompts on their keyboard until they find the most effective one.<\/p><p>It can be connected to various LLMs to produce prompts and responses, such as GPT-3 or GPT-4 and Google PaLM 2.<\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-0b5fd11 elementor-widget elementor-widget-image\" data-id=\"0b5fd11\" data-element_type=\"widget\" data-widget_type=\"image.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t\t\t\t<figure class=\"wp-caption\">\n\t\t\t\t\t\t\t\t\t\t<img decoding=\"async\" src=\"https:\/\/datascientest.com\/wp-content\/uploads\/2023\/12\/Automated_Prompt_Engineering-3.jpg\" title=\"\" alt=\"\" loading=\"lazy\" \/>\t\t\t\t\t\t\t\t\t\t\t<figcaption class=\"widget-image-caption wp-caption-text\"><\/figcaption>\n\t\t\t\t\t\t\t\t\t\t<\/figure>\n\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-ffb852f elementor-align-center button-principale elementor-widget elementor-widget-button\" data-id=\"ffb852f\" data-element_type=\"widget\" data-widget_type=\"button.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<div class=\"elementor-button-wrapper\">\n\t\t\t<a class=\"elementor-button elementor-button-link elementor-size-sm elementor-animation-grow\" href=\"https:\/\/datascientest.com\/en\/data-courses\">\n\t\t\t\t\t\t<span class=\"elementor-button-content-wrapper\">\n\t\t\t\t\t\t<span class=\"elementor-button-text\">Discover Prompt Engineering<\/span>\n\t\t<\/span>\n\t\t\t\t\t<\/a>\n\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-bf4c089 elementor-widget elementor-widget-text-editor\" data-id=\"bf4c089\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<p>The authors of the study <strong>began by testing OPRO on simple problems<\/strong> such as<a href=\"https:\/\/datascientest.com\/en\/linear-regression-with-python-how-does-it-work\"> linear regression<\/a>, on which the program was instructed to &#8220;minimize a function&#8221; by finding a pair of numbers similar to past examples while producing a smaller numerical value.<\/p><p>The language model is therefore capable of finding solutions to a mathematical problem just from a prompt, without the need to use a &#8220;solver&#8221; program designed specifically for this purpose.<\/p><p>Subsequently, the researchers wanted to verify how well Meta-Prompt can optimize prompts by testing it on benchmarks such as GSM8K introduced in 2021 by OpenAI, or BIG-bench created by Google in 2022.<\/p><p>Overall, prompts optimized by Meta-Prompt outperformed those created by humans on both benchmarks by a margin of over 50%.<\/p><p>\u00a0<\/p><p>\ud83d\udca1Related articles:<\/p><table dir=\"ltr\" border=\"1\" cellspacing=\"0\" cellpadding=\"0\" data-sheets-root=\"1\"><colgroup><col width=\"656\" \/><\/colgroup><tbody><tr><td data-sheets-value=\"{&quot;1&quot;:2,&quot;2&quot;:&quot;NLP training: Become an NLP Pro and Master the Art of Natural Language Processing&quot;}\" data-sheets-hyperlink=\"https:\/\/datascientest.com\/en\/nlp-training-become-an-nlp-pro-and-master-the-art-of-natural-language-processing\"><a class=\"in-cell-link\" href=\"https:\/\/datascientest.com\/en\/nlp-training-become-an-nlp-pro-and-master-the-art-of-natural-language-processing\" target=\"_blank\" rel=\"noopener\">NLP training: Become an NLP Pro and Master the Art of Natural Language Processing<\/a><\/td><\/tr><tr><td data-sheets-value=\"{&quot;1&quot;:2,&quot;2&quot;:&quot;Natural Language Processing (NLP): Definition and Principles&quot;}\" data-sheets-hyperlink=\"https:\/\/datascientest.com\/en\/natural-language-processing-definition-and-principles\"><a class=\"in-cell-link\" href=\"https:\/\/datascientest.com\/en\/natural-language-processing-definition-and-principles\" target=\"_blank\" rel=\"noopener\">Natural Language Processing (NLP): Definition and Principles<\/a><\/td><\/tr><tr><td data-sheets-value=\"{&quot;1&quot;:2,&quot;2&quot;:&quot;Large Language Models (LLM) : Everything you need to know&quot;}\" data-sheets-hyperlink=\"https:\/\/datascientest.com\/en\/large-language-models-llm-everything-you-need-to-know\"><a class=\"in-cell-link\" href=\"https:\/\/datascientest.com\/en\/large-language-models-llm-everything-you-need-to-know\" target=\"_blank\" rel=\"noopener\">Large Language Models (LLM) : Everything you need to know<\/a><\/td><\/tr><tr><td data-sheets-value=\"{&quot;1&quot;:2,&quot;2&quot;:&quot;Dense Neural Networks: Understanding Their Structure and Function&quot;}\" data-sheets-hyperlink=\"https:\/\/datascientest.com\/en\/dense-neural-networks-understanding-their-structure-and-function\"><a class=\"in-cell-link\" href=\"https:\/\/datascientest.com\/en\/dense-neural-networks-understanding-their-structure-and-function\" target=\"_blank\" rel=\"noopener\">Dense Neural Networks: Understanding Their Structure and Function<\/a><\/td><\/tr><\/tbody><\/table>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-bac0a22 e-flex e-con-boxed e-con\" data-id=\"bac0a22\" data-element_type=\"container\" data-settings=\"{&quot;content_width&quot;:&quot;boxed&quot;}\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-06c5048 elementor-widget elementor-widget-heading\" data-id=\"06c5048\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<h3 class=\"elementor-heading-title elementor-size-default\">Conclusion: Automated Prompt Engineering, the key to unlocking the full potential of AI<\/h3>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-a20f987 elementor-widget elementor-widget-text-editor\" data-id=\"a20f987\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<p>By automating the entire prompt engineering process,<strong> Automated Prompt Engineering<\/strong> takes the use of generative AI to a new level. Thanks to this method, you can increase your productivity tenfold.<\/p><p>To become an expert in this field, turn to DataScientest! Our <strong>Prompt Engineering &amp; Generative AI training course<\/strong> will teach you how to write perfect prompts in just two days.<\/p><p>First, you&#8217;ll learn the fundamentals of<strong> Machine Learning<\/strong>, Deep Learning and Generative AI, before taking a closer look at ChatGPT for text, DALL-E and Canvas for images, and ElevenLabs for audio.<\/p><p>By the end of the course, you&#8217;ll be able to write high-quality prompts and use the various AIs to create content, develop a web app or analyze data.<\/p><p>This course is entirely distance learning, and our organization is eligible for funding options. If you want to go even further in the<em> field of AI,<\/em> you can also choose our Data Scientist, Machine Learning Engineer, Deep Learning or MLOps training courses. Don&#8217;t wait any longer and discover DataScientest!<\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-3a64039 elementor-widget elementor-widget-html\" data-id=\"3a64039\" data-element_type=\"widget\" data-widget_type=\"html.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<script type=\"application\/ld+json\">\n{\n  \"@context\": \"https:\/\/schema.org\",\n  \"@type\": \"FAQPage\",\n  \"mainEntity\": [{\n    \"@type\": \"Question\",\n    \"name\": \"What is prompt engineering?\",\n    \"acceptedAnswer\": {\n      \"@type\": \"Answer\",\n      \"text\": \"Large language models are able to create human-like text based on the commands they receive: prompts. The term Prompt Engineering refers to the creation of efficient, precise prompts to achieve the best results with generative AI tools based on Large Language Models (LLMs). This discipline requires expertise in natural language processing (NLP) and LLM. Prompt Engineers need to be able to formulate clear, context-specific questions and sentences, in order to obtain precise, relevant answers from the AI. Whether generating detailed marketing reports, creating engaging content for a website or writing computer code: prompt engineering is a very useful time-saving skill.\"\n    }\n  },{\n    \"@type\": \"Question\",\n    \"name\": \"Why automate prompt engineering?\",\n    \"acceptedAnswer\": {\n      \"@type\": \"Answer\",\n      \"text\": \"Techniques for creating prompts automatically are not just a simple way of generating high-quality content with AI. It's also an alternative to training LLMs from data aggregated from the web or books, considered the norm until now. Rather than assembling vast datasets and manually creating labels, synthetic data can be produced automatically. As a result, training AI models on large datasets becomes much easier and faster. Automated engineering methods therefore have revolutionary potential for the AI industry.\"\n    }\n  },{\n    \"@type\": \"Question\",\n    \"name\": \"What is Automatic Prompt Engineer (APE)?\",\n    \"acceptedAnswer\": {\n      \"@type\": \"Answer\",\n      \"text\": \"Researchers Yongchao Zhou, Andrei Ioan Muresanu, Ziwen Han and their colleagues at the University of Toronto, the Vector Institute and the University of Waterloo have created a procedure for generating prompt text for large language models: Automatic Prompt Engineer (APE). Originally published in November 2022 and updated in March 2023, their method involves entrusting input-output pairs to an LLM to generate a prompt. With inputs similar to those given upstream, the prompt will enable the LLM to produce results similar to the outputs. It will also be able to generate variations. This approach therefore requires two LLMs: a prompt generator, and a content generator. To generate the prompts, the researchers used GPT-3 and InstructGPT, backed up by T5, GLM and InsertGPT to fill in the gaps.\"\n    }\n  }]\n}\n<\/script>\n\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-9122c1f elementor-align-center button-principale elementor-widget elementor-widget-button\" data-id=\"9122c1f\" data-element_type=\"widget\" data-widget_type=\"button.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<div class=\"elementor-button-wrapper\">\n\t\t\t<a class=\"elementor-button elementor-button-link elementor-size-sm elementor-animation-grow\" href=\"https:\/\/datascientest.com\/en\/data-courses\">\n\t\t\t\t\t\t<span class=\"elementor-button-content-wrapper\">\n\t\t\t\t\t\t<span class=\"elementor-button-text\">Discover our training courses<\/span>\n\t\t<\/span>\n\t\t\t\t\t<\/a>\n\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t\t\t<\/div>\n\t\t","protected":false},"excerpt":{"rendered":"<p>Automated Prompt Engineering is a new approach to automating the engineering and writing of prompts for Large Language Models (LLMs) such as GPT and other generative AIs. Find out all you need to know! With the emergence of tools like ChatGPT and MidJourney, generative AI is causing a revolution in a wide range of sectors. [&hellip;]<\/p>\n","protected":false},"author":67,"featured_media":183284,"comment_status":"open","ping_status":"open","sticky":false,"template":"elementor_theme","format":"standard","meta":{"content-type":"","inline_featured_image":false},"categories":[2425],"tags":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v21.7 (Yoast SEO v21.7) - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Automated Prompt Engineering: How does it work?<\/title>\n<meta name=\"description\" content=\"Automated Prompt Engineering refers to the process of automatically generating or crafting prompts for natural language processing (NLP) models,\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/datascientest.com\/en\/all-about-automated-prompt-engineering\" \/>\n<meta property=\"og:locale\" content=\"en_GB\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Automated Prompt Engineering: How does it work?\" \/>\n<meta property=\"og:description\" content=\"Automated Prompt Engineering is a new approach to automating the engineering and writing of prompts for Large Language Models (LLMs) such as GPT and other\" \/>\n<meta property=\"og:url\" content=\"https:\/\/datascientest.com\/en\/all-about-automated-prompt-engineering\" \/>\n<meta property=\"og:site_name\" content=\"Data Science Courses | DataScientest\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/DataScientestEN\" \/>\n<meta property=\"article:published_time\" content=\"2024-03-19T08:37:00+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2024-07-11T19:52:58+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/datascientest.com\/en\/files\/2024\/03\/Automated_Prompt_Engineering-768x439-1.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"768\" \/>\n\t<meta property=\"og:image:height\" content=\"439\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Melanie\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@DataScientest__\" \/>\n<meta name=\"twitter:site\" content=\"@DataScientest__\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Melanie\" \/>\n\t<meta name=\"twitter:label2\" content=\"Estimated reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"8 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/datascientest.com\/en\/all-about-automated-prompt-engineering#article\",\"isPartOf\":{\"@id\":\"https:\/\/datascientest.com\/en\/all-about-automated-prompt-engineering\"},\"author\":{\"name\":\"Melanie\",\"@id\":\"https:\/\/datascientest.com\/en\/#\/schema\/person\/19d5f7ade9407eb69af3bf6d1ae1731d\"},\"headline\":\"Automated Prompt Engineering: How does it work?\",\"datePublished\":\"2024-03-19T08:37:00+00:00\",\"dateModified\":\"2024-07-11T19:52:58+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/datascientest.com\/en\/all-about-automated-prompt-engineering\"},\"wordCount\":1535,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\/\/datascientest.com\/en\/#organization\"},\"articleSection\":[\"Data Science\"],\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/datascientest.com\/en\/all-about-automated-prompt-engineering#respond\"]}],\"copyrightYear\":\"2024\",\"copyrightHolder\":{\"@id\":\"https:\/\/datascientest.com\/#organization\"}},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/datascientest.com\/en\/all-about-automated-prompt-engineering\",\"url\":\"https:\/\/datascientest.com\/en\/all-about-automated-prompt-engineering\",\"name\":\"Automated Prompt Engineering: How does it work?\",\"isPartOf\":{\"@id\":\"https:\/\/datascientest.com\/en\/#website\"},\"datePublished\":\"2024-03-19T08:37:00+00:00\",\"dateModified\":\"2024-07-11T19:52:58+00:00\",\"description\":\"Automated Prompt Engineering refers to the process of automatically generating or crafting prompts for natural language processing (NLP) models,\",\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/datascientest.com\/en\/all-about-automated-prompt-engineering\"]}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/datascientest.com\/en\/#website\",\"url\":\"https:\/\/datascientest.com\/en\/\",\"name\":\"Data Science Courses | DataScientest\",\"description\":\"Leader in Data Science Courses\",\"publisher\":{\"@id\":\"https:\/\/datascientest.com\/en\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/datascientest.com\/en\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-GB\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/datascientest.com\/en\/#organization\",\"name\":\"DataScientest\",\"url\":\"https:\/\/datascientest.com\/en\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\/\/datascientest.com\/en\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/datascientest.com\/en\/wp-content\/blogs.dir\/9\/files\/2024\/02\/DataScientest_icon_blue-2.png\",\"contentUrl\":\"https:\/\/datascientest.com\/en\/wp-content\/blogs.dir\/9\/files\/2024\/02\/DataScientest_icon_blue-2.png\",\"width\":301,\"height\":301,\"caption\":\"DataScientest\"},\"image\":{\"@id\":\"https:\/\/datascientest.com\/en\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/www.facebook.com\/DataScientestEN\",\"https:\/\/twitter.com\/DataScientest__\",\"https:\/\/www.linkedin.com\/school\/datascientest\/mycompany\/\",\"https:\/\/www.tiktok.com\/@datascientest\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/datascientest.com\/en\/#\/schema\/person\/19d5f7ade9407eb69af3bf6d1ae1731d\",\"name\":\"Melanie\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\/\/datascientest.com\/en\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/8d3d660a0698de06f13ecf4823519da1?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/8d3d660a0698de06f13ecf4823519da1?s=96&d=mm&r=g\",\"caption\":\"Melanie\"},\"url\":\"https:\/\/datascientest.com\/en\/author\/melaniekrause\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Automated Prompt Engineering: How does it work?","description":"Automated Prompt Engineering refers to the process of automatically generating or crafting prompts for natural language processing (NLP) models,","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/datascientest.com\/en\/all-about-automated-prompt-engineering","og_locale":"en_GB","og_type":"article","og_title":"Automated Prompt Engineering: How does it work?","og_description":"Automated Prompt Engineering is a new approach to automating the engineering and writing of prompts for Large Language Models (LLMs) such as GPT and other","og_url":"https:\/\/datascientest.com\/en\/all-about-automated-prompt-engineering","og_site_name":"Data Science Courses | DataScientest","article_publisher":"https:\/\/www.facebook.com\/DataScientestEN","article_published_time":"2024-03-19T08:37:00+00:00","article_modified_time":"2024-07-11T19:52:58+00:00","og_image":[{"width":768,"height":439,"url":"https:\/\/datascientest.com\/en\/files\/2024\/03\/Automated_Prompt_Engineering-768x439-1.jpg","type":"image\/jpeg"}],"author":"Melanie","twitter_card":"summary_large_image","twitter_creator":"@DataScientest__","twitter_site":"@DataScientest__","twitter_misc":{"Written by":"Melanie","Estimated reading time":"8 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/datascientest.com\/en\/all-about-automated-prompt-engineering#article","isPartOf":{"@id":"https:\/\/datascientest.com\/en\/all-about-automated-prompt-engineering"},"author":{"name":"Melanie","@id":"https:\/\/datascientest.com\/en\/#\/schema\/person\/19d5f7ade9407eb69af3bf6d1ae1731d"},"headline":"Automated Prompt Engineering: How does it work?","datePublished":"2024-03-19T08:37:00+00:00","dateModified":"2024-07-11T19:52:58+00:00","mainEntityOfPage":{"@id":"https:\/\/datascientest.com\/en\/all-about-automated-prompt-engineering"},"wordCount":1535,"commentCount":0,"publisher":{"@id":"https:\/\/datascientest.com\/en\/#organization"},"articleSection":["Data Science"],"inLanguage":"en-GB","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/datascientest.com\/en\/all-about-automated-prompt-engineering#respond"]}],"copyrightYear":"2024","copyrightHolder":{"@id":"https:\/\/datascientest.com\/#organization"}},{"@type":"WebPage","@id":"https:\/\/datascientest.com\/en\/all-about-automated-prompt-engineering","url":"https:\/\/datascientest.com\/en\/all-about-automated-prompt-engineering","name":"Automated Prompt Engineering: How does it work?","isPartOf":{"@id":"https:\/\/datascientest.com\/en\/#website"},"datePublished":"2024-03-19T08:37:00+00:00","dateModified":"2024-07-11T19:52:58+00:00","description":"Automated Prompt Engineering refers to the process of automatically generating or crafting prompts for natural language processing (NLP) models,","inLanguage":"en-GB","potentialAction":[{"@type":"ReadAction","target":["https:\/\/datascientest.com\/en\/all-about-automated-prompt-engineering"]}]},{"@type":"WebSite","@id":"https:\/\/datascientest.com\/en\/#website","url":"https:\/\/datascientest.com\/en\/","name":"Data Science Courses | DataScientest","description":"Leader in Data Science Courses","publisher":{"@id":"https:\/\/datascientest.com\/en\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/datascientest.com\/en\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-GB"},{"@type":"Organization","@id":"https:\/\/datascientest.com\/en\/#organization","name":"DataScientest","url":"https:\/\/datascientest.com\/en\/","logo":{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/datascientest.com\/en\/#\/schema\/logo\/image\/","url":"https:\/\/datascientest.com\/en\/wp-content\/blogs.dir\/9\/files\/2024\/02\/DataScientest_icon_blue-2.png","contentUrl":"https:\/\/datascientest.com\/en\/wp-content\/blogs.dir\/9\/files\/2024\/02\/DataScientest_icon_blue-2.png","width":301,"height":301,"caption":"DataScientest"},"image":{"@id":"https:\/\/datascientest.com\/en\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/DataScientestEN","https:\/\/twitter.com\/DataScientest__","https:\/\/www.linkedin.com\/school\/datascientest\/mycompany\/","https:\/\/www.tiktok.com\/@datascientest"]},{"@type":"Person","@id":"https:\/\/datascientest.com\/en\/#\/schema\/person\/19d5f7ade9407eb69af3bf6d1ae1731d","name":"Melanie","image":{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/datascientest.com\/en\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/8d3d660a0698de06f13ecf4823519da1?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/8d3d660a0698de06f13ecf4823519da1?s=96&d=mm&r=g","caption":"Melanie"},"url":"https:\/\/datascientest.com\/en\/author\/melaniekrause"}]}},"_links":{"self":[{"href":"https:\/\/datascientest.com\/en\/wp-json\/wp\/v2\/posts\/183282"}],"collection":[{"href":"https:\/\/datascientest.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/datascientest.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/datascientest.com\/en\/wp-json\/wp\/v2\/users\/67"}],"replies":[{"embeddable":true,"href":"https:\/\/datascientest.com\/en\/wp-json\/wp\/v2\/comments?post=183282"}],"version-history":[{"count":0,"href":"https:\/\/datascientest.com\/en\/wp-json\/wp\/v2\/posts\/183282\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/datascientest.com\/en\/wp-json\/wp\/v2\/media\/183284"}],"wp:attachment":[{"href":"https:\/\/datascientest.com\/en\/wp-json\/wp\/v2\/media?parent=183282"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/datascientest.com\/en\/wp-json\/wp\/v2\/categories?post=183282"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/datascientest.com\/en\/wp-json\/wp\/v2\/tags?post=183282"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}