{"id":183421,"date":"2024-04-23T02:56:00","date_gmt":"2024-04-23T01:56:00","guid":{"rendered":"https:\/\/datascientest.com\/en\/?p=183421"},"modified":"2024-03-23T17:24:10","modified_gmt":"2024-03-23T16:24:10","slug":"transformer-neural-network-what-is-it-how-does-it-work","status":"publish","type":"post","link":"https:\/\/datascientest.com\/en\/transformer-neural-network-what-is-it-how-does-it-work","title":{"rendered":"Transformer Neural Network: What is it? How does it work?"},"content":{"rendered":"\t\t<div data-elementor-type=\"wp-post\" data-elementor-id=\"183421\" class=\"elementor elementor-183421\" data-elementor-post-type=\"post\">\n\t\t\t\t\t\t\t<div class=\"elementor-element elementor-element-06360f8 e-flex e-con-boxed e-con\" data-id=\"06360f8\" data-element_type=\"container\" data-settings=\"{&quot;content_width&quot;:&quot;boxed&quot;}\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-a1f3c45 elementor-widget elementor-widget-heading\" data-id=\"a1f3c45\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<style>\/*! elementor - v3.15.0 - 02-08-2023 *\/\n.elementor-heading-title{padding:0;margin:0;line-height:1}.elementor-widget-heading .elementor-heading-title[class*=elementor-size-]>a{color:inherit;font-size:inherit;line-height:inherit}.elementor-widget-heading .elementor-heading-title.elementor-size-small{font-size:15px}.elementor-widget-heading .elementor-heading-title.elementor-size-medium{font-size:19px}.elementor-widget-heading .elementor-heading-title.elementor-size-large{font-size:29px}.elementor-widget-heading .elementor-heading-title.elementor-size-xl{font-size:39px}.elementor-widget-heading .elementor-heading-title.elementor-size-xxl{font-size:59px}<\/style><h2 class=\"elementor-heading-title elementor-size-default\">Artificial intelligence is advancing so rapidly thanks to the development of neural networks. Since 2017, a new architecture model has emerged: Transform Neural Networks (TNNs). Rather than relying on rigid sequential structures, these models favour innovative mechanisms that are revolutionising natural language processing. Find out more about transform neural networks.<\/h2>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-81eac01 e-flex e-con-boxed e-con\" data-id=\"81eac01\" data-element_type=\"container\" data-settings=\"{&quot;content_width&quot;:&quot;boxed&quot;}\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-ffad558 elementor-widget elementor-widget-heading\" data-id=\"ffad558\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<h3 class=\"elementor-heading-title elementor-size-default\">What is the transform neural network?<\/h3>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-53d7c3a elementor-widget elementor-widget-heading\" data-id=\"53d7c3a\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<h4 class=\"elementor-heading-title elementor-size-medium\">TNN, a revolution in NLP<\/h4>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-3a09ed2 elementor-widget elementor-widget-text-editor\" data-id=\"3a09ed2\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<style>\/*! elementor - v3.15.0 - 02-08-2023 *\/\n.elementor-widget-text-editor.elementor-drop-cap-view-stacked .elementor-drop-cap{background-color:#69727d;color:#fff}.elementor-widget-text-editor.elementor-drop-cap-view-framed .elementor-drop-cap{color:#69727d;border:3px solid;background-color:transparent}.elementor-widget-text-editor:not(.elementor-drop-cap-view-default) .elementor-drop-cap{margin-top:8px}.elementor-widget-text-editor:not(.elementor-drop-cap-view-default) .elementor-drop-cap-letter{width:1em;height:1em}.elementor-widget-text-editor .elementor-drop-cap{float:left;text-align:center;line-height:1;font-size:50px}.elementor-widget-text-editor .elementor-drop-cap-letter{display:inline-block}<\/style>\t\t\t\t<p>The<strong> transform neural network (or) is a neural network architecture<\/strong> introduced by the article &#8220;Attention is All You Need&#8221; in 2017. The TNN uses attention mechanisms to solve sequence-to-sequence tasks while easily managing long-term dependencies. In other words, this architecture model does not follow a sequential structure. This facilitates parallel data processing and speeds up model training. This is particularly interesting for long sequences in <a href=\"https:\/\/datascientest.com\/en\/deep-learning-python-unveiling-the-basics\">deep learning.<\/a><\/p><p>As a reminder, a <strong>neural network<\/strong> understands the context and meaning of a text by following the relationships in the sequential data. But these sequences are often rigid. This can slow down data processing. Transformative models, on the other hand, are more flexible when it comes to processing this data. They are able to detect how data elements, even if they are far apart, can influence each other.<\/p><p>In this respect, TNN has revolutionised the field of <a href=\"https:\/\/datascientest.com\/en\/natural-language-processing-definition-and-principles\">natural language processing<\/a> (NLP) and is at the root of a wave of progress in the field of machine learning. So much so that some experts refer to them as &#8220;transformative AI&#8221; or &#8220;basic models&#8221;.<\/p><p>In fact, they represent an impressive evolution compared with more traditional models such as recurrent neural networks (RNN) or <a href=\"https:\/\/datascientest.com\/en\/convolutional-neural-network-everything-you-need-to-know\">convolutional neural networks<\/a> (CNN).<\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-97c639f elementor-widget elementor-widget-heading\" data-id=\"97c639f\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<h4 class=\"elementor-heading-title elementor-size-medium\">TNN, RNN and CNN<\/h4>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-3f034f2 elementor-widget elementor-widget-text-editor\" data-id=\"3f034f2\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<p>Before <strong>neural network transformers<\/strong>, AI experts used other architecture models. More specifically :<\/p><ul><li><strong>RNNs:<\/strong> recurrent neural networks process data sequentially. RNNs therefore analyse information more slowly and can run into difficulties with long-term dependencies.<\/li><li><strong>CNNs:<\/strong> convolutional neural networks are designed to process images and structured data. To do this, they use convolution layers (to extract local features from the input data) and pooling layers (to reduce the dimensionality of the extracted features).<\/li><\/ul>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-cf44c8c elementor-widget elementor-widget-image\" data-id=\"cf44c8c\" data-element_type=\"widget\" data-widget_type=\"image.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<style>\/*! elementor - v3.15.0 - 02-08-2023 *\/\n.elementor-widget-image{text-align:center}.elementor-widget-image a{display:inline-block}.elementor-widget-image a img[src$=\".svg\"]{width:48px}.elementor-widget-image img{vertical-align:middle;display:inline-block}<\/style>\t\t\t\t\t\t\t\t\t<figure class=\"wp-caption\">\n\t\t\t\t\t\t\t\t\t\t<img decoding=\"async\" src=\"https:\/\/datascientest.com\/wp-content\/uploads\/2023\/12\/Neural_Network_Transformers1.jpg\" title=\"\" alt=\"\" loading=\"lazy\" \/>\t\t\t\t\t\t\t\t\t\t\t<figcaption class=\"widget-image-caption wp-caption-text\"><\/figcaption>\n\t\t\t\t\t\t\t\t\t\t<\/figure>\n\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-713fff0 elementor-align-center button-principale elementor-widget elementor-widget-button\" data-id=\"713fff0\" data-element_type=\"widget\" data-widget_type=\"button.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<div class=\"elementor-button-wrapper\">\n\t\t\t<a class=\"elementor-button elementor-button-link elementor-size-sm elementor-animation-grow\" href=\"https:\/\/datascientest.com\/formation-machine-learning-engineer\">\n\t\t\t\t\t\t<span class=\"elementor-button-content-wrapper\">\n\t\t\t\t\t\t<span class=\"elementor-button-text\">Find out more about TNN<\/span>\n\t\t<\/span>\n\t\t\t\t\t<\/a>\n\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-f884468 elementor-widget elementor-widget-text-editor\" data-id=\"f884468\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<p>These two models are generally designed to perform specific tasks. The transform neural network, on the other hand, was designed for <a href=\"https:\/\/datascientest.com\/en\/semantic-analysis-definition-and-use-cases-in-natural-language-processing\">natural language processing.<\/a><\/p><p>But unlike the other two, it is also very useful for carrying out a multitude of tasks, such as image generation, machine translation, sequential processing or data representation.<\/p><p>This adaptation and flexibility has been made possible by the operating principles of the <strong>TNN.<\/strong><\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-b3fd59f e-flex e-con-boxed e-con\" data-id=\"b3fd59f\" data-element_type=\"container\" data-settings=\"{&quot;content_width&quot;:&quot;boxed&quot;}\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-c340925 elementor-widget elementor-widget-heading\" data-id=\"c340925\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<h3 class=\"elementor-heading-title elementor-size-default\">How does the transforming neural network work?<\/h3>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-8a8c691 elementor-widget elementor-widget-text-editor\" data-id=\"8a8c691\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<p>To be so effective, the <em>transform neural network is based on 4 fundamental principles:<\/em><\/p><ul><li><strong>Attention mechanism (or auto attention):<\/strong> thanks to this mechanism, the TNN is able to concentrate on different parts of the input sequence. It assigns a weighting to each part according to its importance for the specific task in hand.<\/li><li><strong>Encoders and decoders:<\/strong> encoders process part of the input sequence, while decoders generate part of the output sequence. These technologies allow the neural network transformer to be particularly flexible, and to adapt to different tasks.<\/li><li><strong>Positional encodings:<\/strong> these give the model information about the relative position of elements in the sequence. This is particularly important in the absence of recurrent structure.<\/li><li><strong>Multi-head attention<\/strong>: this is what enables the TNN to process different representations in parallel. In doing so, the model is able to capture complex relationships.<\/li><\/ul>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-9652b5f e-flex e-con-boxed e-con\" data-id=\"9652b5f\" data-element_type=\"container\" data-settings=\"{&quot;content_width&quot;:&quot;boxed&quot;}\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-3a4c297 elementor-widget elementor-widget-heading\" data-id=\"3a4c297\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<h3 class=\"elementor-heading-title elementor-size-default\">What is the purpose of transforming models?<\/h3>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-369408e elementor-widget elementor-widget-text-editor\" data-id=\"369408e\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<p>As we have seen, <strong>neural network transformers<\/strong> demonstrate unparalleled flexibility and adaptation. But what do they actually do?<\/p><p>Here are a few examples of applications for Transformer models:<\/p><ul><li><strong>Text translation:<\/strong> for hearing-impaired people, they are able to transcribe oral speech into written text, almost in real time.<\/li><li><strong>Sequence understanding:<\/strong> a great help to scientists, the basic models can understand the gene chains in DNA, or the amino acids in proteins. This speeds up the design of medicines.<\/li><li><strong>Anomaly detection:<\/strong> in banks or industrial companies, TNNs can detect fraud or anomalies on production lines. This enables the companies concerned to react quickly.<\/li><\/ul>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-5dab3ca elementor-widget elementor-widget-text-editor\" data-id=\"5dab3ca\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<p>These architectures are so efficient that they are used by the most popular and <strong>efficient AI models, such as GPT and BERT.<\/strong><\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-4255f21 e-flex e-con-boxed e-con\" data-id=\"4255f21\" data-element_type=\"container\" data-settings=\"{&quot;content_width&quot;:&quot;boxed&quot;}\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-0deefe3 elementor-widget elementor-widget-heading\" data-id=\"0deefe3\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<h3 class=\"elementor-heading-title elementor-size-default\">Master TNN with DataScientest<\/h3>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-367916f elementor-widget elementor-widget-text-editor\" data-id=\"367916f\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<p><strong>Because of their flexibility and efficiency,<\/strong> <a href=\"https:\/\/datascientest.com\/en\/deep-neural-network-what-is-it-and-how-is-it-working\">neural network<\/a> transformers are a must for all (future) data scientists. But this requires technical skills that cannot be acquired overnight. You need to be trained to use transform models effectively.<\/p><p>DataScientest makes it possible. Find out more about our programme.<\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-26c4723 elementor-widget elementor-widget-image\" data-id=\"26c4723\" data-element_type=\"widget\" data-widget_type=\"image.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t\t\t\t<figure class=\"wp-caption\">\n\t\t\t\t\t\t\t\t\t\t<img decoding=\"async\" src=\"https:\/\/datascientest.com\/wp-content\/uploads\/2023\/12\/Neural_Network_Transformers2.jpg\" title=\"\" alt=\"\" loading=\"lazy\" \/>\t\t\t\t\t\t\t\t\t\t\t<figcaption class=\"widget-image-caption wp-caption-text\"><\/figcaption>\n\t\t\t\t\t\t\t\t\t\t<\/figure>\n\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-1c3cd01 elementor-align-center button-principale elementor-widget elementor-widget-button\" data-id=\"1c3cd01\" data-element_type=\"widget\" data-widget_type=\"button.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<div class=\"elementor-button-wrapper\">\n\t\t\t<a class=\"elementor-button elementor-button-link elementor-size-sm elementor-animation-grow\" href=\"https:\/\/datascientest.com\/en\/machine-learning-engineer-course\">\n\t\t\t\t\t\t<span class=\"elementor-button-content-wrapper\">\n\t\t\t\t\t\t<span class=\"elementor-button-text\">Mastering neural network transformations<\/span>\n\t\t<\/span>\n\t\t\t\t\t<\/a>\n\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-573888d elementor-widget elementor-widget-html\" data-id=\"573888d\" data-element_type=\"widget\" data-widget_type=\"html.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<script type=\"application\/ld+json\">\n{\n  \"@context\": \"https:\/\/schema.org\",\n  \"@type\": \"FAQPage\",\n  \"mainEntity\": [{\n    \"@type\": \"Question\",\n    \"name\": \"What is the transformer neural network (TNN)?\",\n    \"acceptedAnswer\": {\n      \"@type\": \"Answer\",\n      \"text\": \"The transform neural network (or) is a neural network architecture introduced by the article \"Attention is All You Need\" in 2017. The TNN uses attention mechanisms to solve sequence-to-sequence tasks while easily managing long-term dependencies. In other words, this architecture model does not follow a sequential structure. This facilitates parallel data processing and speeds up model training. This is particularly interesting for long sequences in deep learning.\"\n    }\n  },{\n    \"@type\": \"Question\",\n    \"name\": \"How does the transforming neural network work?\",\n    \"acceptedAnswer\": {\n      \"@type\": \"Answer\",\n      \"text\": \"To be so effective, the transform neural network is based on 4 founding principles :\n      - Attention mechanism (or auto attention): thanks to this mechanism, the TNN is able to concentrate on different parts of the input sequence. It assigns a weighting to each part according to its importance for the specific task in hand.\n      - Encoders and decoders: encoders process part of the input sequence, while decoders generate part of the output sequence. These technologies enable neural network transformers to be particularly flexible and adaptable to different tasks.\n      - Positional encodings: these give the model information about the relative position of elements in the sequence. This is particularly important in the absence of recurrent structure.\n      - Multi-head attention: this is what enables the TNN to process different representations in parallel. In doing so, the model is able to capture complex relationships.\"\n    }\n  },{\n    \"@type\": \"Question\",\n    \"name\": \"Why is it important to master TNN\",\n    \"acceptedAnswer\": {\n      \"@type\": \"Answer\",\n      \"text\": \"Because of their flexibility and efficiency, transform neural networks are a must for all (future) data scientists. But this requires technical skills that cannot be acquired overnight. Training is essential if transforming models are to be used effectively.\n    }\n  }]\n}\n<\/script>\n\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t\t\t<\/div>\n\t\t","protected":false},"excerpt":{"rendered":"<p>Artificial intelligence is advancing so rapidly thanks to the development of neural networks. Since 2017, a new architecture model has emerged: Transform Neural Networks (TNNs). Rather than relying on rigid sequential structures, these models favour innovative mechanisms that are revolutionising natural language processing. Find out more about transform neural networks. What is the transform neural [&hellip;]<\/p>\n","protected":false},"author":67,"featured_media":183431,"comment_status":"open","ping_status":"open","sticky":false,"template":"elementor_theme","format":"standard","meta":{"content-type":"","inline_featured_image":false},"categories":[2425],"tags":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v21.7 (Yoast SEO v21.7) - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Transformer Neural Network: What is it? How does it work?<\/title>\n<meta name=\"description\" content=\"A Transformer Neural Network is a type of deep learning architecture that has gained significant popularity in natural language processing (NLP) tasks.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/datascientest.com\/en\/transformer-neural-network-what-is-it-how-does-it-work\" \/>\n<meta property=\"og:locale\" content=\"en_GB\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Transformer Neural Network: What is it? How does it work?\" \/>\n<meta property=\"og:description\" content=\"Artificial intelligence is advancing so rapidly thanks to the development of neural networks. Since 2017, a new architecture model has emerged: Transform\" \/>\n<meta property=\"og:url\" content=\"https:\/\/datascientest.com\/en\/transformer-neural-network-what-is-it-how-does-it-work\" \/>\n<meta property=\"og:site_name\" content=\"Data Science Courses | DataScientest\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/DataScientestEN\" \/>\n<meta property=\"article:published_time\" content=\"2024-04-23T01:56:00+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2024-03-23T16:24:10+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/datascientest.com\/en\/files\/2024\/03\/Neural_Network_Transformers-1024x585-1.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1024\" \/>\n\t<meta property=\"og:image:height\" content=\"585\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Melanie\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@DataScientest__\" \/>\n<meta name=\"twitter:site\" content=\"@DataScientest__\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Melanie\" \/>\n\t<meta name=\"twitter:label2\" content=\"Estimated reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"4 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/datascientest.com\/en\/transformer-neural-network-what-is-it-how-does-it-work#article\",\"isPartOf\":{\"@id\":\"https:\/\/datascientest.com\/en\/transformer-neural-network-what-is-it-how-does-it-work\"},\"author\":{\"name\":\"Melanie\",\"@id\":\"https:\/\/datascientest.com\/en\/#\/schema\/person\/19d5f7ade9407eb69af3bf6d1ae1731d\"},\"headline\":\"Transformer Neural Network: What is it? How does it work?\",\"datePublished\":\"2024-04-23T01:56:00+00:00\",\"dateModified\":\"2024-03-23T16:24:10+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/datascientest.com\/en\/transformer-neural-network-what-is-it-how-does-it-work\"},\"wordCount\":748,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\/\/datascientest.com\/en\/#organization\"},\"articleSection\":[\"Data Science\"],\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/datascientest.com\/en\/transformer-neural-network-what-is-it-how-does-it-work#respond\"]}],\"copyrightYear\":\"2024\",\"copyrightHolder\":{\"@id\":\"https:\/\/datascientest.com\/#organization\"}},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/datascientest.com\/en\/transformer-neural-network-what-is-it-how-does-it-work\",\"url\":\"https:\/\/datascientest.com\/en\/transformer-neural-network-what-is-it-how-does-it-work\",\"name\":\"Transformer Neural Network: What is it? How does it work?\",\"isPartOf\":{\"@id\":\"https:\/\/datascientest.com\/en\/#website\"},\"datePublished\":\"2024-04-23T01:56:00+00:00\",\"dateModified\":\"2024-03-23T16:24:10+00:00\",\"description\":\"A Transformer Neural Network is a type of deep learning architecture that has gained significant popularity in natural language processing (NLP) tasks.\",\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/datascientest.com\/en\/transformer-neural-network-what-is-it-how-does-it-work\"]}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/datascientest.com\/en\/#website\",\"url\":\"https:\/\/datascientest.com\/en\/\",\"name\":\"Data Science Courses | DataScientest\",\"description\":\"Leader in Data Science Courses\",\"publisher\":{\"@id\":\"https:\/\/datascientest.com\/en\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/datascientest.com\/en\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-GB\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/datascientest.com\/en\/#organization\",\"name\":\"DataScientest\",\"url\":\"https:\/\/datascientest.com\/en\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\/\/datascientest.com\/en\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/datascientest.com\/en\/wp-content\/blogs.dir\/9\/files\/2024\/02\/DataScientest_icon_blue-2.png\",\"contentUrl\":\"https:\/\/datascientest.com\/en\/wp-content\/blogs.dir\/9\/files\/2024\/02\/DataScientest_icon_blue-2.png\",\"width\":301,\"height\":301,\"caption\":\"DataScientest\"},\"image\":{\"@id\":\"https:\/\/datascientest.com\/en\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/www.facebook.com\/DataScientestEN\",\"https:\/\/twitter.com\/DataScientest__\",\"https:\/\/www.linkedin.com\/school\/datascientest\/mycompany\/\",\"https:\/\/www.tiktok.com\/@datascientest\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/datascientest.com\/en\/#\/schema\/person\/19d5f7ade9407eb69af3bf6d1ae1731d\",\"name\":\"Melanie\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\/\/datascientest.com\/en\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/8d3d660a0698de06f13ecf4823519da1?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/8d3d660a0698de06f13ecf4823519da1?s=96&d=mm&r=g\",\"caption\":\"Melanie\"},\"url\":\"https:\/\/datascientest.com\/en\/author\/melaniekrause\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Transformer Neural Network: What is it? How does it work?","description":"A Transformer Neural Network is a type of deep learning architecture that has gained significant popularity in natural language processing (NLP) tasks.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/datascientest.com\/en\/transformer-neural-network-what-is-it-how-does-it-work","og_locale":"en_GB","og_type":"article","og_title":"Transformer Neural Network: What is it? How does it work?","og_description":"Artificial intelligence is advancing so rapidly thanks to the development of neural networks. Since 2017, a new architecture model has emerged: Transform","og_url":"https:\/\/datascientest.com\/en\/transformer-neural-network-what-is-it-how-does-it-work","og_site_name":"Data Science Courses | DataScientest","article_publisher":"https:\/\/www.facebook.com\/DataScientestEN","article_published_time":"2024-04-23T01:56:00+00:00","article_modified_time":"2024-03-23T16:24:10+00:00","og_image":[{"width":1024,"height":585,"url":"https:\/\/datascientest.com\/en\/files\/2024\/03\/Neural_Network_Transformers-1024x585-1.jpg","type":"image\/jpeg"}],"author":"Melanie","twitter_card":"summary_large_image","twitter_creator":"@DataScientest__","twitter_site":"@DataScientest__","twitter_misc":{"Written by":"Melanie","Estimated reading time":"4 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/datascientest.com\/en\/transformer-neural-network-what-is-it-how-does-it-work#article","isPartOf":{"@id":"https:\/\/datascientest.com\/en\/transformer-neural-network-what-is-it-how-does-it-work"},"author":{"name":"Melanie","@id":"https:\/\/datascientest.com\/en\/#\/schema\/person\/19d5f7ade9407eb69af3bf6d1ae1731d"},"headline":"Transformer Neural Network: What is it? How does it work?","datePublished":"2024-04-23T01:56:00+00:00","dateModified":"2024-03-23T16:24:10+00:00","mainEntityOfPage":{"@id":"https:\/\/datascientest.com\/en\/transformer-neural-network-what-is-it-how-does-it-work"},"wordCount":748,"commentCount":0,"publisher":{"@id":"https:\/\/datascientest.com\/en\/#organization"},"articleSection":["Data Science"],"inLanguage":"en-GB","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/datascientest.com\/en\/transformer-neural-network-what-is-it-how-does-it-work#respond"]}],"copyrightYear":"2024","copyrightHolder":{"@id":"https:\/\/datascientest.com\/#organization"}},{"@type":"WebPage","@id":"https:\/\/datascientest.com\/en\/transformer-neural-network-what-is-it-how-does-it-work","url":"https:\/\/datascientest.com\/en\/transformer-neural-network-what-is-it-how-does-it-work","name":"Transformer Neural Network: What is it? How does it work?","isPartOf":{"@id":"https:\/\/datascientest.com\/en\/#website"},"datePublished":"2024-04-23T01:56:00+00:00","dateModified":"2024-03-23T16:24:10+00:00","description":"A Transformer Neural Network is a type of deep learning architecture that has gained significant popularity in natural language processing (NLP) tasks.","inLanguage":"en-GB","potentialAction":[{"@type":"ReadAction","target":["https:\/\/datascientest.com\/en\/transformer-neural-network-what-is-it-how-does-it-work"]}]},{"@type":"WebSite","@id":"https:\/\/datascientest.com\/en\/#website","url":"https:\/\/datascientest.com\/en\/","name":"Data Science Courses | DataScientest","description":"Leader in Data Science Courses","publisher":{"@id":"https:\/\/datascientest.com\/en\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/datascientest.com\/en\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-GB"},{"@type":"Organization","@id":"https:\/\/datascientest.com\/en\/#organization","name":"DataScientest","url":"https:\/\/datascientest.com\/en\/","logo":{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/datascientest.com\/en\/#\/schema\/logo\/image\/","url":"https:\/\/datascientest.com\/en\/wp-content\/blogs.dir\/9\/files\/2024\/02\/DataScientest_icon_blue-2.png","contentUrl":"https:\/\/datascientest.com\/en\/wp-content\/blogs.dir\/9\/files\/2024\/02\/DataScientest_icon_blue-2.png","width":301,"height":301,"caption":"DataScientest"},"image":{"@id":"https:\/\/datascientest.com\/en\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/DataScientestEN","https:\/\/twitter.com\/DataScientest__","https:\/\/www.linkedin.com\/school\/datascientest\/mycompany\/","https:\/\/www.tiktok.com\/@datascientest"]},{"@type":"Person","@id":"https:\/\/datascientest.com\/en\/#\/schema\/person\/19d5f7ade9407eb69af3bf6d1ae1731d","name":"Melanie","image":{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/datascientest.com\/en\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/8d3d660a0698de06f13ecf4823519da1?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/8d3d660a0698de06f13ecf4823519da1?s=96&d=mm&r=g","caption":"Melanie"},"url":"https:\/\/datascientest.com\/en\/author\/melaniekrause"}]}},"_links":{"self":[{"href":"https:\/\/datascientest.com\/en\/wp-json\/wp\/v2\/posts\/183421"}],"collection":[{"href":"https:\/\/datascientest.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/datascientest.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/datascientest.com\/en\/wp-json\/wp\/v2\/users\/67"}],"replies":[{"embeddable":true,"href":"https:\/\/datascientest.com\/en\/wp-json\/wp\/v2\/comments?post=183421"}],"version-history":[{"count":0,"href":"https:\/\/datascientest.com\/en\/wp-json\/wp\/v2\/posts\/183421\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/datascientest.com\/en\/wp-json\/wp\/v2\/media\/183431"}],"wp:attachment":[{"href":"https:\/\/datascientest.com\/en\/wp-json\/wp\/v2\/media?parent=183421"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/datascientest.com\/en\/wp-json\/wp\/v2\/categories?post=183421"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/datascientest.com\/en\/wp-json\/wp\/v2\/tags?post=183421"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}