{"id":198100,"date":"2023-05-09T07:30:00","date_gmt":"2023-05-09T07:30:00","guid":{"rendered":"https:\/\/datascientest.com\/?p=198100"},"modified":"2023-11-09T14:21:59","modified_gmt":"2023-11-09T14:21:59","slug":"aws-glue-tout-savoir","status":"publish","type":"post","link":"https:\/\/datascientest.com\/aws-glue-tout-savoir","title":{"rendered":"AWS Glue : Qu&rsquo;est-ce que c&rsquo;est ? \u00c0 quoi \u00e7a sert ?"},"content":{"rendered":"\t\t<div data-elementor-type=\"wp-post\" data-elementor-id=\"198100\" class=\"elementor elementor-198100\" data-elementor-post-type=\"post\">\n\t\t\t\t\t\t\t<div class=\"elementor-element elementor-element-55ae3a5 e-flex e-con-boxed e-con\" data-id=\"55ae3a5\" data-element_type=\"container\" data-settings=\"{&quot;content_width&quot;:&quot;boxed&quot;}\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-659e30d elementor-widget elementor-widget-heading\" data-id=\"659e30d\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<style>\/*! elementor - v3.15.0 - 02-08-2023 *\/\n.elementor-heading-title{padding:0;margin:0;line-height:1}.elementor-widget-heading .elementor-heading-title[class*=elementor-size-]>a{color:inherit;font-size:inherit;line-height:inherit}.elementor-widget-heading .elementor-heading-title.elementor-size-small{font-size:15px}.elementor-widget-heading .elementor-heading-title.elementor-size-medium{font-size:19px}.elementor-widget-heading .elementor-heading-title.elementor-size-large{font-size:29px}.elementor-widget-heading .elementor-heading-title.elementor-size-xl{font-size:39px}.elementor-widget-heading .elementor-heading-title.elementor-size-xxl{font-size:59px}<\/style><h2 class=\"elementor-heading-title elementor-size-default\">AWS Glue est un service de traitement de donn\u00e9es enti\u00e8rement g\u00e9r\u00e9 et \u00e9volutif qui permet aux utilisateurs d\u2019utiliser des workflows ETL (Extract, Transform, Load) sans serveur, pour ainsi s\u2019affranchir de toute la partie gestion de l\u2019infrastructure sous-jacente.<\/h2>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-5765b0d e-flex e-con-boxed e-con\" data-id=\"5765b0d\" data-element_type=\"container\" data-settings=\"{&quot;content_width&quot;:&quot;boxed&quot;}\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-268953a elementor-widget elementor-widget-heading\" data-id=\"268953a\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<h3 class=\"elementor-heading-title elementor-size-default\">Rappel concernant les processus ETL<\/h3>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-4f92708 elementor-widget elementor-widget-text-editor\" data-id=\"4f92708\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<style>\/*! elementor - v3.15.0 - 02-08-2023 *\/\n.elementor-widget-text-editor.elementor-drop-cap-view-stacked .elementor-drop-cap{background-color:#69727d;color:#fff}.elementor-widget-text-editor.elementor-drop-cap-view-framed .elementor-drop-cap{color:#69727d;border:3px solid;background-color:transparent}.elementor-widget-text-editor:not(.elementor-drop-cap-view-default) .elementor-drop-cap{margin-top:8px}.elementor-widget-text-editor:not(.elementor-drop-cap-view-default) .elementor-drop-cap-letter{width:1em;height:1em}.elementor-widget-text-editor .elementor-drop-cap{float:left;text-align:center;line-height:1;font-size:50px}.elementor-widget-text-editor .elementor-drop-cap-letter{display:inline-block}<\/style>\t\t\t\t<p><span style=\"font-weight: 400;\">L\u2019<a href=\"https:\/\/datascientest.com\/extract-transform-load-tout-savoir\">ETL<\/a> est un processus qui a pour but de garantir la qualit\u00e9 et la disponibilit\u00e9 des donn\u00e9es. Il est divis\u00e9 en 3 phases :\u00a0<\/span><\/p><ul><li style=\"font-weight: 400;\" aria-level=\"1\"><b>Extraction <\/b><span style=\"font-weight: 400;\">: r\u00e9cup\u00e9ration des donn\u00e9es depuis des sources diverses<\/span><\/li><li style=\"font-weight: 400;\" aria-level=\"1\"><b>Transformation <\/b><span style=\"font-weight: 400;\">: nettoyage, normalisation, modification des donn\u00e9es pour les rendre exploitables<\/span><\/li><li style=\"font-weight: 400;\" aria-level=\"1\"><b>Chargement <\/b><span style=\"font-weight: 400;\">: charge les donn\u00e9es transform\u00e9es dans un environnement final, tel qu\u2019une base de donn\u00e9es ou un <a href=\"https:\/\/datascientest.com\/data-warehouse-2\">data warehouse<\/a>.<\/span><\/li><\/ul>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-d3b91a7 elementor-widget elementor-widget-image\" data-id=\"d3b91a7\" data-element_type=\"widget\" data-widget_type=\"image.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<style>\/*! elementor - v3.15.0 - 02-08-2023 *\/\n.elementor-widget-image{text-align:center}.elementor-widget-image a{display:inline-block}.elementor-widget-image a img[src$=\".svg\"]{width:48px}.elementor-widget-image img{vertical-align:middle;display:inline-block}<\/style>\t\t\t\t\t\t\t\t\t<figure class=\"wp-caption\">\n\t\t\t\t\t\t\t\t\t\t<img decoding=\"async\" width=\"1080\" height=\"527\" src=\"https:\/\/datascientest.com\/wp-content\/uploads\/2023\/04\/image3-5-e1681996722906.png\" class=\"attachment-full size-full wp-image-198104\" alt=\"\" srcset=\"https:\/\/datascientest.com\/wp-content\/uploads\/2023\/04\/image3-5-e1681996722906.png 1080w, https:\/\/datascientest.com\/wp-content\/uploads\/2023\/04\/image3-5-e1681996722906-300x146.png 300w, https:\/\/datascientest.com\/wp-content\/uploads\/2023\/04\/image3-5-e1681996722906-1024x500.png 1024w, https:\/\/datascientest.com\/wp-content\/uploads\/2023\/04\/image3-5-e1681996722906-768x375.png 768w\" sizes=\"(max-width: 1080px) 100vw, 1080px\" \/>\t\t\t\t\t\t\t\t\t\t\t<figcaption class=\"widget-image-caption wp-caption-text\">Source : Informatica.com<\/figcaption>\n\t\t\t\t\t\t\t\t\t\t<\/figure>\n\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-a14bf32 e-flex e-con-boxed e-con\" data-id=\"a14bf32\" data-element_type=\"container\" data-settings=\"{&quot;content_width&quot;:&quot;boxed&quot;}\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-dc5423e elementor-widget elementor-widget-heading\" data-id=\"dc5423e\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<h3 class=\"elementor-heading-title elementor-size-default\">Comment se structure AWS Glue ?<\/h3>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-6680498 elementor-widget elementor-widget-text-editor\" data-id=\"6680498\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<p><span style=\"font-weight: 400;\">Les jobs de Glue permettent d\u2019accomplir le n\u00e9cessaire requis pour l\u2019extraction, la transformation et le chargement des donn\u00e9es d\u2019une source vers une destination. Le diagramme suivant indique l\u2019architecture de AWS Glue, et nous d\u00e9crivons ensuite les diff\u00e9rents \u00e9l\u00e9ments : <\/span><\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-898dfe4 elementor-widget elementor-widget-image\" data-id=\"898dfe4\" data-element_type=\"widget\" data-widget_type=\"image.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<img decoding=\"async\" width=\"768\" height=\"576\" src=\"https:\/\/datascientest.com\/wp-content\/uploads\/2023\/04\/image1-7.png\" class=\"attachment-full size-full wp-image-198108\" alt=\"\" srcset=\"https:\/\/datascientest.com\/wp-content\/uploads\/2023\/04\/image1-7.png 768w, https:\/\/datascientest.com\/wp-content\/uploads\/2023\/04\/image1-7-300x225.png 300w\" sizes=\"(max-width: 768px) 100vw, 768px\" \/>\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-d2e0e7b elementor-widget elementor-widget-text-editor\" data-id=\"d2e0e7b\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<ul><li style=\"font-weight: 400;\" aria-level=\"1\"><b>Data Catalog (catalogue de donn\u00e9es)<\/b><span style=\"font-weight: 400;\"> : il s\u2019agit du stockage de m\u00e9tadonn\u00e9es permanent dans AWS Glue. Il contient entre autres les d\u00e9finitions de tables, les d\u00e9finitions de jobs, etc.<\/span><\/li><li style=\"font-weight: 400;\" aria-level=\"1\"><b>Base de donn\u00e9es <\/b><span style=\"font-weight: 400;\">: c\u2019est un ensemble de d\u00e9finition de tables de catalogues de donn\u00e9es associ\u00e9es.<\/span><\/li><li style=\"font-weight: 400;\" aria-level=\"1\"><b>Crawler<\/b><span style=\"font-weight: 400;\"> : c\u2019est un programme qui se connecte \u00e0 une source de donn\u00e9es pour en extraire ses donn\u00e9es et d\u00e9terminer leur structure. Il utilise ensuite ces informations pour cr\u00e9er des d\u00e9finitions de table dans le catalogue de donn\u00e9es.<\/span><\/li><li style=\"font-weight: 400;\" aria-level=\"1\"><b>Connexion<\/b><span style=\"font-weight: 400;\"> : cette connexion AWS Glue est le catalogue de donn\u00e9es qui contient les informations n\u00e9cessaires pour se connecter \u00e0 un certain stockage de donn\u00e9es<\/span><\/li><li style=\"font-weight: 400;\" aria-level=\"1\"><b>Classificateur <\/b><span style=\"font-weight: 400;\">: il d\u00e9termine le sch\u00e9ma de donn\u00e9es. AWS Glue fournit des classificateurs pour les types de fichiers les plus courants tels que CSV, Json, etc.<\/span><\/li><li style=\"font-weight: 400;\" aria-level=\"1\"><b>Magasin de donn\u00e9es <\/b><span style=\"font-weight: 400;\">: r\u00e9f\u00e9rentiel pour le stockage des donn\u00e9es de mani\u00e8re persistante.<\/span><\/li><li style=\"font-weight: 400;\" aria-level=\"1\"><b>Data source <\/b><span style=\"font-weight: 400;\">: il s\u2019agit du point d\u2019entr\u00e9e utilis\u00e9 pour le process de transformation<\/span><\/li><li style=\"font-weight: 400;\" aria-level=\"1\"><b>Data target <\/b><span style=\"font-weight: 400;\">: il s\u2019agit de la cible, o\u00f9 seront \u00e9crite les donn\u00e9es une fois transform\u00e9es<\/span><\/li><li style=\"font-weight: 400;\" aria-level=\"1\"><b>Job<\/b><span> : logique m\u00e9tier requise pour les travaux d\u2019ETL et qui est compos\u00e9 des diff\u00e9rents \u00e9l\u00e9ments n\u00e9cessaires.<\/span><\/li><\/ul>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-71e220a elementor-align-center button-principale elementor-widget elementor-widget-button\" data-id=\"71e220a\" data-element_type=\"widget\" data-widget_type=\"button.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<div class=\"elementor-button-wrapper\">\n\t\t\t<a class=\"elementor-button elementor-button-link elementor-size-sm elementor-animation-grow\" href=\"https:\/\/datascientest.com\/formation-aws\">\n\t\t\t\t\t\t<span class=\"elementor-button-content-wrapper\">\n\t\t\t\t\t\t<span class=\"elementor-button-text\">Apprendre \u00e0 utiliser AWS Glue<\/span>\n\t\t<\/span>\n\t\t\t\t\t<\/a>\n\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-20351d8 e-flex e-con-boxed e-con\" data-id=\"20351d8\" data-element_type=\"container\" data-settings=\"{&quot;content_width&quot;:&quot;boxed&quot;}\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-b45adfe elementor-widget elementor-widget-heading\" data-id=\"b45adfe\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<h3 class=\"elementor-heading-title elementor-size-default\">Les fonctionnalit\u00e9s de AWS Glue <\/h3>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-63d29d6 elementor-widget elementor-widget-text-editor\" data-id=\"63d29d6\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<p><span style=\"font-weight: 400;\">AWS Glue vous permet une gestion compl\u00e8te de vos processus ETL par le biais de diff\u00e9rentes fonctionnalit\u00e9s, dont voici les principales et les plus importantes :<\/span><\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-ae3bb74 elementor-widget__width-initial elementor-widget elementor-widget-html\" data-id=\"ae3bb74\" data-element_type=\"widget\" data-widget_type=\"html.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<style type=\"text\/css\">\r\n.tg  {border-collapse:collapse;border-spacing:0;}\r\n.tg td{border-color:black;border-style:solid;border-width:1px;font-family:Arial, sans-serif;font-size:14px;\r\n  overflow:hidden;padding:10px 5px;word-break:normal;}\r\n.tg th{border-color:black;border-style:solid;border-width:1px;font-family:Arial, sans-serif;font-size:14px;\r\n  font-weight:normal;overflow:hidden;padding:10px 5px;word-break:normal;}\r\n.tg .tg-yj5y{background-color:#efefef;border-color:inherit;text-align:center;vertical-align:top}\r\n.tg .tg-dvid{background-color:#efefef;border-color:inherit;font-weight:bold;text-align:left;vertical-align:top}\r\n.tg .tg-y698{background-color:#efefef;border-color:inherit;text-align:left;vertical-align:top}\r\n<\/style>\r\n<table class=\"tg\" style=\"undefined;table-layout: fixed; width: 800px\">\r\n<colgroup>\r\n<col style=\"width: 100px\">\r\n<col style=\"width: 250px\">\r\n<col style=\"width: 450px\">\r\n<\/colgroup>\r\n<thead>\r\n  <tr>\r\n    <th class=\"tg-yj5y\"><img decoding=\"async\" src=\"https:\/\/datascientest.com\/wp-content\/uploads\/2023\/04\/image7-2.png\" alt=\"Image\" width=\"100\" height=\"100\"><\/th>\r\n    <th class=\"tg-dvid\">Collecte et int\u00e9gration de donn\u00e9es<\/th>\r\n    <th class=\"tg-y698\">AWS Glue permet de collecter et d'int\u00e9grer des donn\u00e9es provenant de diff\u00e9rentes sources, telles que des bases de donn\u00e9es, des fichiers plats, des donn\u00e9es en streaming, etc.<\/th>\r\n  <\/tr>\r\n<\/thead>\r\n<tbody>\r\n  <tr>\r\n    <td class=\"tg-yj5y\"><img decoding=\"async\" src=\"https:\/\/datascientest.com\/wp-content\/uploads\/2023\/04\/image9-1.png\" alt=\"Image\" width=\"100\" height=\"93\"><\/td>\r\n    <td class=\"tg-dvid\">Transformation des donn\u00e9es<\/td>\r\n    <td class=\"tg-y698\">Offre un ensemble d'outils pour transformer les donn\u00e9es, y compris des fonctions de traitement de donn\u00e9es, des op\u00e9rations de filtrage, de tri, de jointure, etc.<\/td>\r\n  <\/tr>\r\n  <tr>\r\n    <td class=\"tg-yj5y\"><img decoding=\"async\" src=\"https:\/\/datascientest.com\/wp-content\/uploads\/2023\/04\/image5-4.png\" alt=\"Image\" width=\"100\" height=\"100\"><\/td>\r\n    <td class=\"tg-dvid\">Catalogue de donn\u00e9es<\/td>\r\n    <td class=\"tg-y698\">Permet de cr\u00e9er et de g\u00e9rer un catalogue de m\u00e9tadonn\u00e9es qui facilite la d\u00e9couverte, la recherche et l'analyse des donn\u00e9es.<\/td>\r\n  <\/tr>\r\n  <tr>\r\n    <td class=\"tg-yj5y\"><img decoding=\"async\" src=\"https:\/\/datascientest.com\/wp-content\/uploads\/2023\/04\/image11-1.png\" alt=\"Image\" width=\"100\" height=\"100\"><\/td>\r\n    <td class=\"tg-dvid\">Ex\u00e9cution et planification de t\u00e2ches ETL<\/td>\r\n    <td class=\"tg-y698\">AWS Glue permet de planifier et d'ex\u00e9cuter des t\u00e2ches ETL pour traiter des donn\u00e9es \u00e0 grande \u00e9chelle.<\/td>\r\n  <\/tr>\r\n  <tr>\r\n    <td class=\"tg-yj5y\"><img decoding=\"async\" src=\"https:\/\/datascientest.com\/wp-content\/uploads\/2023\/04\/image4-7.png\" alt=\"Image\" width=\"100\" height=\"100\"><\/td>\r\n    <td class=\"tg-dvid\">Automatisation du workflow<\/td>\r\n    <td class=\"tg-y698\">Offre des fonctionnalit\u00e9s d'automatisation de flux de travail pour orchestrer des t\u00e2ches complexes impliquant plusieurs \u00e9tapes.<\/td>\r\n  <\/tr>\r\n  <tr>\r\n    <td class=\"tg-yj5y\"><img decoding=\"async\" src=\"https:\/\/datascientest.com\/wp-content\/uploads\/2023\/04\/image8-2.png\" alt=\"Image\" width=\"100\" height=\"100\"><\/td>\r\n    <td class=\"tg-dvid\">Jobs personnalis\u00e9s<\/td>\r\n    <td class=\"tg-y698\">Permet de cr\u00e9er des jobs personnalis\u00e9s pour traiter des cas d'utilisation sp\u00e9cifiques. Les jobs personnalis\u00e9s peuvent \u00eatre cr\u00e9\u00e9s \u00e0 l'aide de langages de programmation courants tels que Python et Scala.<\/td>\r\n  <\/tr>\r\n  <tr>\r\n    <td class=\"tg-yj5y\"><img decoding=\"async\" src=\"https:\/\/datascientest.com\/wp-content\/uploads\/2023\/04\/image2-9.png\" alt=\"Image\" width=\"100\" height=\"99\"><\/td>\r\n    <td class=\"tg-dvid\">Gestion des erreurs<\/td>\r\n    <td class=\"tg-y698\">Permet de g\u00e9rer les erreurs rencontr\u00e9es lors du traitement des donn\u00e9es, telles que les erreurs de syntaxe ou les probl\u00e8mes de connectivit\u00e9.<\/td>\r\n  <\/tr>\r\n  <tr>\r\n    <td class=\"tg-yj5y\"><img decoding=\"async\" src=\"https:\/\/datascientest.com\/wp-content\/uploads\/2023\/04\/image6-5.png\" alt=\"Image\" width=\"100\" height=\"100\"><\/td>\r\n    <td class=\"tg-dvid\">Surveillance<\/td>\r\n    <td class=\"tg-y698\">AWS Glue offre des fonctionnalit\u00e9s de monitoring pour suivre les performances des jobs ETL, d\u00e9tecter les erreurs et les probl\u00e8mes de performance, et optimiser l'utilisation des ressources.<\/td>\r\n  <\/tr>\r\n<\/tbody>\r\n<\/table>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-473eafd e-flex e-con-boxed e-con\" data-id=\"473eafd\" data-element_type=\"container\" data-settings=\"{&quot;content_width&quot;:&quot;boxed&quot;}\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-28c25c1 elementor-widget elementor-widget-heading\" data-id=\"28c25c1\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<h3 class=\"elementor-heading-title elementor-size-default\">Avantages et inconv\u00e9nients d\u2019AWS Glue<\/h3>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-0ae70e0 elementor-widget elementor-widget-text-editor\" data-id=\"0ae70e0\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<p><span style=\"font-weight: 400;\">Avant de se lancer dans l\u2019utilisation et l\u2019apprentissage d\u2019AWS Glue, il est important de consid\u00e9rer ses avantages mais \u00e9galement ses inconv\u00e9nients :\u00a0<\/span><\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-e38bc74 elementor-widget__width-initial elementor-widget elementor-widget-html\" data-id=\"e38bc74\" data-element_type=\"widget\" data-widget_type=\"html.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<style type=\"text\/css\">\r\n.tg  {border-collapse:collapse;border-spacing:0;}\r\n.tg td{border-color:black;border-style:solid;border-width:1px;font-family:Arial, sans-serif;font-size:14px;\r\n  overflow:hidden;padding:10px 5px;word-break:normal;}\r\n.tg th{border-color:black;border-style:solid;border-width:1px;font-family:Arial, sans-serif;font-size:14px;\r\n  font-weight:normal;overflow:hidden;padding:10px 5px;word-break:normal;}\r\n.tg .tg-d78e{background-color:#9aff99;text-align:center;vertical-align:top}\r\n.tg .tg-cmwg{background-color:#ffccc9;text-align:center;vertical-align:top}\r\n.tg .tg-s47q{background-color:#9aff99;font-size:20px;font-weight:bold;text-align:center;vertical-align:top}\r\n.tg .tg-rjvs{background-color:#ffccc9;font-size:20px;font-weight:bold;text-align:center;vertical-align:top}\r\n<\/style>\r\n<table class=\"tg\" style=\"undefined;table-layout: fixed; width: 600px\">\r\n<colgroup>\r\n<col style=\"width: 300px\">\r\n<col style=\"width: 300px\">\r\n<\/colgroup>\r\n<thead>\r\n  <tr>\r\n    <th class=\"tg-s47q\">Avantages<\/th>\r\n    <th class=\"tg-rjvs\">Inconv\u00e9nients<\/th>\r\n  <\/tr>\r\n<\/thead>\r\n<tbody>\r\n  <tr>\r\n    <td class=\"tg-d78e\">Gestion de donn\u00e9es \u00e0 grande \u00e9chelle<\/td>\r\n    <td class=\"tg-cmwg\">Co\u00fbts \u00e9lev\u00e9s pour les petites entreprises, ou les projets \u00e0 petite envergure, malgr\u00e9 le fait que le service soit enti\u00e8rement g\u00e9r\u00e9<\/td>\r\n  <\/tr>\r\n  <tr>\r\n    <td class=\"tg-d78e\">Rapidit\u00e9 dans le traitement des donn\u00e9es<\/td>\r\n    <td class=\"tg-cmwg\">Courbe d\u2019apprentissage tr\u00e8s importante<\/td>\r\n  <\/tr>\r\n  <tr>\r\n    <td class=\"tg-d78e\">Int\u00e9gration avec d\u2019autres services AWS<\/td>\r\n    <td class=\"tg-cmwg\">Personnalisations des workflows limit\u00e9es<\/td>\r\n  <\/tr>\r\n  <tr>\r\n    <td class=\"tg-d78e\">Supporte plusieurs langages de programmation<\/td>\r\n    <td class=\"tg-cmwg\">N\u00e9cessite une expertise en data engineering<\/td>\r\n  <\/tr>\r\n  <tr>\r\n    <td class=\"tg-d78e\">Plateforme enti\u00e8rement g\u00e9r\u00e9e<\/td>\r\n    <td class=\"tg-cmwg\" rowspan=\"2\"><\/td>\r\n  <\/tr>\r\n  <tr>\r\n    <td class=\"tg-d78e\">Catalogue de m\u00e9tadonn\u00e9es int\u00e9gr\u00e9<\/td>\r\n  <\/tr>\r\n<\/tbody>\r\n<\/table>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-516315c e-flex e-con-boxed e-con\" data-id=\"516315c\" data-element_type=\"container\" data-settings=\"{&quot;content_width&quot;:&quot;boxed&quot;}\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-50dc582 elementor-widget elementor-widget-heading\" data-id=\"50dc582\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<h3 class=\"elementor-heading-title elementor-size-default\">Conclusion<\/h3>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-a1ed28d elementor-widget elementor-widget-text-editor\" data-id=\"a1ed28d\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<p><span style=\"font-weight: 400;\">Comme vous l\u2019avez certainement compris, AWS Glue est un service enti\u00e8rement g\u00e9r\u00e9 par <a href=\"https:\/\/datascientest.com\/amazon-web-services-tout-savoir\">Amazon AWS<\/a> de gestion des workflows ETL. Sa grande puissance et flexibilit\u00e9 n\u00e9cessite n\u00e9anmoins une courbe d\u2019apprentissage et un investissement tr\u00e8s important afin de le mettre en place afin qu\u2019il r\u00e9ponde aux besoins requis.<\/span><\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-3f9eff1 elementor-align-center button-principale elementor-widget elementor-widget-button\" data-id=\"3f9eff1\" data-element_type=\"widget\" data-widget_type=\"button.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<div class=\"elementor-button-wrapper\">\n\t\t\t<a class=\"elementor-button elementor-button-link elementor-size-sm elementor-animation-grow\" href=\"https:\/\/datascientest.com\/formation-aws\">\n\t\t\t\t\t\t<span class=\"elementor-button-content-wrapper\">\n\t\t\t\t\t\t<span class=\"elementor-button-text\">D\u00e9couvrir le service AWS Glue<\/span>\n\t\t<\/span>\n\t\t\t\t\t<\/a>\n\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-3348713 e-flex e-con-boxed e-con\" data-id=\"3348713\" data-element_type=\"container\" data-settings=\"{&quot;content_width&quot;:&quot;boxed&quot;}\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-8eacfe5 elementor-widget elementor-widget-html\" data-id=\"8eacfe5\" data-element_type=\"widget\" data-widget_type=\"html.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<script type=\"application\/ld+json\">\r\n{\r\n  \"@context\": \"https:\/\/schema.org\",\r\n  \"@type\": \"FAQPage\",\r\n  \"mainEntity\": [{\r\n    \"@type\": \"Question\",\r\n    \"name\": \"Les fonctionnalit\u00e9s de AWS Glue\",\r\n    \"acceptedAnswer\": {\r\n      \"@type\": \"Answer\",\r\n      \"text\": \"AWS Glue permet de collecter et d'int\u00e9grer des donn\u00e9es provenant de diff\u00e9rentes sources, telles que des bases de donn\u00e9es, des fichiers plats, des donn\u00e9es en streaming, etc.\"\r\n    }\r\n  },{\r\n    \"@type\": \"Question\",\r\n    \"name\": \"Comment se structure AWS Glue ?\",\r\n    \"acceptedAnswer\": {\r\n      \"@type\": \"Answer\",\r\n      \"text\": \"Data Catalog (catalogue de donn\u00e9es) : il s\u2019agit du stockage de m\u00e9tadonn\u00e9es permanent dans AWS Glue. Il contient entre autres les d\u00e9finitions de tables, les d\u00e9finitions de jobs, etc. Base de donn\u00e9es : c\u2019est un ensemble de d\u00e9finition de tables de catalogues de donn\u00e9es associ\u00e9es. Crawler : c\u2019est un programme qui se connecte \u00e0 une source de donn\u00e9es pour en extraire ses donn\u00e9es et d\u00e9terminer leur structure. Il utilise ensuite ces informations pour cr\u00e9er des d\u00e9finitions de table dans le catalogue de donn\u00e9es.\"\r\n    }\r\n  },{\r\n    \"@type\": \"Question\",\r\n    \"name\": \"Rappel concernant les processus ETL\",\r\n    \"acceptedAnswer\": {\r\n      \"@type\": \"Answer\",\r\n      \"text\": \"L\u2019ETL est un processus qui a pour but de garantir la qualit\u00e9 et la disponibilit\u00e9 des donn\u00e9es. Il est divis\u00e9 en 3 phases : Extraction : r\u00e9cup\u00e9ration des donn\u00e9es depuis des sources diverses. Transformation : nettoyage, normalisation, modification des donn\u00e9es pour les rendre exploitables. Chargement : charge les donn\u00e9es transform\u00e9es dans un environnement final, tel qu\u2019une base de donn\u00e9es ou un data warehouse.\"\r\n    }\r\n  }]\r\n}\r\n<\/script>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t\t\t<\/div>\n\t\t","protected":false},"excerpt":{"rendered":"<p>AWS Glue est un service de traitement de donn\u00e9es enti\u00e8rement g\u00e9r\u00e9 et \u00e9volutif qui permet aux utilisateurs d\u2019utiliser des workflows ETL (Extract, Transform, Load) sans serveur, pour ainsi s\u2019affranchir de toute la partie gestion de l\u2019infrastructure sous-jacente. Rappel concernant les processus ETL L\u2019ETL est un processus qui a pour but de garantir la qualit\u00e9 et [&hellip;]<\/p>\n","protected":false},"author":79,"featured_media":198102,"comment_status":"open","ping_status":"open","sticky":false,"template":"elementor_theme","format":"standard","meta":{"content-type":"","inline_featured_image":false},"categories":[2411],"tags":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v21.7 (Yoast SEO v21.7) - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>AWS Glue : Qu&#039;est-ce que c&#039;est ? \u00c0 quoi \u00e7a sert ?<\/title>\n<meta name=\"description\" content=\"AWS Glue est un service de traitement de donn\u00e9es enti\u00e8rement g\u00e9r\u00e9 et \u00e9volutif qui permet aux utilisateurs d\u2019utiliser des workflows ETL (Extract, Transform, Load) sans serveur.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/datascientest.com\/aws-glue-tout-savoir\" \/>\n<meta property=\"og:locale\" content=\"fr_FR\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"AWS Glue : Qu&#039;est-ce que c&#039;est ? \u00c0 quoi \u00e7a sert ?\" \/>\n<meta property=\"og:url\" content=\"https:\/\/datascientest.com\/aws-glue-tout-savoir\" \/>\n<meta property=\"og:site_name\" content=\"Formation Data Science | DataScientest.com\" \/>\n<meta property=\"article:published_time\" content=\"2023-05-09T07:30:00+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-11-09T14:21:59+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/datascientest.com\/wp-content\/uploads\/2023\/04\/AWS_GLUE_datascientest.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1200\" \/>\n\t<meta property=\"og:image:height\" content=\"600\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Dan Cohen\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"\u00c9crit par\" \/>\n\t<meta name=\"twitter:data1\" content=\"Dan Cohen\" \/>\n\t<meta name=\"twitter:label2\" content=\"Dur\u00e9e de lecture estim\u00e9e\" \/>\n\t<meta name=\"twitter:data2\" content=\"6 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/datascientest.com\/aws-glue-tout-savoir\",\"url\":\"https:\/\/datascientest.com\/aws-glue-tout-savoir\",\"name\":\"AWS Glue : Qu'est-ce que c'est ? \u00c0 quoi \u00e7a sert ?\",\"isPartOf\":{\"@id\":\"https:\/\/datascientest.com\/#website\"},\"datePublished\":\"2023-05-09T07:30:00+00:00\",\"dateModified\":\"2023-11-09T14:21:59+00:00\",\"author\":{\"@id\":\"https:\/\/datascientest.com\/#\/schema\/person\/61997d589648bc1d367f632ba686e354\"},\"description\":\"AWS Glue est un service de traitement de donn\u00e9es enti\u00e8rement g\u00e9r\u00e9 et \u00e9volutif qui permet aux utilisateurs d\u2019utiliser des workflows ETL (Extract, Transform, Load) sans serveur.\",\"inLanguage\":\"fr-FR\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/datascientest.com\/aws-glue-tout-savoir\"]}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/datascientest.com\/#website\",\"url\":\"https:\/\/datascientest.com\/\",\"name\":\"Formation Data Science | DataScientest.com\",\"description\":\"Leader de la formation en Data Science\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/datascientest.com\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"fr-FR\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/datascientest.com\/#\/schema\/person\/61997d589648bc1d367f632ba686e354\",\"name\":\"Dan Cohen\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"fr-FR\",\"@id\":\"https:\/\/datascientest.com\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/datascientest.com\/wp-content\/uploads\/2023\/11\/dancohen.jpeg\",\"contentUrl\":\"https:\/\/datascientest.com\/wp-content\/uploads\/2023\/11\/dancohen.jpeg\",\"caption\":\"Dan Cohen\"},\"description\":\"Dan Cohen est actuellement Data Engineer chez DataScientest. Il poss\u00e8de une solide exp\u00e9rience dans le domaine de la data, ayant pr\u00e9c\u00e9demment occup\u00e9 des postes de Consultant en Data Science chez Meotec, Data Engineer chez Cetim, et Ing\u00e9nieur commercial chez Global D\u00e9co &amp; Food.\",\"sameAs\":[\"https:\/\/www.linkedin.com\/in\/dancohen1307\/\",\"Cloud & Data Engineering\"],\"url\":\"https:\/\/datascientest.com\/author\/dancohen\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"AWS Glue : Qu'est-ce que c'est ? \u00c0 quoi \u00e7a sert ?","description":"AWS Glue est un service de traitement de donn\u00e9es enti\u00e8rement g\u00e9r\u00e9 et \u00e9volutif qui permet aux utilisateurs d\u2019utiliser des workflows ETL (Extract, Transform, Load) sans serveur.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/datascientest.com\/aws-glue-tout-savoir","og_locale":"fr_FR","og_type":"article","og_title":"AWS Glue : Qu'est-ce que c'est ? \u00c0 quoi \u00e7a sert ?","og_url":"https:\/\/datascientest.com\/aws-glue-tout-savoir","og_site_name":"Formation Data Science | DataScientest.com","article_published_time":"2023-05-09T07:30:00+00:00","article_modified_time":"2023-11-09T14:21:59+00:00","og_image":[{"width":1200,"height":600,"url":"https:\/\/datascientest.com\/wp-content\/uploads\/2023\/04\/AWS_GLUE_datascientest.png","type":"image\/png"}],"author":"Dan Cohen","twitter_card":"summary_large_image","twitter_misc":{"\u00c9crit par":"Dan Cohen","Dur\u00e9e de lecture estim\u00e9e":"6 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/datascientest.com\/aws-glue-tout-savoir","url":"https:\/\/datascientest.com\/aws-glue-tout-savoir","name":"AWS Glue : Qu'est-ce que c'est ? \u00c0 quoi \u00e7a sert ?","isPartOf":{"@id":"https:\/\/datascientest.com\/#website"},"datePublished":"2023-05-09T07:30:00+00:00","dateModified":"2023-11-09T14:21:59+00:00","author":{"@id":"https:\/\/datascientest.com\/#\/schema\/person\/61997d589648bc1d367f632ba686e354"},"description":"AWS Glue est un service de traitement de donn\u00e9es enti\u00e8rement g\u00e9r\u00e9 et \u00e9volutif qui permet aux utilisateurs d\u2019utiliser des workflows ETL (Extract, Transform, Load) sans serveur.","inLanguage":"fr-FR","potentialAction":[{"@type":"ReadAction","target":["https:\/\/datascientest.com\/aws-glue-tout-savoir"]}]},{"@type":"WebSite","@id":"https:\/\/datascientest.com\/#website","url":"https:\/\/datascientest.com\/","name":"Formation Data Science | DataScientest.com","description":"Leader de la formation en Data Science","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/datascientest.com\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"fr-FR"},{"@type":"Person","@id":"https:\/\/datascientest.com\/#\/schema\/person\/61997d589648bc1d367f632ba686e354","name":"Dan Cohen","image":{"@type":"ImageObject","inLanguage":"fr-FR","@id":"https:\/\/datascientest.com\/#\/schema\/person\/image\/","url":"https:\/\/datascientest.com\/wp-content\/uploads\/2023\/11\/dancohen.jpeg","contentUrl":"https:\/\/datascientest.com\/wp-content\/uploads\/2023\/11\/dancohen.jpeg","caption":"Dan Cohen"},"description":"Dan Cohen est actuellement Data Engineer chez DataScientest. Il poss\u00e8de une solide exp\u00e9rience dans le domaine de la data, ayant pr\u00e9c\u00e9demment occup\u00e9 des postes de Consultant en Data Science chez Meotec, Data Engineer chez Cetim, et Ing\u00e9nieur commercial chez Global D\u00e9co &amp; Food.","sameAs":["https:\/\/www.linkedin.com\/in\/dancohen1307\/","Cloud & Data Engineering"],"url":"https:\/\/datascientest.com\/author\/dancohen"}]}},"_links":{"self":[{"href":"https:\/\/datascientest.com\/wp-json\/wp\/v2\/posts\/198100"}],"collection":[{"href":"https:\/\/datascientest.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/datascientest.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/datascientest.com\/wp-json\/wp\/v2\/users\/79"}],"replies":[{"embeddable":true,"href":"https:\/\/datascientest.com\/wp-json\/wp\/v2\/comments?post=198100"}],"version-history":[{"count":0,"href":"https:\/\/datascientest.com\/wp-json\/wp\/v2\/posts\/198100\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/datascientest.com\/wp-json\/wp\/v2\/media\/198102"}],"wp:attachment":[{"href":"https:\/\/datascientest.com\/wp-json\/wp\/v2\/media?parent=198100"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/datascientest.com\/wp-json\/wp\/v2\/categories?post=198100"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/datascientest.com\/wp-json\/wp\/v2\/tags?post=198100"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}