{"id":177334,"date":"2024-01-21T17:58:24","date_gmt":"2024-01-21T16:58:24","guid":{"rendered":"https:\/\/datascientest.com\/en\/?p=177334"},"modified":"2024-01-21T18:00:33","modified_gmt":"2024-01-21T17:00:33","slug":"aws-glue-what-is-it-whats-it-for","status":"publish","type":"post","link":"https:\/\/datascientest.com\/en\/aws-glue-what-is-it-whats-it-for","title":{"rendered":"AWS Glue: What is it? What&#8217;s it for?"},"content":{"rendered":"\t\t<div data-elementor-type=\"wp-post\" data-elementor-id=\"177334\" class=\"elementor elementor-177334\" data-elementor-post-type=\"post\">\n\t\t\t\t\t\t\t<div class=\"elementor-element elementor-element-4307e59 e-flex e-con-boxed e-con\" data-id=\"4307e59\" data-element_type=\"container\" data-settings=\"{&quot;content_width&quot;:&quot;boxed&quot;}\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-6c5d868 elementor-widget elementor-widget-heading\" data-id=\"6c5d868\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<style>\/*! elementor - v3.15.0 - 02-08-2023 *\/\n.elementor-heading-title{padding:0;margin:0;line-height:1}.elementor-widget-heading .elementor-heading-title[class*=elementor-size-]>a{color:inherit;font-size:inherit;line-height:inherit}.elementor-widget-heading .elementor-heading-title.elementor-size-small{font-size:15px}.elementor-widget-heading .elementor-heading-title.elementor-size-medium{font-size:19px}.elementor-widget-heading .elementor-heading-title.elementor-size-large{font-size:29px}.elementor-widget-heading .elementor-heading-title.elementor-size-xl{font-size:39px}.elementor-widget-heading .elementor-heading-title.elementor-size-xxl{font-size:59px}<\/style><h2 class=\"elementor-heading-title elementor-size-default\">AWS Glue is a fully managed, scalable data processing service that enables users to run serverless ETL (Extract, Transform, Load) workflows, freeing them from the need to manage the underlying infrastructure.<\/h2>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-be7aec4 e-flex e-con-boxed e-con\" data-id=\"be7aec4\" data-element_type=\"container\" data-settings=\"{&quot;content_width&quot;:&quot;boxed&quot;}\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-9dbe2da elementor-widget elementor-widget-heading\" data-id=\"9dbe2da\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<h3 class=\"elementor-heading-title elementor-size-default\">A reminder about ETL processes<\/h3>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-d977fbf elementor-widget elementor-widget-text-editor\" data-id=\"d977fbf\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<style>\/*! elementor - v3.15.0 - 02-08-2023 *\/\n.elementor-widget-text-editor.elementor-drop-cap-view-stacked .elementor-drop-cap{background-color:#69727d;color:#fff}.elementor-widget-text-editor.elementor-drop-cap-view-framed .elementor-drop-cap{color:#69727d;border:3px solid;background-color:transparent}.elementor-widget-text-editor:not(.elementor-drop-cap-view-default) .elementor-drop-cap{margin-top:8px}.elementor-widget-text-editor:not(.elementor-drop-cap-view-default) .elementor-drop-cap-letter{width:1em;height:1em}.elementor-widget-text-editor .elementor-drop-cap{float:left;text-align:center;line-height:1;font-size:50px}.elementor-widget-text-editor .elementor-drop-cap-letter{display:inline-block}<\/style>\t\t\t\t<p><strong>ETL<\/strong> is a process designed to guarantee data quality and availability. It is divided into 3 phases:<\/p><ul><li><strong>Extraction<\/strong>: recovery of data from various sources<\/li><li><strong>Transformation:<\/strong> <a href=\"https:\/\/datascientest.com\/en\/data-cleaning-definition-methods-and-relevance-in-data-science\">cleansing, normalizing and modifying data to make it usable<\/a><\/li><li><strong>Loading:<\/strong> loading transformed data into a final environment, such as a database or <a href=\"https:\/\/datascientest.com\/en\/data-warehouse-2\">data warehouse.<\/a><\/li><\/ul>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-4329e20 elementor-widget elementor-widget-image\" data-id=\"4329e20\" data-element_type=\"widget\" data-widget_type=\"image.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<style>\/*! elementor - v3.15.0 - 02-08-2023 *\/\n.elementor-widget-image{text-align:center}.elementor-widget-image a{display:inline-block}.elementor-widget-image a img[src$=\".svg\"]{width:48px}.elementor-widget-image img{vertical-align:middle;display:inline-block}<\/style>\t\t\t\t\t\t\t\t\t<figure class=\"wp-caption\">\n\t\t\t\t\t\t\t\t\t\t<img decoding=\"async\" src=\"https:\/\/datascientest.com\/wp-content\/uploads\/2023\/04\/image3-5-e1681996722906.png\" title=\"\" alt=\"\" loading=\"lazy\" \/>\t\t\t\t\t\t\t\t\t\t\t<figcaption class=\"widget-image-caption wp-caption-text\">Source : Informatica.com<\/figcaption>\n\t\t\t\t\t\t\t\t\t\t<\/figure>\n\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-d729661 e-flex e-con-boxed e-con\" data-id=\"d729661\" data-element_type=\"container\" data-settings=\"{&quot;content_width&quot;:&quot;boxed&quot;}\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-2fc7dcc elementor-widget elementor-widget-heading\" data-id=\"2fc7dcc\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<h3 class=\"elementor-heading-title elementor-size-default\">How is AWS Glue structured?<\/h3>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-07ed00e elementor-widget elementor-widget-text-editor\" data-id=\"07ed00e\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<p><strong>AWS Glu<\/strong>e jobs perform the necessary extraction, transformation and loading of data from a source to a destination. The following diagram shows the architecture of <strong>AWS Glue,<\/strong> and then we describe the various elements:<\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-250b5e1 elementor-widget elementor-widget-image\" data-id=\"250b5e1\" data-element_type=\"widget\" data-widget_type=\"image.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t\t\t\t<figure class=\"wp-caption\">\n\t\t\t\t\t\t\t\t\t\t<img decoding=\"async\" src=\"https:\/\/datascientest.com\/wp-content\/uploads\/2023\/04\/image1-7.png\" title=\"\" alt=\"\" loading=\"lazy\" \/>\t\t\t\t\t\t\t\t\t\t\t<figcaption class=\"widget-image-caption wp-caption-text\"><\/figcaption>\n\t\t\t\t\t\t\t\t\t\t<\/figure>\n\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-edbefb9 elementor-widget elementor-widget-text-editor\" data-id=\"edbefb9\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<ul><li style=\"font-weight: 400;\" aria-level=\"1\"><strong>Data Catalog:<\/strong> this is the permanent metadata storage in<strong> AWS Glue<\/strong>. It contains table definitions, job definitions, etc.<\/li><li style=\"font-weight: 400;\" aria-level=\"1\"><strong>Database:<\/strong> a set of table definitions for associated data catalogs.<\/li><li style=\"font-weight: 400;\" aria-level=\"1\"><strong>Crawler:<\/strong> a program that connects to a data source to extract its data and determine its structure. It then uses this information to create table definitions in the data catalog.<\/li><li style=\"font-weight: 400;\" aria-level=\"1\"><strong>Connection:<\/strong> this<strong> AWS Glue<\/strong> connection is the data catalog that contains the information needed to connect to a certain data store.<\/li><li style=\"font-weight: 400;\" aria-level=\"1\"><strong>Classifier:<\/strong> determines the data schema.<strong> AWS Glue<\/strong> provides classifiers for the most common file types, such as CSV, Json, etc.<\/li><li style=\"font-weight: 400;\" aria-level=\"1\"><strong>Data store<\/strong>: repository for persistent data storage.<\/li><li style=\"font-weight: 400;\" aria-level=\"1\"><strong>Data source<\/strong>: this is the entry point used for the transformation process.<\/li><li style=\"font-weight: 400;\" aria-level=\"1\"><strong>Data target<\/strong>: the target to which the transformed data will be written.<\/li><li style=\"font-weight: 400;\" aria-level=\"1\"><strong>Job:<\/strong> the business logic required for ETL jobs, made up of the various elements required.<\/li><\/ul>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-3089c5f elementor-align-center button-principale elementor-widget elementor-widget-button\" data-id=\"3089c5f\" data-element_type=\"widget\" data-widget_type=\"button.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<div class=\"elementor-button-wrapper\">\n\t\t\t<a class=\"elementor-button elementor-button-link elementor-size-sm elementor-animation-grow\" href=\"https:\/\/datascientest.com\/en\/aws-training\">\n\t\t\t\t\t\t<span class=\"elementor-button-content-wrapper\">\n\t\t\t\t\t\t<span class=\"elementor-button-text\">Learn how to use AWS Glue<\/span>\n\t\t<\/span>\n\t\t\t\t\t<\/a>\n\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-e200922 e-flex e-con-boxed e-con\" data-id=\"e200922\" data-element_type=\"container\" data-settings=\"{&quot;content_width&quot;:&quot;boxed&quot;}\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-0de4797 elementor-widget elementor-widget-heading\" data-id=\"0de4797\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<h3 class=\"elementor-heading-title elementor-size-default\">AWS Glue features <\/h3>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-381ddab elementor-widget elementor-widget-text-editor\" data-id=\"381ddab\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<p><strong>AWS Glue<\/strong> allows you to fully manage your <strong>ETL processes<\/strong> through a variety of features, the most important of which are listed below:<\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-c8d39bf elementor-widget__width-initial elementor-widget elementor-widget-html\" data-id=\"c8d39bf\" data-element_type=\"widget\" data-widget_type=\"html.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<style type=\"text\/css\">\n.tg  {border-collapse:collapse;border-spacing:0;}\n.tg td{border-color:black;border-style:solid;border-width:1px;font-family:Arial, sans-serif;font-size:14px;\n  overflow:hidden;padding:10px 5px;word-break:normal;}\n.tg th{border-color:black;border-style:solid;border-width:1px;font-family:Arial, sans-serif;font-size:14px;\n  font-weight:normal;overflow:hidden;padding:10px 5px;word-break:normal;}\n.tg .tg-yj5y{background-color:#efefef;border-color:inherit;text-align:center;vertical-align:top}\n.tg .tg-dvid{background-color:#efefef;border-color:inherit;font-weight:bold;text-align:left;vertical-align:top}\n.tg .tg-y698{background-color:#efefef;border-color:inherit;text-align:left;vertical-align:top}\n<\/style>\n<table class=\"tg\" style=\"undefined;table-layout: fixed; width: 800px\">\n<colgroup>\n<col style=\"width: 100px\">\n<col style=\"width: 250px\">\n<col style=\"width: 450px\">\n<\/colgroup>\n<thead>\n  <tr>\n    <th class=\"tg-yj5y\"><img decoding=\"async\" src=\"https:\/\/datascientest.com\/wp-content\/uploads\/2023\/04\/image7-2.png\" alt=\"Image\" width=\"100\" height=\"100\"><\/th>\n    <th class=\"tg-dvid\">Data Collection and Integration<\/th>\n    <th class=\"tg-y698\">AWS Glue allows for the collection and integration of data from various sources, including databases, flat files, streaming data, etc.<\/th>\n  <\/tr>\n<\/thead>\n<tbody>\n  <tr>\n    <td class=\"tg-yj5y\"><img decoding=\"async\" src=\"https:\/\/datascientest.com\/wp-content\/uploads\/2023\/04\/image9-1.png\" alt=\"Image\" width=\"100\" height=\"93\"><\/td>\n    <td class=\"tg-dvid\">Data Transformation<\/td>\n    <td class=\"tg-y698\">Provides a set of tools for transforming data, including data processing functions, filtering, sorting, joining, and more.<\/td>\n  <\/tr>\n  <tr>\n    <td class=\"tg-yj5y\"><img decoding=\"async\" src=\"https:\/\/datascientest.com\/wp-content\/uploads\/2023\/04\/image5-4.png\" alt=\"Image\" width=\"100\" height=\"100\"><\/td>\n    <td class=\"tg-dvid\">Data Catalog<\/td>\n    <td class=\"tg-y698\">Allows for the creation and management of a metadata catalog that facilitates data discovery, search, and analysis.<\/td>\n  <\/tr>\n  <tr>\n    <td class=\"tg-yj5y\"><img decoding=\"async\" src=\"https:\/\/datascientest.com\/wp-content\/uploads\/2023\/04\/image11-1.png\" alt=\"Image\" width=\"100\" height=\"100\"><\/td>\n    <td class=\"tg-dvid\">ETL Task Execution and Scheduling<\/td>\n    <td class=\"tg-y698\">AWS Glue enables the scheduling and execution of ETL tasks to process data at scale.<\/td>\n  <\/tr>\n  <tr>\n    <td class=\"tg-yj5y\"><img decoding=\"async\" src=\"https:\/\/datascientest.com\/wp-content\/uploads\/2023\/04\/image4-7.png\" alt=\"Image\" width=\"100\" height=\"100\"><\/td>\n    <td class=\"tg-dvid\">Workflow Automation<\/td>\n    <td class=\"tg-y698\">Offers workflow automation features to orchestrate complex tasks involving multiple steps.<\/td>\n  <\/tr>\n  <tr>\n    <td class=\"tg-yj5y\"><img decoding=\"async\" src=\"https:\/\/datascientest.com\/wp-content\/uploads\/2023\/04\/image8-2.png\" alt=\"Image\" width=\"100\" height=\"100\"><\/td>\n    <td class=\"tg-dvid\">Custom Jobs<\/td>\n    <td class=\"tg-y698\">Enables the creation of custom jobs to address specific use cases. Custom jobs can be created using common programming languages such as Python and Scala.<\/td>\n  <\/tr>\n  <tr>\n    <td class=\"tg-yj5y\"><img decoding=\"async\" src=\"https:\/\/datascientest.com\/wp-content\/uploads\/2023\/04\/image2-9.png\" alt=\"Image\" width=\"100\" height=\"99\"><\/td>\n    <td class=\"tg-dvid\">Error Handling<\/td>\n    <td class=\"tg-y698\">Allows for the management of errors encountered during data processing, such as syntax errors or connectivity issues.<\/td>\n  <\/tr>\n  <tr>\n    <td class=\"tg-yj5y\"><img decoding=\"async\" src=\"https:\/\/datascientest.com\/wp-content\/uploads\/2023\/04\/image6-5.png\" alt=\"Image\" width=\"100\" height=\"100\"><\/td>\n    <td class=\"tg-dvid\">Monitoring<\/td>\n    <td class=\"tg-y698\">AWS Glue provides monitoring features to track ETL job performance, detect errors and performance issues, and optimize resource utilization.<\/td>\n  <\/tr>\n<\/tbody>\n<\/table>\n\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-98d57e9 e-flex e-con-boxed e-con\" data-id=\"98d57e9\" data-element_type=\"container\" data-settings=\"{&quot;content_width&quot;:&quot;boxed&quot;}\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-b788d1f elementor-widget elementor-widget-heading\" data-id=\"b788d1f\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<h3 class=\"elementor-heading-title elementor-size-default\">Advantages and disadvantages of AWS Glue<\/h3>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-92f57a7 elementor-widget elementor-widget-text-editor\" data-id=\"92f57a7\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<p>Before embarking on using and learning<strong> AWS Glue,<\/strong> it&#8217;s important to consider both its advantages and disadvantages:<\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-43e47ac elementor-widget__width-initial elementor-widget elementor-widget-html\" data-id=\"43e47ac\" data-element_type=\"widget\" data-widget_type=\"html.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<style type=\"text\/css\">\n.tg  {border-collapse:collapse;border-spacing:0;}\n.tg td{border-color:black;border-style:solid;border-width:1px;font-family:Arial, sans-serif;font-size:14px;\n  overflow:hidden;padding:10px 5px;word-break:normal;}\n.tg th{border-color:black;border-style:solid;border-width:1px;font-family:Arial, sans-serif;font-size:14px;\n  font-weight:normal;overflow:hidden;padding:10px 5px;word-break:normal;}\n.tg .tg-d78e{background-color:#9aff99;text-align:center;vertical-align:top}\n.tg .tg-cmwg{background-color:#ffccc9;text-align:center;vertical-align:top}\n.tg .tg-s47q{background-color:#9aff99;font-size:20px;font-weight:bold;text-align:center;vertical-align:top}\n.tg .tg-rjvs{background-color:#ffccc9;font-size:20px;font-weight:bold;text-align:center;vertical-align:top}\n<\/style>\n<table class=\"tg\" style=\"undefined;table-layout: fixed; width: 600px\">\n<colgroup>\n<col style=\"width: 300px\">\n<col style=\"width: 300px\">\n<\/colgroup>\n<thead>\n  <tr>\n    <th class=\"tg-s47q\">Advantages<\/th>\n    <th class=\"tg-rjvs\">Disadvantages<\/th>\n  <\/tr>\n<\/thead>\n<tbody>\n  <tr>\n    <td class=\"tg-d78e\">Large-scale data management<\/td>\n    <td class=\"tg-cmwg\">High costs for small businesses or small-scale projects, despite being a fully managed service<\/td>\n  <\/tr>\n  <tr>\n    <td class=\"tg-d78e\">Fast data processing<\/td>\n    <td class=\"tg-cmwg\">Steep learning curve<\/td>\n  <\/tr>\n  <tr>\n    <td class=\"tg-d78e\">Integration with other AWS services<\/td>\n    <td class=\"tg-cmwg\">Limited workflow customizations<\/td>\n  <\/tr>\n  <tr>\n    <td class=\"tg-d78e\">Support for multiple programming languages<\/td>\n    <td class=\"tg-cmwg\">Requires expertise in data engineering<\/td>\n  <\/tr>\n  <tr>\n    <td class=\"tg-d78e\">Fully managed platform<\/td>\n    <td class=\"tg-cmwg\" rowspan=\"2\"><\/td>\n  <\/tr>\n  <tr>\n    <td class=\"tg-d78e\">Built-in metadata catalog<\/td>\n  <\/tr>\n<\/tbody>\n<\/table>\n\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-0976420 e-flex e-con-boxed e-con\" data-id=\"0976420\" data-element_type=\"container\" data-settings=\"{&quot;content_width&quot;:&quot;boxed&quot;}\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-cc53c2b elementor-widget elementor-widget-heading\" data-id=\"cc53c2b\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<h3 class=\"elementor-heading-title elementor-size-default\">Conclusion<\/h3>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-85645fc elementor-widget elementor-widget-text-editor\" data-id=\"85645fc\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<p>As you&#8217;ve probably gathered by now, AWS Glue is a fully managed <a href=\"https:\/\/datascientest.com\/en\/etl-or-extract-transform-load-definition-and-use\">Amazon AWS ETL workflow service.<\/a> Its great power and flexibility nevertheless require a steep learning curve and a very substantial investment in order to set it up to meet the required needs.<\/p><p>\u00a0<\/p><p>\ud83d\udca1 Related articles:<\/p><table dir=\"ltr\" border=\"1\" cellspacing=\"0\" cellpadding=\"0\" data-sheets-root=\"1\"><colgroup><col width=\"656\" \/><\/colgroup><tbody><tr><td data-sheets-value=\"{&quot;1&quot;:2,&quot;2&quot;:&quot;AWS Elastic Load Balancer: The solution that distributes network traffic&quot;}\" data-sheets-hyperlink=\"https:\/\/datascientest.com\/en\/aws-elastic-load-balancer-the-solution-that-distributes-network-traffic\"><a class=\"in-cell-link\" href=\"https:\/\/datascientest.com\/en\/aws-elastic-load-balancer-the-solution-that-distributes-network-traffic\" target=\"_blank\" rel=\"noopener\">AWS Elastic Load Balancer: The solution that distributes network traffic<\/a><\/td><\/tr><tr><td data-sheets-value=\"{&quot;1&quot;:2,&quot;2&quot;:&quot;Jam AWS: The playful Amazon learning platform&quot;}\" data-sheets-hyperlink=\"https:\/\/datascientest.com\/en\/jam-aws-the-playful-learning-platform-from-amazon\"><a class=\"in-cell-link\" href=\"https:\/\/datascientest.com\/en\/jam-aws-the-playful-learning-platform-from-amazon\" target=\"_blank\" rel=\"noopener\">Jam AWS: The playful Amazon learning platform<\/a><\/td><\/tr><tr><td data-sheets-value=\"{&quot;1&quot;:2,&quot;2&quot;:&quot;AWS Lambda: Introduction to the Serverless Function&quot;}\" data-sheets-hyperlink=\"https:\/\/datascientest.com\/en\/aws-lambda-introduction-to-the-serverless-function\"><a class=\"in-cell-link\" href=\"https:\/\/datascientest.com\/en\/aws-lambda-introduction-to-the-serverless-function\" target=\"_blank\" rel=\"noopener\">AWS Lambda: Introduction to the Serverless Function<\/a><\/td><\/tr><tr><td data-sheets-value=\"{&quot;1&quot;:2,&quot;2&quot;:&quot;AWS Certification: What is it and how do I get it? &quot;}\" data-sheets-hyperlink=\"https:\/\/datascientest.com\/en\/aws-certification-what-is-it-and-how-do-i-get-it\"><a class=\"in-cell-link\" href=\"https:\/\/datascientest.com\/en\/aws-certification-what-is-it-and-how-do-i-get-it\" target=\"_blank\" rel=\"noopener\">AWS Certification: What is it and how do I get it? <\/a><\/td><\/tr><tr><td data-sheets-value=\"{&quot;1&quot;:2,&quot;2&quot;:&quot;AWS SageMaker: A guide for using the platform&quot;}\" data-sheets-hyperlink=\"https:\/\/datascientest.com\/en\/aws-sagemaker-a-guide-for-using-the-platform\"><a class=\"in-cell-link\" href=\"https:\/\/datascientest.com\/en\/aws-sagemaker-a-guide-for-using-the-platform\" target=\"_blank\" rel=\"noopener\">AWS SageMaker: A guide for using the platform<\/a><\/td><\/tr><tr><td data-sheets-value=\"{&quot;1&quot;:2,&quot;2&quot;:&quot;5 AWS launches and announcements making developers\u2019 life easy in 2022&quot;}\" data-sheets-hyperlink=\"https:\/\/datascientest.com\/en\/5-aws-launches-and-announcements-making-developers-life-easy-in-2022\"><a class=\"in-cell-link\" href=\"https:\/\/datascientest.com\/en\/5-aws-launches-and-announcements-making-developers-life-easy-in-2022\" target=\"_blank\" rel=\"noopener\">5 AWS launches and announcements making developers\u2019 life easy in 2022<\/a><\/td><\/tr><\/tbody><\/table>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-8cd42b8 elementor-align-center button-principale elementor-widget elementor-widget-button\" data-id=\"8cd42b8\" data-element_type=\"widget\" data-widget_type=\"button.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<div class=\"elementor-button-wrapper\">\n\t\t\t<a class=\"elementor-button elementor-button-link elementor-size-sm elementor-animation-grow\" href=\"https:\/\/datascientest.com\/en\/aws-training\">\n\t\t\t\t\t\t<span class=\"elementor-button-content-wrapper\">\n\t\t\t\t\t\t<span class=\"elementor-button-text\">Discover the AWS Glue service<\/span>\n\t\t<\/span>\n\t\t\t\t\t<\/a>\n\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-0b8a963 e-flex e-con-boxed e-con\" data-id=\"0b8a963\" data-element_type=\"container\" data-settings=\"{&quot;content_width&quot;:&quot;boxed&quot;}\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-fbff04e elementor-widget elementor-widget-html\" data-id=\"fbff04e\" data-element_type=\"widget\" data-widget_type=\"html.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<script type=\"application\/ld+json\">\n{\n  \"@context\": \"https:\/\/schema.org\",\n  \"@type\": \"FAQPage\",\n  \"mainEntity\": [{\n    \"@type\": \"Question\",\n    \"name\": \"AWS Glue features\",\n    \"acceptedAnswer\": {\n      \"@type\": \"Answer\",\n      \"text\": \"AWS Glue enables you to collect and integrate data from different sources, such as databases, flat files, streaming data, etc.\"\n    }\n  },{\n    \"@type\": \"Question\",\n    \"name\": \"How is AWS Glue structured?\",\n    \"acceptedAnswer\": {\n      \"@type\": \"Answer\",\n      \"text\": \"Data Catalog: This is the permanent metadata store in AWS Glue. It contains table definitions, job definitions, etc. Database: this is a set of associated data catalog table definitions. Crawler: a program that connects to a data source to extract its data and determine its structure. It then uses this information to create table definitions in the data catalog.\"\n    }\n  },{\n    \"@type\": \"Question\",\n    \"name\": \"Reminder about ETL processes\",\n    \"acceptedAnswer\": {\n      \"@type\": \"Answer\",\n      \"text\": \"ETL is a process designed to guarantee data quality and availability. It is divided into 3 phases: Extraction: recovery of data from various sources. Transformation: cleansing, normalizing and modifying data to make it usable. Loading: loading transformed data into a final environment, such as a database or data warehouse.\"\n    }\n  }]\n}\n<\/script>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t\t\t<\/div>\n\t\t","protected":false},"excerpt":{"rendered":"<p>AWS Glue is a fully managed, scalable data processing service that enables users to run serverless ETL (Extract, Transform, Load) workflows, freeing them from the need to manage the underlying infrastructure. A reminder about ETL processes ETL is a process designed to guarantee data quality and availability. It is divided into 3 phases: Extraction: recovery [&hellip;]<\/p>\n","protected":false},"author":67,"featured_media":177351,"comment_status":"open","ping_status":"open","sticky":false,"template":"elementor_theme","format":"standard","meta":{"content-type":"","inline_featured_image":false},"categories":[2412],"tags":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v21.7 (Yoast SEO v21.7) - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>AWS Glue: What is it? What&#039;s it for?<\/title>\n<meta name=\"description\" content=\"AWS Glue is a fully managed extract, transform, and load (ETL) service offered by Amazon Web Services (AWS). It automates the process of preparing and loading data for analysis.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/datascientest.com\/en\/aws-glue-what-is-it-whats-it-for\" \/>\n<meta property=\"og:locale\" content=\"en_GB\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"AWS Glue: What is it? What&#039;s it for?\" \/>\n<meta property=\"og:description\" content=\"AWS Glue is a fully managed, scalable data processing service that enables users to run serverless ETL (Extract, Transform, Load) workflows, freeing them\" \/>\n<meta property=\"og:url\" content=\"https:\/\/datascientest.com\/en\/aws-glue-what-is-it-whats-it-for\" \/>\n<meta property=\"og:site_name\" content=\"DataScientest\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/DataScientestEN\" \/>\n<meta property=\"article:published_time\" content=\"2024-01-21T16:58:24+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2024-01-21T17:00:33+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/datascientest.com\/en\/files\/2024\/01\/AWS_GLUE_datascientest.webp\" \/>\n\t<meta property=\"og:image:width\" content=\"1024\" \/>\n\t<meta property=\"og:image:height\" content=\"512\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/webp\" \/>\n<meta name=\"author\" content=\"Melanie\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@DataScientest__\" \/>\n<meta name=\"twitter:site\" content=\"@DataScientest__\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Melanie\" \/>\n\t<meta name=\"twitter:label2\" content=\"Estimated reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"5 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/datascientest.com\/en\/aws-glue-what-is-it-whats-it-for#article\",\"isPartOf\":{\"@id\":\"https:\/\/datascientest.com\/en\/aws-glue-what-is-it-whats-it-for\"},\"author\":{\"name\":\"Melanie\",\"@id\":\"https:\/\/datascientest.com\/en\/#\/schema\/person\/19d5f7ade9407eb69af3bf6d1ae1731d\"},\"headline\":\"AWS Glue: What is it? What&#8217;s it for?\",\"datePublished\":\"2024-01-21T16:58:24+00:00\",\"dateModified\":\"2024-01-21T17:00:33+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/datascientest.com\/en\/aws-glue-what-is-it-whats-it-for\"},\"wordCount\":648,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\/\/datascientest.com\/en\/#organization\"},\"articleSection\":[\"Cloud &amp; Data Engineering\"],\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/datascientest.com\/en\/aws-glue-what-is-it-whats-it-for#respond\"]}],\"copyrightYear\":\"2024\",\"copyrightHolder\":{\"@id\":\"https:\/\/datascientest.com\/#organization\"}},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/datascientest.com\/en\/aws-glue-what-is-it-whats-it-for\",\"url\":\"https:\/\/datascientest.com\/en\/aws-glue-what-is-it-whats-it-for\",\"name\":\"AWS Glue: What is it? What's it for?\",\"isPartOf\":{\"@id\":\"https:\/\/datascientest.com\/en\/#website\"},\"datePublished\":\"2024-01-21T16:58:24+00:00\",\"dateModified\":\"2024-01-21T17:00:33+00:00\",\"description\":\"AWS Glue is a fully managed extract, transform, and load (ETL) service offered by Amazon Web Services (AWS). It automates the process of preparing and loading data for analysis.\",\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/datascientest.com\/en\/aws-glue-what-is-it-whats-it-for\"]}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/datascientest.com\/en\/#website\",\"url\":\"https:\/\/datascientest.com\/en\/\",\"name\":\"DataScientest\",\"description\":\"Leader in Data Science Courses\",\"publisher\":{\"@id\":\"https:\/\/datascientest.com\/en\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/datascientest.com\/en\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-GB\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/datascientest.com\/en\/#organization\",\"name\":\"DataScientest\",\"url\":\"https:\/\/datascientest.com\/en\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\/\/datascientest.com\/en\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/datascientest.com\/en\/wp-content\/blogs.dir\/9\/files\/2024\/02\/DataScientest_icon_blue-2.png\",\"contentUrl\":\"https:\/\/datascientest.com\/en\/wp-content\/blogs.dir\/9\/files\/2024\/02\/DataScientest_icon_blue-2.png\",\"width\":301,\"height\":301,\"caption\":\"DataScientest\"},\"image\":{\"@id\":\"https:\/\/datascientest.com\/en\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/www.facebook.com\/DataScientestEN\",\"https:\/\/twitter.com\/DataScientest__\",\"https:\/\/www.linkedin.com\/school\/datascientest\/mycompany\/\",\"https:\/\/www.tiktok.com\/@datascientest\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/datascientest.com\/en\/#\/schema\/person\/19d5f7ade9407eb69af3bf6d1ae1731d\",\"name\":\"Melanie\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\/\/datascientest.com\/en\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/8d3d660a0698de06f13ecf4823519da1?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/8d3d660a0698de06f13ecf4823519da1?s=96&d=mm&r=g\",\"caption\":\"Melanie\"},\"url\":\"https:\/\/datascientest.com\/en\/author\/melaniekrause\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"AWS Glue: What is it? What's it for?","description":"AWS Glue is a fully managed extract, transform, and load (ETL) service offered by Amazon Web Services (AWS). It automates the process of preparing and loading data for analysis.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/datascientest.com\/en\/aws-glue-what-is-it-whats-it-for","og_locale":"en_GB","og_type":"article","og_title":"AWS Glue: What is it? What's it for?","og_description":"AWS Glue is a fully managed, scalable data processing service that enables users to run serverless ETL (Extract, Transform, Load) workflows, freeing them","og_url":"https:\/\/datascientest.com\/en\/aws-glue-what-is-it-whats-it-for","og_site_name":"DataScientest","article_publisher":"https:\/\/www.facebook.com\/DataScientestEN","article_published_time":"2024-01-21T16:58:24+00:00","article_modified_time":"2024-01-21T17:00:33+00:00","og_image":[{"width":1024,"height":512,"url":"https:\/\/datascientest.com\/en\/files\/2024\/01\/AWS_GLUE_datascientest.webp","type":"image\/webp"}],"author":"Melanie","twitter_card":"summary_large_image","twitter_creator":"@DataScientest__","twitter_site":"@DataScientest__","twitter_misc":{"Written by":"Melanie","Estimated reading time":"5 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/datascientest.com\/en\/aws-glue-what-is-it-whats-it-for#article","isPartOf":{"@id":"https:\/\/datascientest.com\/en\/aws-glue-what-is-it-whats-it-for"},"author":{"name":"Melanie","@id":"https:\/\/datascientest.com\/en\/#\/schema\/person\/19d5f7ade9407eb69af3bf6d1ae1731d"},"headline":"AWS Glue: What is it? What&#8217;s it for?","datePublished":"2024-01-21T16:58:24+00:00","dateModified":"2024-01-21T17:00:33+00:00","mainEntityOfPage":{"@id":"https:\/\/datascientest.com\/en\/aws-glue-what-is-it-whats-it-for"},"wordCount":648,"commentCount":0,"publisher":{"@id":"https:\/\/datascientest.com\/en\/#organization"},"articleSection":["Cloud &amp; Data Engineering"],"inLanguage":"en-GB","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/datascientest.com\/en\/aws-glue-what-is-it-whats-it-for#respond"]}],"copyrightYear":"2024","copyrightHolder":{"@id":"https:\/\/datascientest.com\/#organization"}},{"@type":"WebPage","@id":"https:\/\/datascientest.com\/en\/aws-glue-what-is-it-whats-it-for","url":"https:\/\/datascientest.com\/en\/aws-glue-what-is-it-whats-it-for","name":"AWS Glue: What is it? What's it for?","isPartOf":{"@id":"https:\/\/datascientest.com\/en\/#website"},"datePublished":"2024-01-21T16:58:24+00:00","dateModified":"2024-01-21T17:00:33+00:00","description":"AWS Glue is a fully managed extract, transform, and load (ETL) service offered by Amazon Web Services (AWS). It automates the process of preparing and loading data for analysis.","inLanguage":"en-GB","potentialAction":[{"@type":"ReadAction","target":["https:\/\/datascientest.com\/en\/aws-glue-what-is-it-whats-it-for"]}]},{"@type":"WebSite","@id":"https:\/\/datascientest.com\/en\/#website","url":"https:\/\/datascientest.com\/en\/","name":"DataScientest","description":"Leader in Data Science Courses","publisher":{"@id":"https:\/\/datascientest.com\/en\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/datascientest.com\/en\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-GB"},{"@type":"Organization","@id":"https:\/\/datascientest.com\/en\/#organization","name":"DataScientest","url":"https:\/\/datascientest.com\/en\/","logo":{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/datascientest.com\/en\/#\/schema\/logo\/image\/","url":"https:\/\/datascientest.com\/en\/wp-content\/blogs.dir\/9\/files\/2024\/02\/DataScientest_icon_blue-2.png","contentUrl":"https:\/\/datascientest.com\/en\/wp-content\/blogs.dir\/9\/files\/2024\/02\/DataScientest_icon_blue-2.png","width":301,"height":301,"caption":"DataScientest"},"image":{"@id":"https:\/\/datascientest.com\/en\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/DataScientestEN","https:\/\/twitter.com\/DataScientest__","https:\/\/www.linkedin.com\/school\/datascientest\/mycompany\/","https:\/\/www.tiktok.com\/@datascientest"]},{"@type":"Person","@id":"https:\/\/datascientest.com\/en\/#\/schema\/person\/19d5f7ade9407eb69af3bf6d1ae1731d","name":"Melanie","image":{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/datascientest.com\/en\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/8d3d660a0698de06f13ecf4823519da1?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/8d3d660a0698de06f13ecf4823519da1?s=96&d=mm&r=g","caption":"Melanie"},"url":"https:\/\/datascientest.com\/en\/author\/melaniekrause"}]}},"_links":{"self":[{"href":"https:\/\/datascientest.com\/en\/wp-json\/wp\/v2\/posts\/177334"}],"collection":[{"href":"https:\/\/datascientest.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/datascientest.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/datascientest.com\/en\/wp-json\/wp\/v2\/users\/67"}],"replies":[{"embeddable":true,"href":"https:\/\/datascientest.com\/en\/wp-json\/wp\/v2\/comments?post=177334"}],"version-history":[{"count":0,"href":"https:\/\/datascientest.com\/en\/wp-json\/wp\/v2\/posts\/177334\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/datascientest.com\/en\/wp-json\/wp\/v2\/media\/177351"}],"wp:attachment":[{"href":"https:\/\/datascientest.com\/en\/wp-json\/wp\/v2\/media?parent=177334"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/datascientest.com\/en\/wp-json\/wp\/v2\/categories?post=177334"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/datascientest.com\/en\/wp-json\/wp\/v2\/tags?post=177334"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}